[2025-10-22T17:00:02.524473] [INFO ] [MAIN ] Using last completed trading day: 2025-10-22 [2025-10-22T17:00:02.698596] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-22T17:00:02.698791] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-22T17:00:02.803359] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-22T17:00:02.803740] [WARN ] [STATE ] State set to: RUNNING [2025-10-22T17:00:02.803828] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-22T17:00:02.803879] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-22T17:00:02.803958] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-22T17:00:02.803994] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-22T17:00:04.567954] [DEBUG] [SYMBOL ] Found 2419 valid NYSE symbols. [2025-10-22T17:00:04.568137] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-22T17:00:04.568419] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-22T17:00:04.568924] [INFO ] [LOCAL ] Symbols cache updated with 2367 symbols. [2025-10-22T17:00:04.568981] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-22T17:00:04.569015] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-22T17:00:04.569071] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-22T17:00:04.569103] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-22T17:00:04.569131] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-22T17:00:04.571437] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-22T17:00:04.571576] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-22T17:00:04.571802] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-22T17:00:04.571859] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2367 valid symbols. [2025-10-22T17:00:04.571892] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-22T17:00:04.571924] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-22T17:00:04.597685] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-22T17:00:04.625304] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-22T17:00:04.625497] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-22T17:00:04.625534] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-22T17:00:04.625564] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-22T17:00:04.625624] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-22T17:00:04.626012] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-22T17:00:04.626053] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-22T17:00:04.626085] [INFO ] [MAIN ] Starting incremental update for 2367 symbols. [2025-10-22T17:00:04.626114] [INFO ] [MAIN ] Running in parallel mode [2025-10-22T17:00:04.626296] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2367 symbols [2025-10-22T17:00:05.267876] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:05.315500] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:05.337053] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:05.345778] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-22T17:00:05.349731] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-10-22T17:00:05.350883] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-10-22T17:00:05.360772] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-22T17:00:05.360941] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-22T17:00:05.370521] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-22T17:00:05.375503] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:05.376366] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-22T17:00:05.376702] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-22T17:00:05.376509] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-22T17:00:05.376847] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-22T17:00:05.376599] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-22T17:00:05.377081] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-22T17:00:05.377202] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-22T17:00:05.377467] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-22T17:00:05.389008] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-22T17:00:05.377332] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-22T17:00:05.398671] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-22T17:00:05.398771] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-22T17:00:06.076335] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-22T17:00:06.164601] [INFO ] [MAIN ] AA: Loaded 53622 existing records. [2025-10-22T17:00:06.491020] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:06.517523] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-22T17:00:06.790164] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:06.813885] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:06.814224] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-22T17:00:06.814630] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-22T17:00:06.814381] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-22T17:00:06.818977] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:06.819473] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-22T17:00:06.819574] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-22T17:00:06.819420] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-22T17:00:07.182064] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:07.182424] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-22T17:00:07.220950] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-22T17:00:07.221986] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-22T17:00:07.489708] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-22T17:00:07.490618] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-22T17:00:07.835978] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-22T17:00:07.836913] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-22T17:00:08.139630] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T17:00:08.143544] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-22T17:00:08.226964] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-22T17:00:08.227947] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-22T17:00:08.471094] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-22T17:00:08.471972] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-22T17:00:08.600023] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T17:00:08.609619] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-22T17:00:08.772445] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-22T17:00:08.773286] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-22T17:00:08.851231] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T17:00:08.855062] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-22T17:00:09.074930] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T17:00:09.085321] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-22T17:00:09.094429] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-22T17:00:09.095247] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-22T17:00:09.366416] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-22T17:00:09.367458] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-22T17:00:09.616191] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-22T17:00:09.617068] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-22T17:00:09.826717] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T17:00:09.831991] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-22T17:00:09.918298] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:00:09.928076] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-22T17:00:10.005360] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-22T17:00:10.006070] [INFO ] [REMOTE ] AAM: Full fetch complete (916 records). [2025-10-22T17:00:10.006142] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-22T17:00:10.179881] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-22T17:00:10.180048] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:00:10.180117] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:00:10.180190] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-22T17:00:10.180256] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-22T17:00:10.180293] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-22T17:00:10.180332] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-22T17:00:10.180389] [INFO ] [MAIN ] Update Progress: 1/2367 symbols completed. AAM took 5.5s. Estimated remaining: 3h 39m 1s. Rate: 10.8 symbols/min [2025-10-22T17:00:10.344337] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:10.395771] [DEBUG] [LOCAL ] AAP: Loaded 51758 existing records from primary storage. [2025-10-22T17:00:10.396086] [INFO ] [MAIN ] AAP: Loaded 51758 existing records. [2025-10-22T17:00:10.570077] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:10.570271] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-22T17:00:10.570318] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-22T17:00:10.570702] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-22T17:00:10.570759] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-22T17:00:10.929723] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:10.930211] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-22T17:00:11.011119] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-22T17:00:11.021692] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-22T17:00:11.079217] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T17:00:11.086016] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-22T17:00:11.874091] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T17:00:11.884430] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-22T17:00:12.253894] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:00:12.259301] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-22T17:00:12.319989] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T17:00:12.329782] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-22T17:00:13.002268] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T17:00:13.013456] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-22T17:00:13.172762] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T17:00:13.177731] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-22T17:00:13.787092] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T17:00:13.799635] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-22T17:00:14.121511] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T17:00:14.127997] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-22T17:00:14.202962] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T17:00:14.212461] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-22T17:00:14.936907] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T17:00:14.948449] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-22T17:00:15.534690] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T17:00:15.540333] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-22T17:00:15.947057] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T17:00:15.964688] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-22T17:00:15.999427] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-22T17:00:16.010601] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-22T17:00:16.624598] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T17:00:16.635923] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-22T17:00:16.713811] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T17:00:16.720150] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-22T17:00:17.682500] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:00:17.693887] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-22T17:00:17.795147] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T17:00:17.806705] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-22T17:00:17.817917] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T17:00:17.821896] [INFO ] [REMOTE ] AAMI: Full fetch complete (33173 records). [2025-10-22T17:00:17.822017] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-22T17:00:18.201783] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-10-22T17:00:18.201878] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-10-22T17:00:18.202263] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-10-22T17:00:18.202308] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-10-22T17:00:18.203284] [DEBUG] [LOCAL ] AAMI: Trimmed 33173 records to 24441 (keeping 200 days of data) [2025-10-22T17:00:18.369953] [DEBUG] [LOCAL ] AAMI: Primary data saved (24441 records). [2025-10-22T17:00:18.370104] [INFO ] [MAIN ] AAMI: Full history saved. [2025-10-22T17:00:18.370184] [INFO ] [MAIN ] Update Progress: 2/2367 symbols completed. AAMI took 13.7s. Estimated remaining: 4h 30m 52s. Rate: 8.7 symbols/min [2025-10-22T17:00:18.542958] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:18.543170] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-10-22T17:00:18.543239] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-10-22T17:00:18.543484] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-22T17:00:18.543555] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-22T17:00:18.543712] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-22T17:00:18.543844] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-22T17:00:18.879554] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-22T17:00:18.946807] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-22T17:00:18.950310] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:18.951549] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-22T17:00:19.426335] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T17:00:19.438013] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-22T17:00:19.563963] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T17:00:19.575512] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-22T17:00:20.237266] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T17:00:20.242986] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-22T17:00:21.088852] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T17:00:21.100052] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-22T17:00:21.143472] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-22T17:00:21.155786] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-22T17:00:21.256545] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T17:00:21.262921] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-22T17:00:21.298222] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T17:00:21.310534] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-22T17:00:22.402481] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T17:00:22.408826] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-22T17:00:22.706728] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T17:00:22.717967] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-22T17:00:22.797036] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T17:00:22.808566] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-22T17:00:23.223445] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-22T17:00:23.236548] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-22T17:00:23.804715] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:00:23.812191] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-22T17:00:24.377755] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:00:24.390885] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-22T17:00:24.578973] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:00:24.590690] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-22T17:00:24.684500] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T17:00:24.691207] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-22T17:00:24.968461] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T17:00:24.977332] [INFO ] [REMOTE ] A: Full fetch complete (73600 records). [2025-10-22T17:00:24.977494] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-22T17:00:25.372790] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-22T17:00:25.372882] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-22T17:00:25.373545] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-22T17:00:25.373596] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-22T17:00:25.375244] [DEBUG] [LOCAL ] A: Trimmed 73600 records to 50664 (keeping 200 days of data) [2025-10-22T17:00:25.706271] [DEBUG] [LOCAL ] A: Primary data saved (50664 records). [2025-10-22T17:00:25.706427] [INFO ] [MAIN ] A: Full history saved. [2025-10-22T17:00:25.706518] [INFO ] [MAIN ] Update Progress: 3/2367 symbols completed. A took 21.1s. Estimated remaining: 4h 36m 51s. Rate: 8.5 symbols/min [2025-10-22T17:00:25.896456] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:25.896916] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-22T17:00:25.897287] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-22T17:00:25.897513] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-22T17:00:25.897831] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-22T17:00:25.897950] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-22T17:00:25.916887] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-22T17:00:25.918977] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T17:00:26.002687] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-22T17:00:26.317968] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:00:26.381614] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-22T17:00:26.567264] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:26.567737] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-22T17:00:26.786467] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:00:26.786944] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-22T17:00:26.787043] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:00:26.787099] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-22T17:00:26.787468] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:00:26.787603] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-22T17:00:26.787819] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-22T17:00:26.787907] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-22T17:00:26.787964] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-22T17:00:26.788042] [INFO ] [MAIN ] Update Progress: 4/2367 symbols completed. AAUC took 1.1s. Estimated remaining: 3h 38m 12s. Rate: 10.8 symbols/min [2025-10-22T17:00:27.011580] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:27.013970] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-22T17:00:27.023249] [INFO ] [REMOTE ] AA: Full fetch complete (77733 records). [2025-10-22T17:00:27.023399] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-22T17:00:27.221721] [DEBUG] [LOCAL ] AB: Loaded 24859 existing records from primary storage. [2025-10-22T17:00:27.241025] [INFO ] [MAIN ] AB: Loaded 24859 existing records. [2025-10-22T17:00:27.587023] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-22T17:00:27.592279] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-22T17:00:27.624875] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-22T17:00:27.651195] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:27.651675] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-22T17:00:27.652189] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-22T17:00:27.652491] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-22T17:00:27.668623] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-22T17:00:27.668894] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-22T17:00:27.694829] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T17:00:27.747185] [DEBUG] [LOCAL ] AA: Trimmed 77733 records to 53622 (keeping 200 days of data) [2025-10-22T17:00:27.777945] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-22T17:00:28.273808] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:28.304948] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-22T17:00:28.420164] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T17:00:28.433442] [INFO ] [REMOTE ] AAP: Full fetch complete (75116 records). [2025-10-22T17:00:28.435774] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-22T17:00:28.738991] [DEBUG] [LOCAL ] AA: Primary data saved (53622 records). [2025-10-22T17:00:28.767248] [INFO ] [MAIN ] AA: Full history saved. [2025-10-22T17:00:28.778911] [INFO ] [MAIN ] Update Progress: 5/2367 symbols completed. AA took 24.1s. Estimated remaining: 3h 10m 10s. Rate: 12.4 symbols/min [2025-10-22T17:00:28.950940] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-22T17:00:28.956295] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-22T17:00:28.979536] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-22T17:00:28.979737] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-22T17:00:29.050517] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:29.067361] [DEBUG] [LOCAL ] AAP: Trimmed 75116 records to 51734 (keeping 200 days of data) [2025-10-22T17:00:29.068570] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-22T17:00:29.136014] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-22T17:00:29.421891] [DEBUG] [LOCAL ] ABBV: Loaded 53682 existing records from primary storage. [2025-10-22T17:00:29.428549] [INFO ] [MAIN ] ABBV: Loaded 53682 existing records. [2025-10-22T17:00:29.570969] [DEBUG] [LOCAL ] AAP: Primary data saved (51734 records). [2025-10-22T17:00:29.614087] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-22T17:00:29.644749] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:29.645684] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-22T17:00:29.645804] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-22T17:00:29.645529] [INFO ] [MAIN ] Update Progress: 6/2367 symbols completed. AAP took 19.5s. Estimated remaining: 2h 44m 5s. Rate: 14.4 symbols/min [2025-10-22T17:00:29.651447] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-22T17:00:29.691724] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-22T17:00:29.950220] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:30.053688] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:00:30.115923] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-22T17:00:30.211199] [DEBUG] [LOCAL ] ABCB: Loaded 30362 existing records from primary storage. [2025-10-22T17:00:30.242296] [INFO ] [MAIN ] ABCB: Loaded 30362 existing records. [2025-10-22T17:00:30.275211] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:30.280684] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-22T17:00:30.443700] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T17:00:30.484852] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:30.485394] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-22T17:00:30.485468] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-22T17:00:30.486091] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-22T17:00:30.486161] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-22T17:00:30.486045] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-22T17:00:30.836578] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:30.836935] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-22T17:00:31.703614] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T17:00:31.712193] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-22T17:00:32.023574] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:00:32.032331] [INFO ] [REMOTE ] AAT: Full fetch complete (43082 records). [2025-10-22T17:00:32.032569] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-22T17:00:32.369171] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T17:00:32.398603] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-22T17:00:32.464817] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-22T17:00:32.465025] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-22T17:00:32.465500] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-22T17:00:32.465683] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-22T17:00:32.466968] [DEBUG] [LOCAL ] AAT: Trimmed 43082 records to 30227 (keeping 200 days of data) [2025-10-22T17:00:32.619763] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-22T17:00:32.636668] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-22T17:00:32.699772] [DEBUG] [LOCAL ] AAT: Primary data saved (30227 records). [2025-10-22T17:00:32.699915] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-22T17:00:32.699987] [INFO ] [MAIN ] Update Progress: 7/2367 symbols completed. AAT took 14.3s. Estimated remaining: 2h 37m 45s. Rate: 15.0 symbols/min [2025-10-22T17:00:32.878276] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:32.927456] [DEBUG] [LOCAL ] ABEV: Loaded 53287 existing records from primary storage. [2025-10-22T17:00:32.927910] [INFO ] [MAIN ] ABEV: Loaded 53287 existing records. [2025-10-22T17:00:33.121732] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:33.121921] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-22T17:00:33.121969] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-22T17:00:33.122202] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-22T17:00:33.122258] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-22T17:00:33.524462] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:33.525234] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-22T17:00:33.527564] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:00:33.554074] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-22T17:00:33.555025] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T17:00:33.562319] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-22T17:00:34.544318] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T17:00:34.554458] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-22T17:00:35.267753] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:00:35.275300] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-22T17:00:35.305153] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T17:00:35.314117] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-22T17:00:35.528716] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T17:00:35.539182] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-22T17:00:36.325909] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:00:36.337561] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-22T17:00:36.557060] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-22T17:00:36.563610] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-22T17:00:36.592813] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T17:00:36.600751] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-22T17:00:36.965193] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T17:00:36.975083] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-22T17:00:37.602925] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T17:00:37.607612] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-22T17:00:37.798967] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T17:00:37.805276] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-22T17:00:38.422387] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T17:00:38.428307] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-22T17:00:38.502380] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-22T17:00:38.513953] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-22T17:00:38.600222] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:00:38.612362] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-22T17:00:39.045300] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:00:39.051207] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-22T17:00:39.549514] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T17:00:39.554797] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-22T17:00:40.449602] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T17:00:40.501301] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-22T17:00:40.515817] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T17:00:40.528749] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T17:00:40.533464] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-22T17:00:40.542124] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-22T17:00:40.836751] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T17:00:40.842339] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-22T17:00:41.627754] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T17:00:41.635392] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-22T17:00:42.067736] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T17:00:42.072303] [INFO ] [REMOTE ] AB: Full fetch complete (44104 records). [2025-10-22T17:00:42.072437] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-22T17:00:42.515136] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-22T17:00:42.517058] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T17:00:42.527487] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-22T17:00:42.528721] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-22T17:00:42.528813] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-22T17:00:42.529599] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-22T17:00:42.531472] [DEBUG] [LOCAL ] AB: Trimmed 44104 records to 24673 (keeping 200 days of data) [2025-10-22T17:00:42.674549] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T17:00:42.702957] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-22T17:00:42.719714] [DEBUG] [LOCAL ] AB: Primary data saved (24673 records). [2025-10-22T17:00:42.719791] [INFO ] [MAIN ] AB: Full history saved. [2025-10-22T17:00:42.719865] [INFO ] [MAIN ] Update Progress: 8/2367 symbols completed. AB took 15.9s. Estimated remaining: 3h 7m 13s. Rate: 12.6 symbols/min [2025-10-22T17:00:42.896039] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:42.896244] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-10-22T17:00:42.896315] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-10-22T17:00:42.896583] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-22T17:00:42.896685] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-22T17:00:42.896810] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-22T17:00:42.896973] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-22T17:00:43.016933] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T17:00:43.047608] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-22T17:00:43.290671] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:43.290984] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-22T17:00:43.992165] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T17:00:44.002875] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-22T17:00:44.412827] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T17:00:44.417282] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-22T17:00:44.897357] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-22T17:00:44.909044] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-22T17:00:45.072272] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T17:00:45.075920] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-22T17:00:45.968242] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T17:00:45.979890] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-22T17:00:46.237326] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T17:00:46.242197] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-22T17:00:47.067850] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T17:00:47.079587] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-22T17:00:47.155188] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T17:00:47.161370] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-22T17:00:47.833693] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T17:00:47.845567] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-22T17:00:47.855536] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T17:00:47.859557] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-22T17:00:48.716617] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (5.67 seconds). [2025-10-22T17:00:48.722111] [INFO ] [REMOTE ] ABCB: Full fetch complete (44980 records). [2025-10-22T17:00:48.722201] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-22T17:00:49.038913] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T17:00:49.059129] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T17:00:49.151224] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-22T17:00:49.145711] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-22T17:00:49.163192] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-22T17:00:49.163841] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-22T17:00:49.164355] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-22T17:00:49.164516] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-22T17:00:49.166097] [DEBUG] [LOCAL ] ABCB: Trimmed 44980 records to 30308 (keeping 200 days of data) [2025-10-22T17:00:49.344722] [DEBUG] [LOCAL ] ABCB: Primary data saved (30308 records). [2025-10-22T17:00:49.344850] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-22T17:00:49.344954] [INFO ] [MAIN ] Update Progress: 9/2367 symbols completed. ABCB took 19.7s. Estimated remaining: 3h 15m 16s. Rate: 12.1 symbols/min [2025-10-22T17:00:49.514108] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:49.544110] [DEBUG] [LOCAL ] ABM: Loaded 32115 existing records from primary storage. [2025-10-22T17:00:49.544373] [INFO ] [MAIN ] ABM: Loaded 32115 existing records. [2025-10-22T17:00:49.725741] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:49.726110] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-22T17:00:49.726228] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-22T17:00:49.726428] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-22T17:00:49.726493] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-22T17:00:49.882506] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:00:50.052513] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-22T17:00:50.135334] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:50.135843] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-22T17:00:50.158505] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T17:00:50.167552] [INFO ] [REMOTE ] ABBV: Full fetch complete (77456 records). [2025-10-22T17:00:50.167742] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-22T17:00:50.168669] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:00:50.168762] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:00:50.168837] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:00:50.168910] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-22T17:00:50.168972] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-22T17:00:50.169008] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-22T17:00:50.169141] [DEBUG] [LOCAL ] ABBV: Deleted derivative data file. [2025-10-22T17:00:50.170996] [INFO ] [MAIN ] Update Progress: 10/2367 symbols completed. ABBV took 21.4s. Estimated remaining: 2h 58m 55s. Rate: 13.2 symbols/min [2025-10-22T17:00:50.339559] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:50.381215] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T17:00:50.386334] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-22T17:00:50.404180] [DEBUG] [LOCAL ] ABR: Loaded 51919 existing records from primary storage. [2025-10-22T17:00:50.404475] [INFO ] [MAIN ] ABR: Loaded 51919 existing records. [2025-10-22T17:00:50.578270] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:50.578459] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-22T17:00:50.578505] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-22T17:00:50.578717] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-22T17:00:50.578773] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-22T17:00:50.925754] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:50.926059] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-22T17:00:51.143852] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T17:00:51.149713] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-22T17:00:51.478558] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T17:00:51.483289] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-22T17:00:51.712248] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:00:51.721283] [INFO ] [REMOTE ] ABEV: Full fetch complete (77339 records). [2025-10-22T17:00:51.721410] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-22T17:00:52.116104] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-22T17:00:52.116272] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-22T17:00:52.117031] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-22T17:00:52.117114] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-22T17:00:52.118719] [DEBUG] [LOCAL ] ABEV: Trimmed 77339 records to 53284 (keeping 200 days of data) [2025-10-22T17:00:52.344995] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T17:00:52.351774] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-22T17:00:52.449251] [DEBUG] [LOCAL ] ABEV: Primary data saved (53284 records). [2025-10-22T17:00:52.449395] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-22T17:00:52.449496] [INFO ] [MAIN ] Update Progress: 11/2367 symbols completed. ABEV took 19.7s. Estimated remaining: 2h 50m 43s. Rate: 13.8 symbols/min [2025-10-22T17:00:52.537969] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:00:52.574447] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-22T17:00:52.639497] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:52.689746] [DEBUG] [LOCAL ] ABT: Loaded 53623 existing records from primary storage. [2025-10-22T17:00:52.690074] [INFO ] [MAIN ] ABT: Loaded 53623 existing records. [2025-10-22T17:00:52.866774] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:52.867144] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-22T17:00:52.867199] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-22T17:00:52.867448] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-22T17:00:52.882168] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-22T17:00:52.962191] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T17:00:53.004036] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-22T17:00:53.279195] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:53.279506] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-22T17:00:53.589444] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T17:00:53.592430] [INFO ] [REMOTE ] ABG: Full fetch complete (26737 records). [2025-10-22T17:00:53.592503] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-22T17:00:53.976740] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T17:00:53.976970] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-22T17:00:53.984117] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-22T17:00:53.983843] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-22T17:00:53.984458] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-22T17:00:53.984534] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-22T17:00:53.985931] [DEBUG] [LOCAL ] ABG: Trimmed 26737 records to 17859 (keeping 200 days of data) [2025-10-22T17:00:54.089722] [DEBUG] [LOCAL ] ABG: Primary data saved (17859 records). [2025-10-22T17:00:54.089847] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-22T17:00:54.089924] [INFO ] [MAIN ] Update Progress: 12/2367 symbols completed. ABG took 11.4s. Estimated remaining: 2h 41m 47s. Rate: 14.6 symbols/min [2025-10-22T17:00:54.255769] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:54.255910] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-22T17:00:54.255947] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-22T17:00:54.256067] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-22T17:00:54.256108] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-22T17:00:54.256149] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-22T17:00:54.256181] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-22T17:00:54.603241] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:54.603543] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-22T17:00:54.882772] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T17:00:54.892708] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-22T17:00:55.229720] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T17:00:55.240916] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-22T17:00:55.575840] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T17:00:55.583258] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-22T17:00:55.606677] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T17:00:55.611364] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-22T17:00:56.673538] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T17:00:56.679225] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-22T17:00:56.755128] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:00:56.761289] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-22T17:00:56.803779] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T17:00:56.815533] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-22T17:00:56.846463] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T17:00:56.857898] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-22T17:00:57.866865] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T17:00:57.873303] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-22T17:00:58.158607] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T17:00:58.165876] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-22T17:00:58.618019] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T17:00:58.629435] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-22T17:00:58.745155] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T17:00:58.756425] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-22T17:00:58.772995] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T17:00:58.779051] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-22T17:00:59.342732] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T17:00:59.351135] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-22T17:00:59.957587] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T17:00:59.966637] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-22T17:01:00.338996] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T17:01:00.346378] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-22T17:01:00.611925] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T17:01:00.623194] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-22T17:01:00.708479] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T17:01:00.719413] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-22T17:01:01.190991] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T17:01:01.195979] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-22T17:01:02.100729] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T17:01:02.109241] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-22T17:01:02.407577] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T17:01:02.413959] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-22T17:01:02.497587] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T17:01:02.509416] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-22T17:01:02.657129] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T17:01:02.667771] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-22T17:01:03.507734] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T17:01:03.513111] [INFO ] [REMOTE ] ABM: Full fetch complete (44797 records). [2025-10-22T17:01:03.513237] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-22T17:01:03.514189] [FATAL] [VALIDATOR ] ABM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:01:03.514278] [FATAL] [MAIN ] ABM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:01:03.514321] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:01:03.514386] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-22T17:01:03.514450] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-22T17:01:03.514487] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-22T17:01:03.514630] [DEBUG] [LOCAL ] ABM: Deleted derivative data file. [2025-10-22T17:01:03.516107] [INFO ] [MAIN ] Update Progress: 13/2367 symbols completed. ABM took 14.2s. Estimated remaining: 2h 57m 44s. Rate: 13.2 symbols/min [2025-10-22T17:01:03.709009] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T17:01:03.712299] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:03.719104] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-22T17:01:03.760664] [DEBUG] [LOCAL ] ACCO: Loaded 36747 existing records from primary storage. [2025-10-22T17:01:03.760976] [INFO ] [MAIN ] ACCO: Loaded 36747 existing records. [2025-10-22T17:01:03.947994] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:03.948360] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-22T17:01:03.948600] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-22T17:01:03.948908] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-22T17:01:03.948958] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-22T17:01:04.324041] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:04.324489] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-22T17:01:04.362293] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T17:01:04.375554] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-22T17:01:04.707239] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-22T17:01:04.718979] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-22T17:01:04.753197] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:01:04.762396] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-22T17:01:05.782285] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T17:01:05.790415] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-22T17:01:05.832190] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T17:01:05.835592] [INFO ] [REMOTE ] ACA: Full fetch complete (34143 records). [2025-10-22T17:01:05.835697] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-22T17:01:05.836356] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:01:05.836479] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:01:05.836521] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:01:05.836560] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-22T17:01:05.836627] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-22T17:01:05.836706] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-22T17:01:05.836761] [DEBUG] [LOCAL ] ACA: No derivative data file found to delete. [2025-10-22T17:01:05.836816] [INFO ] [MAIN ] Update Progress: 14/2367 symbols completed. ACA took 11.7s. Estimated remaining: 2h 51m 28s. Rate: 13.7 symbols/min [2025-10-22T17:01:06.002287] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:06.042229] [DEBUG] [LOCAL ] ACEL: Loaded 26474 existing records from primary storage. [2025-10-22T17:01:06.042486] [INFO ] [MAIN ] ACEL: Loaded 26474 existing records. [2025-10-22T17:01:06.224579] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:06.224834] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-22T17:01:06.224882] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-22T17:01:06.225308] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-22T17:01:06.225365] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-22T17:01:06.595750] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:06.596462] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-22T17:01:06.659075] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-22T17:01:06.661365] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T17:01:06.683278] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-22T17:01:07.122040] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T17:01:07.317681] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-22T17:01:07.828035] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T17:01:08.117692] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-22T17:01:08.590756] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T17:01:08.917735] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-22T17:01:09.039447] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T17:01:09.717796] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-22T17:01:09.768477] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:01:10.517773] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-22T17:01:10.772129] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T17:01:10.809165] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T17:01:11.317730] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-22T17:01:11.607062] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T17:01:12.117617] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-22T17:01:12.551707] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T17:01:12.917755] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-22T17:01:13.671235] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T17:01:13.717629] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-22T17:01:14.270743] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T17:01:14.517684] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-22T17:01:15.289485] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T17:01:15.318332] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-22T17:01:15.321373] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T17:01:15.320275] [INFO ] [REMOTE ] ABT: Full fetch complete (77771 records). [2025-10-22T17:01:15.329662] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-22T17:01:15.713326] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-22T17:01:15.713405] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-22T17:01:15.714121] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-22T17:01:15.714186] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-22T17:01:15.715766] [DEBUG] [LOCAL ] ABT: Trimmed 77771 records to 53624 (keeping 200 days of data) [2025-10-22T17:01:16.046627] [DEBUG] [LOCAL ] ABT: Primary data saved (53624 records). [2025-10-22T17:01:16.046830] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-22T17:01:16.046948] [INFO ] [MAIN ] Update Progress: 15/2367 symbols completed. ABT took 23.6s. Estimated remaining: 3h 6m 39s. Rate: 12.6 symbols/min [2025-10-22T17:01:16.122835] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-22T17:01:16.219919] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:16.220060] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-10-22T17:01:16.220097] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-10-22T17:01:16.220206] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-22T17:01:16.220275] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-22T17:01:16.220348] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-22T17:01:16.220409] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-22T17:01:16.570229] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:16.917756] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-22T17:01:17.360386] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T17:01:17.368511] [INFO ] [REMOTE ] ABR: Full fetch complete (75039 records). [2025-10-22T17:01:17.368679] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-22T17:01:17.369493] [FATAL] [VALIDATOR ] ABR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:01:17.369580] [FATAL] [MAIN ] ABR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:01:17.369626] [WARN ] [MAIN ] ABR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:01:17.369749] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-22T17:01:17.369834] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-22T17:01:17.369888] [INFO ] [LOCAL ] ABR: Starting deletion of derivative data. [2025-10-22T17:01:17.370036] [DEBUG] [LOCAL ] ABR: Deleted derivative data file. [2025-10-22T17:01:17.371096] [INFO ] [MAIN ] Update Progress: 16/2367 symbols completed. ABR took 27.2s. Estimated remaining: 2h 58m 9s. Rate: 13.2 symbols/min [2025-10-22T17:01:17.544017] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:17.582135] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T17:01:17.625142] [DEBUG] [LOCAL ] ACI: Loaded 53286 existing records from primary storage. [2025-10-22T17:01:17.625458] [INFO ] [MAIN ] ACI: Loaded 53286 existing records. [2025-10-22T17:01:17.722871] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-22T17:01:17.809552] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:17.809809] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-22T17:01:17.809873] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-22T17:01:17.810088] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-22T17:01:17.810145] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-22T17:01:18.244469] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:18.264880] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T17:01:18.517939] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-22T17:01:19.004752] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T17:01:19.317681] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-22T17:01:20.117629] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-22T17:01:20.305133] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T17:01:20.917702] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-22T17:01:21.460942] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T17:01:21.717639] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-22T17:01:21.887622] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-22T17:01:21.926343] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T17:01:22.517777] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-22T17:01:22.887457] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T17:01:22.893101] [INFO ] [REMOTE ] ACCO: Full fetch complete (53784 records). [2025-10-22T17:01:22.893248] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-22T17:01:22.894067] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:01:22.894168] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:01:22.894212] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:01:22.894253] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-22T17:01:22.894325] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-22T17:01:22.894384] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-22T17:01:22.894517] [DEBUG] [LOCAL ] ACCO: Deleted derivative data file. [2025-10-22T17:01:22.895256] [INFO ] [MAIN ] Update Progress: 17/2367 symbols completed. ACCO took 19.4s. Estimated remaining: 3h 0m 20s. Rate: 13.0 symbols/min [2025-10-22T17:01:23.071935] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:23.114823] [DEBUG] [LOCAL ] ACM: Loaded 42827 existing records from primary storage. [2025-10-22T17:01:23.115141] [INFO ] [MAIN ] ACM: Loaded 42827 existing records. [2025-10-22T17:01:23.297776] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:23.297969] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-22T17:01:23.298018] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-22T17:01:23.298206] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-22T17:01:23.298245] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-22T17:01:23.322873] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-22T17:01:23.669604] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:24.117685] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-22T17:01:24.534304] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T17:01:24.753939] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-22T17:01:24.917754] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-22T17:01:25.717678] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-22T17:01:25.797576] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T17:01:26.131276] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T17:01:26.517756] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-22T17:01:27.317696] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-22T17:01:27.420300] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T17:01:27.940097] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T17:01:28.117746] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-22T17:01:28.917748] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-22T17:01:29.660706] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T17:01:29.717731] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-22T17:01:29.866081] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-22T17:01:30.517774] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-22T17:01:30.746567] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:01:30.831956] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T17:01:31.317723] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-22T17:01:32.117760] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-22T17:01:32.794046] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T17:01:32.917741] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-22T17:01:32.999090] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-22T17:01:33.717751] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-22T17:01:33.904453] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T17:01:33.996432] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:01:34.001109] [INFO ] [REMOTE ] ACEL: Full fetch complete (38757 records). [2025-10-22T17:01:34.001292] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-22T17:01:34.392085] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-22T17:01:34.392211] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-22T17:01:34.392744] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-22T17:01:34.392846] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-22T17:01:34.394261] [DEBUG] [LOCAL ] ACEL: Trimmed 38757 records to 26346 (keeping 200 days of data) [2025-10-22T17:01:34.521409] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-22T17:01:34.562368] [DEBUG] [LOCAL ] ACEL: Primary data saved (26346 records). [2025-10-22T17:01:34.562577] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-22T17:01:34.562718] [INFO ] [MAIN ] Update Progress: 18/2367 symbols completed. ACEL took 28.7s. Estimated remaining: 3h 15m 37s. Rate: 12.0 symbols/min [2025-10-22T17:01:34.749870] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:34.807573] [DEBUG] [LOCAL ] ACN: Loaded 53440 existing records from primary storage. [2025-10-22T17:01:34.808076] [INFO ] [MAIN ] ACN: Loaded 53440 existing records. [2025-10-22T17:01:35.023227] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:35.023756] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-22T17:01:35.023842] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-22T17:01:35.024127] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-22T17:01:35.024217] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-22T17:01:35.322730] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-22T17:01:35.402765] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T17:01:35.496296] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:36.117797] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-22T17:01:36.917686] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-22T17:01:37.006965] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:01:37.082782] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-22T17:01:37.527360] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T17:01:37.717752] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-22T17:01:38.517795] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-22T17:01:38.920998] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T17:01:39.008220] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T17:01:39.317680] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-22T17:01:40.117678] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-22T17:01:40.214374] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T17:01:40.917697] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-22T17:01:40.948936] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:01:41.717687] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-22T17:01:42.019339] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T17:01:42.517738] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-22T17:01:43.317739] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-22T17:01:43.556295] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-22T17:01:43.641451] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T17:01:44.072330] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T17:01:44.117851] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-22T17:01:44.917739] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-22T17:01:45.239560] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T17:01:45.717935] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-22T17:01:46.517669] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-22T17:01:46.608367] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T17:01:46.869903] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-22T17:01:47.317947] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-22T17:01:47.529213] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T17:01:48.117936] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-22T17:01:48.605888] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-22T17:01:48.917751] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-22T17:01:49.377343] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T17:01:49.385987] [INFO ] [REMOTE ] ACM: Full fetch complete (63037 records). [2025-10-22T17:01:49.386231] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-22T17:01:49.387541] [FATAL] [VALIDATOR ] ACM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:01:49.387638] [FATAL] [MAIN ] ACM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:01:49.387749] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:01:49.387814] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-22T17:01:49.387886] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-22T17:01:49.387936] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-10-22T17:01:49.388126] [DEBUG] [LOCAL ] ACM: Deleted derivative data file. [2025-10-22T17:01:49.388953] [INFO ] [MAIN ] Update Progress: 19/2367 symbols completed. ACM took 26.5s. Estimated remaining: 3h 35m 46s. Rate: 10.9 symbols/min [2025-10-22T17:01:49.569833] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:49.609100] [DEBUG] [LOCAL ] ACP: Loaded 31078 existing records from primary storage. [2025-10-22T17:01:49.609470] [INFO ] [MAIN ] ACP: Loaded 31078 existing records. [2025-10-22T17:01:49.721448] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-22T17:01:49.812338] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:49.812627] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-22T17:01:49.812714] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-22T17:01:49.812964] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-22T17:01:49.813006] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-22T17:01:50.200516] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:50.517792] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-22T17:01:50.651660] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T17:01:50.805257] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-22T17:01:51.317778] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-22T17:01:51.416078] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T17:01:51.425183] [INFO ] [REMOTE ] ACI: Full fetch complete (77233 records). [2025-10-22T17:01:51.425346] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-22T17:01:51.839513] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-22T17:01:51.839698] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-22T17:01:51.840474] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-22T17:01:51.840566] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-22T17:01:51.843060] [DEBUG] [LOCAL ] ACI: Trimmed 77233 records to 53286 (keeping 200 days of data) [2025-10-22T17:01:51.967856] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T17:01:52.129310] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-22T17:01:52.209966] [DEBUG] [LOCAL ] ACI: Primary data saved (53286 records). [2025-10-22T17:01:52.210126] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-22T17:01:52.211162] [INFO ] [MAIN ] Update Progress: 20/2367 symbols completed. ACI took 34.8s. Estimated remaining: 3h 30m 25s. Rate: 11.2 symbols/min [2025-10-22T17:01:52.381749] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:52.381943] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-10-22T17:01:52.381983] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-10-22T17:01:52.382093] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-22T17:01:52.382134] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-22T17:01:52.382177] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-22T17:01:52.382210] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-22T17:01:52.737848] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:52.917745] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-22T17:01:53.121472] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:01:53.389679] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T17:01:53.717758] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-22T17:01:54.517767] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-22T17:01:55.013961] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T17:01:55.199582] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-22T17:01:55.317807] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-22T17:01:55.444179] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-22T17:01:55.721024] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T17:01:56.117675] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-22T17:01:56.917782] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-22T17:01:57.717737] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-22T17:01:58.517795] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-22T17:01:58.534677] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T17:01:59.067965] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-22T17:01:59.111714] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-22T17:01:59.122415] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-22T17:01:59.122616] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-22T17:01:59.322677] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-22T17:01:59.580926] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-22T17:01:59.581046] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-22T17:01:59.581855] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-22T17:01:59.581931] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-22T17:01:59.583727] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-22T17:01:59.924019] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-22T17:01:59.924327] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-22T17:01:59.924546] [INFO ] [MAIN ] Update Progress: 21/2367 symbols completed. ACHR took 43.9s. Estimated remaining: 3h 34m 40s. Rate: 10.9 symbols/min [2025-10-22T17:02:00.106047] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T17:02:00.127202] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-22T17:02:00.169722] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:00.170063] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-10-22T17:02:00.170143] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-10-22T17:02:00.176068] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T17:02:00.176556] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-22T17:02:00.179235] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-22T17:02:00.179321] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-22T17:02:00.179360] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-22T17:02:00.540688] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:00.917769] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-22T17:02:01.717753] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-22T17:02:02.148781] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-22T17:02:02.172289] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T17:02:02.517700] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-22T17:02:02.703953] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T17:02:03.119262] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T17:02:03.317732] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-22T17:02:03.881300] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T17:02:04.117746] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-22T17:02:04.917736] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-22T17:02:05.612034] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T17:02:05.717740] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-22T17:02:05.974572] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T17:02:06.517699] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-22T17:02:07.226616] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T17:02:07.317749] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-22T17:02:07.430490] [DEBUG] [REMOTE ] ACP: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-22T17:02:07.430867] [WARN ] [REMOTE ] ACP: No data returned for month 2025-06 [2025-10-22T17:02:07.430975] [FATAL] [REMOTE ] ACP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:02:07.431101] [FATAL] [MAIN ] ACP: Failed to fetch primary data. [2025-10-22T17:02:07.431203] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:02:07.431294] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-22T17:02:07.431379] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-22T17:02:07.431433] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-22T17:02:07.431580] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-10-22T17:02:07.432298] [INFO ] [MAIN ] Update Progress: 22/2367 symbols completed. ACP took 18.0s. Estimated remaining: 3h 38m 10s. Rate: 10.7 symbols/min [2025-10-22T17:02:07.614218] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:07.625048] [DEBUG] [LOCAL ] ACV: Loaded 7423 existing records from primary storage. [2025-10-22T17:02:07.625263] [INFO ] [MAIN ] ACV: Loaded 7423 existing records. [2025-10-22T17:02:07.816954] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:07.817531] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-22T17:02:07.817799] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-22T17:02:07.818049] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-22T17:02:07.818403] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-22T17:02:08.026084] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T17:02:08.124569] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-22T17:02:08.244181] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:08.789682] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T17:02:08.917695] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-22T17:02:09.717696] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-22T17:02:10.241265] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T17:02:10.509301] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T17:02:10.517618] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-22T17:02:11.146485] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T17:02:11.317755] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-22T17:02:12.117694] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-22T17:02:12.704421] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T17:02:12.917701] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-22T17:02:13.061490] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:02:13.717693] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-22T17:02:14.517744] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-22T17:02:14.538625] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T17:02:14.973511] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T17:02:14.982791] [INFO ] [REMOTE ] ACN: Full fetch complete (77023 records). [2025-10-22T17:02:14.982983] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-22T17:02:14.984168] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:02:14.984283] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:02:14.984347] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:02:14.984391] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-22T17:02:14.984627] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-22T17:02:14.984705] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-10-22T17:02:14.984872] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-10-22T17:02:14.986772] [INFO ] [MAIN ] Update Progress: 23/2367 symbols completed. ACN took 40.4s. Estimated remaining: 3h 41m 25s. Rate: 10.6 symbols/min [2025-10-22T17:02:15.164031] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:15.192261] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-22T17:02:15.193541] [INFO ] [REMOTE ] ACR: Full fetch complete (8559 records). [2025-10-22T17:02:15.193627] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-22T17:02:15.329284] [DEBUG] [LOCAL ] ACVA: Loaded 49262 existing records from primary storage. [2025-10-22T17:02:15.327824] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-22T17:02:15.340752] [INFO ] [MAIN ] ACVA: Loaded 49262 existing records. [2025-10-22T17:02:15.736806] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:15.747341] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-22T17:02:15.771799] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-22T17:02:15.815195] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-22T17:02:15.815408] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-22T17:02:15.815499] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-22T17:02:15.860398] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-22T17:02:15.894140] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-22T17:02:15.911043] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-22T17:02:15.923124] [DEBUG] [LOCAL ] ACR: Trimmed 8559 records to 5310 (keeping 200 days of data) [2025-10-22T17:02:16.084178] [DEBUG] [LOCAL ] ACR: Primary data saved (5310 records). [2025-10-22T17:02:16.115449] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-22T17:02:16.120691] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-22T17:02:16.138863] [INFO ] [MAIN ] Update Progress: 24/2367 symbols completed. ACR took 23.9s. Estimated remaining: 3h 33m 59s. Rate: 10.9 symbols/min [2025-10-22T17:02:16.278730] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:16.304905] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T17:02:16.404600] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:16.404812] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-22T17:02:16.404856] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-22T17:02:16.404995] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-22T17:02:16.405037] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-22T17:02:16.405079] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-22T17:02:16.405112] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-22T17:02:16.767475] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:16.917744] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-22T17:02:17.139725] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:02:17.140072] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-22T17:02:17.140186] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:02:17.140277] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-22T17:02:17.140352] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:02:17.140618] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-22T17:02:17.140727] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-22T17:02:17.140775] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-22T17:02:17.140818] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-22T17:02:17.140868] [INFO ] [MAIN ] Update Progress: 25/2367 symbols completed. AD took 1.0s. Estimated remaining: 3h 26m 54s. Rate: 11.3 symbols/min [2025-10-22T17:02:17.348520] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:17.405196] [DEBUG] [LOCAL ] ADC: Loaded 46430 existing records from primary storage. [2025-10-22T17:02:17.405801] [INFO ] [MAIN ] ADC: Loaded 46430 existing records. [2025-10-22T17:02:17.599238] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:17.599545] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-22T17:02:17.599618] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-22T17:02:17.599975] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-22T17:02:17.600033] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-22T17:02:17.717672] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-22T17:02:17.719538] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T17:02:17.990179] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:18.157981] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T17:02:18.517735] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-22T17:02:19.317737] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-22T17:02:19.971752] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T17:02:20.117786] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-22T17:02:20.256012] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T17:02:20.917889] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-22T17:02:20.970299] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:02:21.717693] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-22T17:02:22.525245] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-22T17:02:22.543843] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T17:02:23.271412] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:02:23.317674] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-22T17:02:23.340370] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T17:02:24.117847] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-22T17:02:24.631977] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:02:24.917681] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-22T17:02:25.602490] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T17:02:25.717608] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-22T17:02:26.252461] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T17:02:26.517747] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-22T17:02:27.320115] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-22T17:02:27.322472] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T17:02:27.897567] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T17:02:28.117678] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-22T17:02:28.917899] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-22T17:02:28.965444] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:02:29.717744] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-22T17:02:29.739199] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T17:02:29.742304] [INFO ] [REMOTE ] ACV: Full fetch complete (10409 records). [2025-10-22T17:02:29.742404] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-22T17:02:29.743096] [FATAL] [VALIDATOR ] ACV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:02:29.743191] [FATAL] [MAIN ] ACV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:02:29.743264] [WARN ] [MAIN ] ACV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:02:29.743351] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-22T17:02:29.743425] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-22T17:02:29.743464] [INFO ] [LOCAL ] ACV: Starting deletion of derivative data. [2025-10-22T17:02:29.743629] [DEBUG] [LOCAL ] ACV: Deleted derivative data file. [2025-10-22T17:02:29.743749] [INFO ] [MAIN ] Update Progress: 26/2367 symbols completed. ACV took 22.3s. Estimated remaining: 3h 37m 46s. Rate: 10.7 symbols/min [2025-10-22T17:02:29.923325] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:29.958941] [DEBUG] [LOCAL ] ADCT: Loaded 35445 existing records from primary storage. [2025-10-22T17:02:29.959236] [INFO ] [MAIN ] ADCT: Loaded 35445 existing records. [2025-10-22T17:02:30.145589] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:30.170378] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-22T17:02:30.173277] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-22T17:02:30.175052] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T17:02:30.175100] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-22T17:02:30.185249] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-22T17:02:30.547984] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-22T17:02:30.558787] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:30.839028] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T17:02:31.317682] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-22T17:02:32.099379] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T17:02:32.117619] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-22T17:02:32.773404] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T17:02:32.779158] [INFO ] [REMOTE ] ACRE: Full fetch complete (49478 records). [2025-10-22T17:02:32.779303] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-22T17:02:32.922867] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-22T17:02:33.198931] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-22T17:02:33.199027] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-22T17:02:33.199567] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-22T17:02:33.199615] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-22T17:02:33.200862] [DEBUG] [LOCAL ] ACRE: Trimmed 49478 records to 33223 (keeping 200 days of data) [2025-10-22T17:02:33.413225] [DEBUG] [LOCAL ] ACRE: Primary data saved (33223 records). [2025-10-22T17:02:33.413386] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-22T17:02:33.413477] [INFO ] [MAIN ] Update Progress: 27/2367 symbols completed. ACRE took 33.5s. Estimated remaining: 3h 34m 55s. Rate: 10.9 symbols/min [2025-10-22T17:02:33.598109] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:33.645112] [DEBUG] [LOCAL ] ADM: Loaded 53400 existing records from primary storage. [2025-10-22T17:02:33.645462] [INFO ] [MAIN ] ADM: Loaded 53400 existing records. [2025-10-22T17:02:33.718815] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-22T17:02:33.825812] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:33.826285] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-22T17:02:33.826391] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-22T17:02:33.826635] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-22T17:02:33.826731] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-22T17:02:34.124389] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T17:02:34.222171] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:34.517689] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-22T17:02:34.543367] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:02:35.317779] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-22T17:02:35.548414] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T17:02:35.624889] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T17:02:36.117741] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-22T17:02:36.917639] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-22T17:02:37.197288] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:02:37.729195] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-22T17:02:37.732256] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T17:02:37.888717] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:02:38.517758] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-22T17:02:39.317727] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-22T17:02:39.646785] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T17:02:39.822560] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T17:02:40.117760] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-22T17:02:40.792208] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T17:02:40.917760] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-22T17:02:41.717635] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-22T17:02:42.033531] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T17:02:42.104040] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T17:02:42.517746] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-22T17:02:43.243798] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T17:02:43.317743] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-22T17:02:44.117689] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-22T17:02:44.321522] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:02:44.915785] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T17:02:44.924571] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-22T17:02:45.717693] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-22T17:02:45.840489] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:02:46.219303] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T17:02:46.517773] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-22T17:02:47.086633] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T17:02:47.317719] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-22T17:02:48.117802] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-22T17:02:48.577919] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-22T17:02:48.609850] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T17:02:48.917696] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-22T17:02:49.717688] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-22T17:02:49.808530] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T17:02:49.820197] [INFO ] [REMOTE ] ACVA: Full fetch complete (70689 records). [2025-10-22T17:02:49.820405] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-22T17:02:49.821441] [FATAL] [VALIDATOR ] ACVA: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:02:49.821561] [FATAL] [MAIN ] ACVA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:02:49.821635] [WARN ] [MAIN ] ACVA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:02:49.821757] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-22T17:02:49.821856] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-22T17:02:49.821909] [INFO ] [LOCAL ] ACVA: Starting deletion of derivative data. [2025-10-22T17:02:49.822092] [DEBUG] [LOCAL ] ACVA: Deleted derivative data file. [2025-10-22T17:02:49.822906] [INFO ] [MAIN ] Update Progress: 28/2367 symbols completed. ACVA took 34.8s. Estimated remaining: 3h 49m 60s. Rate: 10.2 symbols/min [2025-10-22T17:02:50.017970] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:50.018156] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-10-22T17:02:50.018198] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-10-22T17:02:50.018317] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-22T17:02:50.018361] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-22T17:02:50.018404] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-22T17:02:50.018438] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-22T17:02:50.388894] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:50.517742] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-22T17:02:50.559690] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T17:02:50.567543] [INFO ] [REMOTE ] ADC: Full fetch complete (66361 records). [2025-10-22T17:02:50.567795] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-22T17:02:50.569204] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:02:50.569309] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:02:50.569383] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:02:50.569477] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-22T17:02:50.569578] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-22T17:02:50.569635] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-10-22T17:02:50.569825] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-10-22T17:02:50.570502] [INFO ] [MAIN ] Update Progress: 29/2367 symbols completed. ADC took 33.4s. Estimated remaining: 3h 42m 59s. Rate: 10.5 symbols/min [2025-10-22T17:02:50.739482] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:50.791242] [DEBUG] [LOCAL ] ADT: Loaded 53436 existing records from primary storage. [2025-10-22T17:02:50.791551] [INFO ] [MAIN ] ADT: Loaded 53436 existing records. [2025-10-22T17:02:50.976045] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:50.976446] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-22T17:02:50.976495] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-22T17:02:50.976990] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-22T17:02:50.977047] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-22T17:02:51.318527] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-22T17:02:51.358224] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:51.384334] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:02:51.870047] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T17:02:52.117667] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-22T17:02:52.917625] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-22T17:02:53.183497] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T17:02:53.717631] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-22T17:02:53.921096] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:02:54.380114] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:02:54.517738] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-22T17:02:55.152377] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:02:55.317749] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-22T17:02:56.117777] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-22T17:02:56.304743] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:02:56.922873] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-22T17:02:56.944723] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:02:57.217095] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T17:02:57.717777] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-22T17:02:58.477443] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T17:02:58.517678] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-22T17:02:59.317802] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-22T17:02:59.739923] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-22T17:02:59.863335] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T17:03:00.117689] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-22T17:03:00.613632] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T17:03:00.917673] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-22T17:03:01.717689] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-22T17:03:01.958934] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T17:03:02.382671] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T17:03:02.517685] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-22T17:03:03.243515] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T17:03:03.317797] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-22T17:03:03.788215] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-22T17:03:03.798438] [INFO ] [REMOTE ] ADM: Full fetch complete (77472 records). [2025-10-22T17:03:03.798682] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-22T17:03:03.903249] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T17:03:03.956190] [INFO ] [REMOTE ] ADCT: Full fetch complete (51466 records). [2025-10-22T17:03:03.974759] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-22T17:03:04.124886] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-22T17:03:04.562154] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-22T17:03:04.576286] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-22T17:03:04.589103] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-22T17:03:04.596776] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-22T17:03:04.642531] [DEBUG] [LOCAL ] ADM: Trimmed 77472 records to 53394 (keeping 200 days of data) [2025-10-22T17:03:04.810995] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-22T17:03:04.812139] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-22T17:03:04.825290] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-22T17:03:04.839425] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-22T17:03:04.846616] [DEBUG] [LOCAL ] ADCT: Trimmed 51466 records to 35462 (keeping 200 days of data) [2025-10-22T17:03:04.943392] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-22T17:03:05.249719] [DEBUG] [LOCAL ] ADM: Primary data saved (53394 records). [2025-10-22T17:03:05.250902] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-22T17:03:05.251313] [INFO ] [MAIN ] Update Progress: 30/2367 symbols completed. ADM took 31.8s. Estimated remaining: 3h 54m 31s. Rate: 10.0 symbols/min [2025-10-22T17:03:05.374947] [DEBUG] [LOCAL ] ADCT: Primary data saved (35462 records). [2025-10-22T17:03:05.396588] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-22T17:03:05.422270] [INFO ] [MAIN ] Update Progress: 31/2367 symbols completed. ADCT took 35.7s. Estimated remaining: 3h 47m 4s. Rate: 10.3 symbols/min [2025-10-22T17:03:05.447564] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:05.632251] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:05.641757] [DEBUG] [LOCAL ] ADX: Loaded 27734 existing records from primary storage. [2025-10-22T17:03:05.641972] [INFO ] [MAIN ] ADX: Loaded 27734 existing records. [2025-10-22T17:03:05.832611] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:05.844428] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-22T17:03:05.844617] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-22T17:03:05.844986] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-22T17:03:05.845043] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-22T17:03:06.029681] [DEBUG] [LOCAL ] AEE: Loaded 50107 existing records from primary storage. [2025-10-22T17:03:06.092722] [INFO ] [MAIN ] AEE: Loaded 50107 existing records. [2025-10-22T17:03:06.345301] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:06.397329] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-22T17:03:06.424884] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:06.425254] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-22T17:03:06.425465] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-22T17:03:06.426021] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-22T17:03:06.426107] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-22T17:03:06.559727] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-22T17:03:06.678969] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-22T17:03:06.862613] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T17:03:06.867322] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:07.317774] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-22T17:03:07.970458] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:03:08.117621] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-22T17:03:08.248166] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:03:08.871443] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:03:08.917626] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-22T17:03:09.368923] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T17:03:09.717677] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-22T17:03:10.477147] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T17:03:10.517670] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-22T17:03:11.317768] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-22T17:03:11.388199] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T17:03:12.117745] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-22T17:03:12.196758] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T17:03:12.917743] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-22T17:03:13.177929] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T17:03:13.717748] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-22T17:03:14.261158] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T17:03:14.517670] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-22T17:03:15.207756] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T17:03:15.317676] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-22T17:03:15.445474] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (3.33 seconds). [2025-10-22T17:03:16.117732] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-22T17:03:16.501256] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T17:03:16.826626] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T17:03:16.833277] [INFO ] [REMOTE ] ADNT: Full fetch complete (67511 records). [2025-10-22T17:03:16.833460] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-22T17:03:16.836843] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:03:16.836989] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:03:16.837198] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:03:16.837274] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-22T17:03:16.837339] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-22T17:03:16.837375] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-10-22T17:03:16.837413] [DEBUG] [LOCAL ] ADNT: No derivative data file found to delete. [2025-10-22T17:03:16.837472] [INFO ] [MAIN ] Update Progress: 32/2367 symbols completed. ADNT took 27.0s. Estimated remaining: 3h 53m 45s. Rate: 10.0 symbols/min [2025-10-22T17:03:16.922771] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-22T17:03:17.018602] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:17.037213] [DEBUG] [LOCAL ] AEFC: Loaded 7734 existing records from primary storage. [2025-10-22T17:03:17.047053] [INFO ] [MAIN ] AEFC: Loaded 7734 existing records. [2025-10-22T17:03:17.080875] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-22T17:03:17.259316] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:17.259563] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-22T17:03:17.259610] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-22T17:03:17.260301] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-22T17:03:17.260358] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-22T17:03:17.615410] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:17.717616] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-22T17:03:18.512201] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T17:03:18.517608] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-22T17:03:18.762421] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T17:03:19.223909] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T17:03:19.317994] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-22T17:03:20.093084] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T17:03:20.117673] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-22T17:03:20.917748] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-22T17:03:21.717734] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-22T17:03:21.902195] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T17:03:22.329394] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T17:03:22.517666] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-22T17:03:23.317760] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-22T17:03:23.538375] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:03:23.612502] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T17:03:24.117688] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-22T17:03:24.632059] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T17:03:24.917687] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-22T17:03:25.576584] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T17:03:25.717627] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-22T17:03:26.121734] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T17:03:26.415466] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T17:03:26.517695] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-22T17:03:27.317688] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-22T17:03:28.122141] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-22T17:03:28.127758] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T17:03:28.917683] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-22T17:03:29.416121] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T17:03:29.428476] [INFO ] [REMOTE ] ADT: Full fetch complete (77364 records). [2025-10-22T17:03:29.428797] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-22T17:03:29.575721] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T17:03:29.722891] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-22T17:03:29.786278] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:03:29.905297] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-22T17:03:29.905426] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-22T17:03:29.906358] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-22T17:03:29.906433] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-22T17:03:29.908633] [DEBUG] [LOCAL ] ADT: Trimmed 77364 records to 53435 (keeping 200 days of data) [2025-10-22T17:03:30.248439] [DEBUG] [LOCAL ] ADT: Primary data saved (53435 records). [2025-10-22T17:03:30.248691] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-22T17:03:30.250188] [INFO ] [MAIN ] Update Progress: 33/2367 symbols completed. ADT took 39.7s. Estimated remaining: 4h 2m 23s. Rate: 9.6 symbols/min [2025-10-22T17:03:30.426189] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:30.477951] [DEBUG] [LOCAL ] AEG: Loaded 49601 existing records from primary storage. [2025-10-22T17:03:30.478440] [INFO ] [MAIN ] AEG: Loaded 49601 existing records. [2025-10-22T17:03:30.522940] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-22T17:03:30.674739] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:30.675119] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-22T17:03:30.675174] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-22T17:03:30.675476] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-22T17:03:30.675537] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-22T17:03:31.077105] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T17:03:31.082733] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:31.317781] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-22T17:03:32.065924] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T17:03:32.117662] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-22T17:03:32.476691] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T17:03:32.917741] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-22T17:03:33.415555] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T17:03:33.524687] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T17:03:33.717745] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-22T17:03:34.517740] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-22T17:03:35.317765] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-22T17:03:35.447426] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T17:03:35.765597] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T17:03:35.771319] [INFO ] [REMOTE ] ADX: Full fetch complete (41911 records). [2025-10-22T17:03:35.771583] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-22T17:03:36.122827] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-22T17:03:36.245871] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-22T17:03:36.245999] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-22T17:03:36.246591] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-22T17:03:36.246707] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-22T17:03:36.248758] [DEBUG] [LOCAL ] ADX: Trimmed 41911 records to 27644 (keeping 200 days of data) [2025-10-22T17:03:36.439823] [DEBUG] [LOCAL ] ADX: Primary data saved (27644 records). [2025-10-22T17:03:36.440084] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-22T17:03:36.440247] [INFO ] [MAIN ] Update Progress: 34/2367 symbols completed. ADX took 31.2s. Estimated remaining: 4h 2m 14s. Rate: 9.6 symbols/min [2025-10-22T17:03:36.693036] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:36.754879] [DEBUG] [LOCAL ] AEM: Loaded 53477 existing records from primary storage. [2025-10-22T17:03:36.755316] [INFO ] [MAIN ] AEM: Loaded 53477 existing records. [2025-10-22T17:03:36.895879] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T17:03:36.917991] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-22T17:03:36.934433] [INFO ] [REMOTE ] AEFC: Full fetch complete (11627 records). [2025-10-22T17:03:36.935393] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-22T17:03:36.961420] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:36.987353] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-22T17:03:37.076239] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-22T17:03:37.087682] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-22T17:03:37.093028] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-22T17:03:37.291781] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T17:03:37.718477] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-22T17:03:37.722799] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-22T17:03:37.722925] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-22T17:03:37.723663] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-22T17:03:37.729156] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-22T17:03:37.773262] [DEBUG] [LOCAL ] AEFC: Trimmed 11627 records to 7650 (keeping 200 days of data) [2025-10-22T17:03:37.814924] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:37.864367] [DEBUG] [LOCAL ] AEFC: Primary data saved (7650 records). [2025-10-22T17:03:37.864547] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-22T17:03:37.864690] [INFO ] [MAIN ] Update Progress: 35/2367 symbols completed. AEFC took 21.0s. Estimated remaining: 3h 56m 48s. Rate: 9.8 symbols/min [2025-10-22T17:03:38.054047] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:38.115425] [DEBUG] [LOCAL ] AEO: Loaded 53564 existing records from primary storage. [2025-10-22T17:03:38.115888] [INFO ] [MAIN ] AEO: Loaded 53564 existing records. [2025-10-22T17:03:38.327528] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:38.327892] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-22T17:03:38.327943] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-22T17:03:38.328487] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-22T17:03:38.328831] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-22T17:03:38.533442] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-22T17:03:38.748977] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T17:03:38.770816] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:39.061551] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T17:03:39.317756] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-22T17:03:40.117686] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-22T17:03:40.188662] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T17:03:40.879673] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:03:40.917730] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-22T17:03:41.717775] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-22T17:03:42.113207] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T17:03:42.122308] [INFO ] [REMOTE ] AEE: Full fetch complete (73021 records). [2025-10-22T17:03:42.122491] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-22T17:03:42.520070] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-22T17:03:42.539472] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-22T17:03:42.539773] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-22T17:03:42.540600] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-22T17:03:42.540893] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-22T17:03:42.572992] [DEBUG] [LOCAL ] AEE: Trimmed 73021 records to 50072 (keeping 200 days of data) [2025-10-22T17:03:42.574818] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T17:03:42.918029] [DEBUG] [LOCAL ] AEE: Primary data saved (50072 records). [2025-10-22T17:03:42.918382] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-22T17:03:42.919769] [INFO ] [MAIN ] Update Progress: 36/2367 symbols completed. AEE took 37.5s. Estimated remaining: 3h 55m 35s. Rate: 9.9 symbols/min [2025-10-22T17:03:43.100818] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:43.101237] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-10-22T17:03:43.101315] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-10-22T17:03:43.101515] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-22T17:03:43.101718] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-22T17:03:43.101877] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-10-22T17:03:43.101988] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-22T17:03:43.318894] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-22T17:03:43.331447] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T17:03:43.531733] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:44.053146] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:03:44.117631] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-22T17:03:44.917736] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-22T17:03:45.292315] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T17:03:45.721835] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-22T17:03:45.730153] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T17:03:46.490031] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:03:46.517743] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-22T17:03:47.317729] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-22T17:03:47.711675] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T17:03:48.117775] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-22T17:03:48.294294] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T17:03:48.917740] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-22T17:03:48.992511] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:03:49.724395] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-22T17:03:49.731745] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T17:03:50.517701] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-22T17:03:50.899986] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T17:03:51.317760] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-22T17:03:51.581456] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T17:03:52.117749] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-22T17:03:52.522218] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T17:03:52.879275] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:03:52.917678] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-22T17:03:53.717673] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-22T17:03:54.020818] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T17:03:54.295687] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T17:03:54.517736] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-22T17:03:55.317680] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-22T17:03:55.584390] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T17:03:56.117695] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-22T17:03:56.454045] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T17:03:56.917667] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-22T17:03:57.037778] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T17:03:57.717722] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-22T17:03:58.517735] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-22T17:03:58.967188] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-22T17:03:59.317781] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-22T17:03:59.359751] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T17:03:59.494813] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (3.38 seconds). [2025-10-22T17:04:00.117757] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-22T17:04:00.299708] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T17:04:00.917750] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-22T17:04:01.143699] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T17:04:01.717776] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-22T17:04:02.395468] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-22T17:04:02.517747] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-22T17:04:02.648045] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:04:03.317742] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-22T17:04:03.834411] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-22T17:04:04.117752] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-22T17:04:04.560037] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:04:04.714349] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T17:04:04.917720] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-22T17:04:05.717739] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-22T17:04:05.763396] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T17:04:06.517681] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-22T17:04:06.897823] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T17:04:06.907029] [INFO ] [REMOTE ] AEG: Full fetch complete (70665 records). [2025-10-22T17:04:06.907308] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-22T17:04:07.319008] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-22T17:04:07.318763] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-22T17:04:07.320102] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-22T17:04:07.320879] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-22T17:04:07.320947] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-22T17:04:07.322983] [DEBUG] [LOCAL ] AEG: Trimmed 70665 records to 49558 (keeping 200 days of data) [2025-10-22T17:04:07.627221] [DEBUG] [LOCAL ] AEG: Primary data saved (49558 records). [2025-10-22T17:04:07.627412] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-22T17:04:07.629261] [INFO ] [MAIN ] Update Progress: 37/2367 symbols completed. AEG took 37.4s. Estimated remaining: 4h 15m 3s. Rate: 9.1 symbols/min [2025-10-22T17:04:07.865959] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T17:04:07.876542] [INFO ] [REMOTE ] AEM: Full fetch complete (77473 records). [2025-10-22T17:04:07.876831] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-22T17:04:08.280858] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-22T17:04:08.281130] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-22T17:04:08.282064] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-22T17:04:08.282133] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-22T17:04:08.284226] [DEBUG] [LOCAL ] AEM: Trimmed 77473 records to 53477 (keeping 200 days of data) [2025-10-22T17:04:08.660385] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-22T17:04:08.681708] [INFO ] [REMOTE ] AEO: Full fetch complete (77650 records). [2025-10-22T17:04:08.681849] [DEBUG] [LOCAL ] AEM: Primary data saved (53477 records). [2025-10-22T17:04:08.682326] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-22T17:04:08.682215] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-22T17:04:08.683553] [INFO ] [MAIN ] Update Progress: 38/2367 symbols completed. AEM took 32.2s. Estimated remaining: 4h 9m 18s. Rate: 9.3 symbols/min [2025-10-22T17:04:09.132244] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-22T17:04:09.132405] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-22T17:04:09.133561] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-22T17:04:09.133814] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-22T17:04:09.169307] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T17:04:09.166143] [DEBUG] [LOCAL ] AEO: Trimmed 77650 records to 53564 (keeping 200 days of data) [2025-10-22T17:04:09.181914] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-22T17:04:09.520317] [DEBUG] [LOCAL ] AEO: Primary data saved (53564 records). [2025-10-22T17:04:09.520523] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-22T17:04:09.521716] [INFO ] [MAIN ] Update Progress: 39/2367 symbols completed. AEO took 31.7s. Estimated remaining: 4h 3m 38s. Rate: 9.6 symbols/min [2025-10-22T17:04:11.768688] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-22T17:04:11.780602] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-22T17:04:13.402417] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T17:04:13.410385] [INFO ] [REMOTE ] AER: Full fetch complete (69939 records). [2025-10-22T17:04:13.410602] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-22T17:04:13.792841] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-22T17:04:13.792924] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-22T17:04:13.793561] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-22T17:04:13.793602] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-22T17:04:13.795479] [DEBUG] [LOCAL ] AER: Trimmed 69939 records to 47899 (keeping 200 days of data) [2025-10-22T17:04:14.084119] [DEBUG] [LOCAL ] AER: Primary data saved (47899 records). [2025-10-22T17:04:14.084278] [INFO ] [MAIN ] AER: Full history saved. [2025-10-22T17:04:14.084359] [INFO ] [MAIN ] Update Progress: 40/2367 symbols completed. AER took 31.2s. Estimated remaining: 4h 1m 52s. Rate: 9.6 symbols/min [2025-10-22T17:04:14.730339] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:14.728823] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:14.776275] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-22T17:04:14.778052] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:14.778312] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-22T17:04:14.807491] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-22T17:04:14.811833] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:14.812688] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-22T17:04:14.812871] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-22T17:04:14.812932] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-22T17:04:14.932471] [DEBUG] [LOCAL ] AFB: Loaded 11097 existing records from primary storage. [2025-10-22T17:04:14.964959] [INFO ] [MAIN ] AFB: Loaded 11097 existing records. [2025-10-22T17:04:15.281911] [DEBUG] [LOCAL ] AESI: Loaded 49822 existing records from primary storage. [2025-10-22T17:04:15.307499] [INFO ] [MAIN ] AESI: Loaded 49822 existing records. [2025-10-22T17:04:15.324412] [DEBUG] [LOCAL ] AES: Loaded 53665 existing records from primary storage. [2025-10-22T17:04:15.404152] [INFO ] [MAIN ] AES: Loaded 53665 existing records. [2025-10-22T17:04:15.571925] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:15.643066] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-22T17:04:15.698976] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:15.729498] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-22T17:04:15.729604] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-22T17:04:15.786848] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-22T17:04:15.817304] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-22T17:04:15.823177] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:15.860208] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-22T17:04:15.865475] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-22T17:04:15.913360] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-22T17:04:15.952921] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-22T17:04:16.043784] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:15.997160] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:04:16.054419] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-22T17:04:16.082575] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-22T17:04:16.134178] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-22T17:04:16.077314] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-22T17:04:16.153634] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-22T17:04:16.154058] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:04:16.236730] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-22T17:04:16.267274] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:04:16.281102] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-22T17:04:16.296697] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-22T17:04:16.302255] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-22T17:04:16.363638] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-22T17:04:16.368984] [INFO ] [MAIN ] Update Progress: 41/2367 symbols completed. AEXA took 2.3s. Estimated remaining: 3h 58m 2s. Rate: 9.8 symbols/min [2025-10-22T17:04:16.909153] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:16.960518] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-22T17:04:17.138806] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:17.185944] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:17.192254] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-22T17:04:17.287947] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:17.289525] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-22T17:04:17.316110] [DEBUG] [LOCAL ] AFG: Loaded 31884 existing records from primary storage. [2025-10-22T17:04:17.316428] [INFO ] [MAIN ] AFG: Loaded 31884 existing records. [2025-10-22T17:04:17.521572] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:17.521832] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-22T17:04:17.521900] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-22T17:04:17.522154] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-22T17:04:17.522218] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-22T17:04:17.907321] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:17.907732] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-22T17:04:17.973188] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T17:04:17.976227] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-22T17:04:18.488088] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T17:04:18.490914] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-22T17:04:18.960227] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T17:04:18.974540] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-22T17:04:19.002965] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T17:04:19.010141] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-22T17:04:19.323745] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T17:04:19.323255] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T17:04:19.339099] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-22T17:04:19.339968] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-22T17:04:20.286195] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T17:04:20.293694] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-22T17:04:20.321241] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T17:04:20.325616] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-22T17:04:20.495574] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T17:04:20.505176] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-22T17:04:21.155162] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T17:04:21.158115] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-22T17:04:21.220582] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T17:04:21.563509] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T17:04:21.717729] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-22T17:04:21.796870] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T17:04:22.353557] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:04:22.517690] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-22T17:04:23.317743] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-22T17:04:23.690946] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T17:04:23.872714] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T17:04:23.916941] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:04:24.117753] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-22T17:04:24.731409] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T17:04:24.917766] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-22T17:04:25.717724] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-22T17:04:26.387087] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T17:04:26.517728] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-22T17:04:27.317751] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-22T17:04:27.451545] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T17:04:27.972922] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T17:04:28.117769] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-22T17:04:28.718968] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T17:04:28.917753] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-22T17:04:29.717623] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-22T17:04:30.090092] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T17:04:30.473128] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-22T17:04:30.517613] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-22T17:04:30.637491] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T17:04:31.317690] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-22T17:04:32.117760] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-22T17:04:32.548396] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T17:04:32.865002] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T17:04:32.868850] [INFO ] [REMOTE ] AFB: Full fetch complete (16374 records). [2025-10-22T17:04:32.869198] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-22T17:04:32.922757] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-22T17:04:33.017855] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:04:33.292026] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-22T17:04:33.292114] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-22T17:04:33.292366] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-22T17:04:33.292409] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-22T17:04:33.293078] [DEBUG] [LOCAL ] AFB: Trimmed 16374 records to 11018 (keeping 200 days of data) [2025-10-22T17:04:33.358047] [DEBUG] [LOCAL ] AFB: Primary data saved (11018 records). [2025-10-22T17:04:33.358216] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-22T17:04:33.358328] [INFO ] [MAIN ] Update Progress: 42/2367 symbols completed. AFB took 19.3s. Estimated remaining: 4h 7m 56s. Rate: 9.4 symbols/min [2025-10-22T17:04:33.537443] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:33.542057] [DEBUG] [LOCAL ] AFGB: Loaded 2236 existing records from primary storage. [2025-10-22T17:04:33.542238] [INFO ] [MAIN ] AFGB: Loaded 2236 existing records. [2025-10-22T17:04:33.718105] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-22T17:04:33.717956] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:33.719358] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-22T17:04:33.719421] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-22T17:04:33.719558] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-22T17:04:33.719598] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-22T17:04:34.076832] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:34.429353] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T17:04:34.517748] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-22T17:04:35.317763] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-22T17:04:35.655703] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:04:35.777684] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T17:04:36.117692] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-22T17:04:36.917691] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-22T17:04:37.081533] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T17:04:37.494574] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T17:04:37.515309] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T17:04:37.717762] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-22T17:04:38.517764] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-22T17:04:39.317685] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-22T17:04:39.748352] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T17:04:39.821449] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T17:04:39.831729] [INFO ] [REMOTE ] AESI: Full fetch complete (71632 records). [2025-10-22T17:04:39.832017] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-22T17:04:40.117682] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-22T17:04:40.290415] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-22T17:04:40.290574] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-22T17:04:40.291611] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-22T17:04:40.291807] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-22T17:04:40.305613] [DEBUG] [LOCAL ] AESI: Trimmed 71632 records to 49817 (keeping 200 days of data) [2025-10-22T17:04:40.327459] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T17:04:40.653333] [DEBUG] [LOCAL ] AESI: Primary data saved (49817 records). [2025-10-22T17:04:40.653588] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-22T17:04:40.653749] [INFO ] [MAIN ] Update Progress: 43/2367 symbols completed. AESI took 26.6s. Estimated remaining: 4h 8m 38s. Rate: 9.3 symbols/min [2025-10-22T17:04:40.827336] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:40.827577] [DEBUG] [LOCAL ] AFGC: No existing data file found in primary storage. [2025-10-22T17:04:40.827623] [WARN ] [MAIN ] AFGC: No existing data found, performing full refresh instead. [2025-10-22T17:04:40.827824] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-22T17:04:40.827896] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-22T17:04:40.827971] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-10-22T17:04:40.828013] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-22T17:04:40.927340] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-22T17:04:41.215817] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:41.504100] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T17:04:41.584836] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T17:04:41.717738] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-22T17:04:42.517844] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-22T17:04:43.041317] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T17:04:43.317773] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-22T17:04:43.849865] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-22T17:04:44.117692] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-22T17:04:44.214483] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T17:04:44.606139] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-22T17:04:44.917681] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-22T17:04:45.521770] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T17:04:45.717739] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-22T17:04:46.188049] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T17:04:46.517676] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-22T17:04:47.317683] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-22T17:04:47.876664] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T17:04:47.961306] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T17:04:47.968046] [INFO ] [REMOTE ] AFG: Full fetch complete (46912 records). [2025-10-22T17:04:47.968190] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-22T17:04:48.124362] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-22T17:04:48.368199] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-22T17:04:48.368280] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-22T17:04:48.368778] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-22T17:04:48.368840] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-22T17:04:48.369791] [DEBUG] [LOCAL ] AFG: Trimmed 46912 records to 31910 (keeping 200 days of data) [2025-10-22T17:04:48.569440] [DEBUG] [LOCAL ] AFG: Primary data saved (31910 records). [2025-10-22T17:04:48.569597] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-22T17:04:48.569728] [INFO ] [MAIN ] Update Progress: 44/2367 symbols completed. AFG took 32.2s. Estimated remaining: 4h 9m 51s. Rate: 9.3 symbols/min [2025-10-22T17:04:48.635724] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T17:04:48.739731] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:48.743166] [DEBUG] [LOCAL ] AFGD: Loaded 1769 existing records from primary storage. [2025-10-22T17:04:48.743321] [INFO ] [MAIN ] AFGD: Loaded 1769 existing records. [2025-10-22T17:04:48.912909] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:48.913160] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-22T17:04:48.913226] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-22T17:04:48.913364] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-22T17:04:48.913419] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-22T17:04:48.924086] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-22T17:04:49.266063] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:49.717701] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-22T17:04:50.286837] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T17:04:50.517675] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-22T17:04:50.957882] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T17:04:51.317744] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-22T17:04:51.684272] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.76 seconds). [2025-10-22T17:04:51.693796] [INFO ] [REMOTE ] AES: Full fetch complete (77843 records). [2025-10-22T17:04:51.694018] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-22T17:04:51.806432] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T17:04:52.106107] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-22T17:04:52.106207] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-22T17:04:52.107023] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-22T17:04:52.107093] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-22T17:04:52.108692] [DEBUG] [LOCAL ] AES: Trimmed 77843 records to 53665 (keeping 200 days of data) [2025-10-22T17:04:52.162632] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-22T17:04:52.429523] [DEBUG] [LOCAL ] AES: Primary data saved (53665 records). [2025-10-22T17:04:52.429681] [INFO ] [MAIN ] AES: Full history saved. [2025-10-22T17:04:52.429775] [INFO ] [MAIN ] Update Progress: 45/2367 symbols completed. AES took 38.3s. Estimated remaining: 4h 7m 31s. Rate: 9.4 symbols/min [2025-10-22T17:04:52.596583] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:52.601067] [DEBUG] [LOCAL ] AFGE: Loaded 2292 existing records from primary storage. [2025-10-22T17:04:52.601256] [INFO ] [MAIN ] AFGE: Loaded 2292 existing records. [2025-10-22T17:04:52.677684] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-22T17:04:52.777975] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:52.778170] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-22T17:04:52.778215] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-22T17:04:52.778337] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-22T17:04:52.778374] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-22T17:04:52.922832] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-22T17:04:53.127768] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:53.533540] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T17:04:53.717684] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-22T17:04:54.273760] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-22T17:04:54.517675] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-22T17:04:54.949280] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T17:04:55.317681] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-22T17:04:55.956625] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T17:04:56.117696] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-22T17:04:56.553883] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T17:04:56.917681] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-22T17:04:57.369264] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T17:04:57.717733] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-22T17:04:58.279216] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T17:04:58.517688] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-22T17:04:59.090115] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T17:04:59.317675] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-22T17:04:59.765959] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T17:05:00.117679] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-22T17:05:00.672158] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T17:05:00.917739] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-22T17:05:01.392360] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T17:05:01.717685] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-22T17:05:02.178398] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T17:05:02.517681] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-22T17:05:02.953677] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T17:05:03.317894] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-22T17:05:03.865099] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T17:05:03.866147] [INFO ] [REMOTE ] AFGC: Full fetch complete (3566 records). [2025-10-22T17:05:03.866228] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-22T17:05:04.127406] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-22T17:05:04.383023] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-22T17:05:04.383100] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-22T17:05:04.383229] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-22T17:05:04.383267] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-22T17:05:04.383610] [DEBUG] [LOCAL ] AFGC: Trimmed 3566 records to 2540 (keeping 200 days of data) [2025-10-22T17:05:04.399636] [DEBUG] [LOCAL ] AFGC: Primary data saved (2540 records). [2025-10-22T17:05:04.399732] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-22T17:05:04.399794] [INFO ] [MAIN ] Update Progress: 46/2367 symbols completed. AFGC took 23.7s. Estimated remaining: 4h 12m 6s. Rate: 9.2 symbols/min [2025-10-22T17:05:04.573973] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T17:05:04.577157] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:04.632456] [DEBUG] [LOCAL ] AFL: Loaded 53177 existing records from primary storage. [2025-10-22T17:05:04.632845] [INFO ] [MAIN ] AFL: Loaded 53177 existing records. [2025-10-22T17:05:04.812076] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:04.812288] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-22T17:05:04.812334] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-22T17:05:04.812523] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-22T17:05:04.812573] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-22T17:05:04.922873] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-22T17:05:05.175716] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:05.357900] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T17:05:05.717694] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-22T17:05:06.168976] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-22T17:05:06.170013] [INFO ] [REMOTE ] AFGD: Full fetch complete (2717 records). [2025-10-22T17:05:06.170100] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-22T17:05:06.170551] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:05:06.170675] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:05:06.170748] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:05:06.170833] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-22T17:05:06.170917] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-22T17:05:06.170970] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-10-22T17:05:06.171155] [DEBUG] [LOCAL ] AFGD: Deleted derivative data file. [2025-10-22T17:05:06.171264] [INFO ] [MAIN ] Update Progress: 47/2367 symbols completed. AFGD took 17.6s. Estimated remaining: 4h 8m 5s. Rate: 9.4 symbols/min [2025-10-22T17:05:06.349443] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:06.349623] [DEBUG] [LOCAL ] AG: No existing data file found in primary storage. [2025-10-22T17:05:06.349692] [WARN ] [MAIN ] AG: No existing data found, performing full refresh instead. [2025-10-22T17:05:06.349805] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-22T17:05:06.349846] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-22T17:05:06.349920] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-22T17:05:06.349978] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-22T17:05:06.522951] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-22T17:05:06.726145] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:07.214892] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T17:05:07.317676] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-22T17:05:07.884774] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T17:05:08.117684] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-22T17:05:08.917691] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-22T17:05:09.544656] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T17:05:09.717727] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-22T17:05:09.889699] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T17:05:10.150630] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-22T17:05:10.517763] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-22T17:05:10.983330] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-22T17:05:11.317682] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-22T17:05:12.117676] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-22T17:05:12.598167] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T17:05:12.917677] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-22T17:05:13.478782] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T17:05:13.480343] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-22T17:05:13.717730] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-22T17:05:14.284093] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T17:05:14.284942] [INFO ] [REMOTE ] AFGB: Full fetch complete (3437 records). [2025-10-22T17:05:14.285010] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-22T17:05:14.522798] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-22T17:05:14.636188] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-22T17:05:14.636267] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-22T17:05:14.636389] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-22T17:05:14.636429] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-22T17:05:14.636823] [DEBUG] [LOCAL ] AFGB: Trimmed 3437 records to 2210 (keeping 200 days of data) [2025-10-22T17:05:14.650520] [DEBUG] [LOCAL ] AFGB: Primary data saved (2210 records). [2025-10-22T17:05:14.650678] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-22T17:05:14.650776] [INFO ] [MAIN ] Update Progress: 48/2367 symbols completed. AFGB took 41.3s. Estimated remaining: 4h 9m 38s. Rate: 9.3 symbols/min [2025-10-22T17:05:14.814093] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:14.851969] [DEBUG] [LOCAL ] AGCO: Loaded 42188 existing records from primary storage. [2025-10-22T17:05:14.852266] [INFO ] [MAIN ] AGCO: Loaded 42188 existing records. [2025-10-22T17:05:15.029882] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:15.030084] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-22T17:05:15.030129] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-22T17:05:15.030347] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-22T17:05:15.030384] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-22T17:05:15.322743] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-22T17:05:15.396989] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:15.817736] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T17:05:16.091420] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:05:16.117734] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-22T17:05:16.917762] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-22T17:05:17.717741] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-22T17:05:17.973486] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T17:05:18.449193] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:05:18.503541] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T17:05:18.504460] [INFO ] [REMOTE ] AFGE: Full fetch complete (3328 records). [2025-10-22T17:05:18.504531] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-22T17:05:18.525815] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-22T17:05:18.881398] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-22T17:05:18.881472] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-22T17:05:18.881602] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-22T17:05:18.881710] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-22T17:05:18.882059] [DEBUG] [LOCAL ] AFGE: Trimmed 3328 records to 2245 (keeping 200 days of data) [2025-10-22T17:05:18.895860] [DEBUG] [LOCAL ] AFGE: Primary data saved (2245 records). [2025-10-22T17:05:18.895922] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-22T17:05:18.895989] [INFO ] [MAIN ] Update Progress: 49/2367 symbols completed. AFGE took 26.5s. Estimated remaining: 4h 7m 47s. Rate: 9.4 symbols/min [2025-10-22T17:05:19.062247] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:19.080443] [DEBUG] [LOCAL ] AGD: Loaded 19315 existing records from primary storage. [2025-10-22T17:05:19.080714] [INFO ] [MAIN ] AGD: Loaded 19315 existing records. [2025-10-22T17:05:19.253041] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:19.253280] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-22T17:05:19.253327] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-22T17:05:19.253678] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-22T17:05:19.253735] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-22T17:05:19.327253] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-22T17:05:19.611171] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:20.117742] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-22T17:05:20.582034] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T17:05:20.917670] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-22T17:05:21.056802] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T17:05:21.267712] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T17:05:21.717687] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-22T17:05:22.343195] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T17:05:22.517680] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-22T17:05:22.970593] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T17:05:23.025051] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T17:05:23.317669] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-22T17:05:24.117700] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-22T17:05:24.130816] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T17:05:24.917677] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-22T17:05:25.686375] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T17:05:25.717611] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-22T17:05:26.483589] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:05:26.517613] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-22T17:05:27.315129] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T17:05:27.323845] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-22T17:05:28.117751] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-22T17:05:28.400225] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T17:05:28.917687] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-22T17:05:29.185986] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-22T17:05:29.505863] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-22T17:05:29.717748] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-22T17:05:30.336028] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T17:05:30.517636] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-22T17:05:31.318134] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-22T17:05:31.322582] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T17:05:32.117690] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-22T17:05:32.461871] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T17:05:32.540255] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T17:05:32.917762] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-22T17:05:33.459441] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-22T17:05:33.717697] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-22T17:05:33.903834] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T17:05:34.517730] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-22T17:05:35.317670] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-22T17:05:35.562018] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T17:05:36.117734] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-22T17:05:36.675873] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T17:05:36.730945] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-22T17:05:36.917757] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-22T17:05:37.717732] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-22T17:05:37.773076] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:05:37.785992] [INFO ] [REMOTE ] AFL: Full fetch complete (77068 records). [2025-10-22T17:05:37.786183] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-22T17:05:38.203598] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-22T17:05:38.203852] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-22T17:05:38.204616] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-22T17:05:38.204855] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-22T17:05:38.230356] [DEBUG] [LOCAL ] AFL: Trimmed 77068 records to 53174 (keeping 200 days of data) [2025-10-22T17:05:38.231927] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:05:38.535251] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-22T17:05:38.582406] [DEBUG] [LOCAL ] AFL: Primary data saved (53174 records). [2025-10-22T17:05:38.582541] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-22T17:05:38.583495] [INFO ] [MAIN ] Update Progress: 50/2367 symbols completed. AFL took 34.2s. Estimated remaining: 4h 17m 56s. Rate: 9.0 symbols/min [2025-10-22T17:05:38.753144] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:38.803577] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-22T17:05:38.804013] [INFO ] [MAIN ] AGI: Loaded 53423 existing records. [2025-10-22T17:05:38.975681] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:38.975964] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-22T17:05:38.976021] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-22T17:05:38.976769] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-22T17:05:38.976858] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-22T17:05:39.319022] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-22T17:05:39.323630] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:39.419174] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-22T17:05:39.909774] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-22T17:05:40.117759] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-22T17:05:40.856267] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T17:05:40.917733] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-22T17:05:41.220561] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T17:05:41.717699] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-22T17:05:42.486705] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T17:05:42.493723] [INFO ] [REMOTE ] AGCO: Full fetch complete (61666 records). [2025-10-22T17:05:42.493869] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-22T17:05:42.525099] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-22T17:05:42.877340] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-22T17:05:42.877430] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-22T17:05:42.878113] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-22T17:05:42.878199] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-22T17:05:42.879552] [DEBUG] [LOCAL ] AGCO: Trimmed 61666 records to 42149 (keeping 200 days of data) [2025-10-22T17:05:43.140744] [DEBUG] [LOCAL ] AGCO: Primary data saved (42149 records). [2025-10-22T17:05:43.140871] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-22T17:05:43.141872] [INFO ] [MAIN ] Update Progress: 51/2367 symbols completed. AGCO took 28.5s. Estimated remaining: 4h 16m 13s. Rate: 9.0 symbols/min [2025-10-22T17:05:43.322749] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-22T17:05:43.326575] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:43.379578] [DEBUG] [LOCAL ] AGL: Loaded 52587 existing records from primary storage. [2025-10-22T17:05:43.380015] [INFO ] [MAIN ] AGL: Loaded 52587 existing records. [2025-10-22T17:05:43.569669] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:43.585352] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-22T17:05:43.596010] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-22T17:05:43.596492] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-22T17:05:43.598031] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:05:43.596981] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-22T17:05:43.966823] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:44.117676] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-22T17:05:44.473365] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T17:05:44.746816] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-22T17:05:44.917747] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-22T17:05:45.717781] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-22T17:05:46.100350] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T17:05:46.517742] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-22T17:05:47.007173] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T17:05:47.283363] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:05:47.317682] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-22T17:05:47.823858] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:05:47.828108] [INFO ] [REMOTE ] AGD: Full fetch complete (26660 records). [2025-10-22T17:05:47.828213] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-22T17:05:48.122984] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-22T17:05:48.194121] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-22T17:05:48.194203] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-22T17:05:48.194546] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-22T17:05:48.194609] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-22T17:05:48.195483] [DEBUG] [LOCAL ] AGD: Trimmed 26660 records to 19283 (keeping 200 days of data) [2025-10-22T17:05:48.307393] [DEBUG] [LOCAL ] AGD: Primary data saved (19283 records). [2025-10-22T17:05:48.307528] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-22T17:05:48.307607] [INFO ] [MAIN ] Update Progress: 52/2367 symbols completed. AGD took 29.4s. Estimated remaining: 4h 15m 0s. Rate: 9.1 symbols/min [2025-10-22T17:05:48.473074] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:48.483596] [DEBUG] [LOCAL ] AGM: Loaded 10663 existing records from primary storage. [2025-10-22T17:05:48.483822] [INFO ] [MAIN ] AGM: Loaded 10663 existing records. [2025-10-22T17:05:48.658663] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:48.658880] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-22T17:05:48.658930] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-22T17:05:48.659105] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-22T17:05:48.659160] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-22T17:05:48.924565] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-22T17:05:49.021014] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:49.111630] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:05:49.717684] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-22T17:05:50.483907] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-22T17:05:50.517624] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-22T17:05:50.572026] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:05:50.688614] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T17:05:51.317780] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-22T17:05:52.117768] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-22T17:05:52.917758] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-22T17:05:52.969438] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:05:53.064985] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-22T17:05:53.075740] [INFO ] [REMOTE ] AG: Full fetch complete (77784 records). [2025-10-22T17:05:53.075921] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-22T17:05:53.448669] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-22T17:05:53.473121] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-22T17:05:53.473215] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-22T17:05:53.474008] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-22T17:05:53.474073] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-22T17:05:53.475501] [DEBUG] [LOCAL ] AG: Trimmed 77784 records to 53644 (keeping 200 days of data) [2025-10-22T17:05:53.740746] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-22T17:05:53.795206] [DEBUG] [LOCAL ] AG: Primary data saved (53644 records). [2025-10-22T17:05:53.795340] [INFO ] [MAIN ] AG: Full history saved. [2025-10-22T17:05:53.795422] [INFO ] [MAIN ] Update Progress: 53/2367 symbols completed. AG took 47.6s. Estimated remaining: 4h 14m 5s. Rate: 9.1 symbols/min [2025-10-22T17:05:53.963340] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:53.994634] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T17:05:54.022570] [DEBUG] [LOCAL ] AGO: Loaded 27763 existing records from primary storage. [2025-10-22T17:05:54.022841] [INFO ] [MAIN ] AGO: Loaded 27763 existing records. [2025-10-22T17:05:54.193143] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:54.193322] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-22T17:05:54.193370] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-22T17:05:54.193563] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-22T17:05:54.193617] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-22T17:05:54.517911] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-22T17:05:54.538623] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:55.193331] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T17:05:55.317635] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-22T17:05:55.543520] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T17:05:56.106434] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T17:05:56.117787] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-22T17:05:56.574932] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T17:05:56.917761] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-22T17:05:57.717697] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-22T17:05:58.102868] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T17:05:58.517739] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-22T17:05:59.317686] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-22T17:05:59.373796] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T17:05:59.460977] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T17:06:00.117625] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-22T17:06:00.692439] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:06:00.917619] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-22T17:06:01.157280] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T17:06:01.717625] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-22T17:06:02.517754] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-22T17:06:02.625403] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T17:06:02.691435] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:06:03.289919] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T17:06:03.317621] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-22T17:06:04.117688] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-22T17:06:04.283413] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-22T17:06:04.285750] [INFO ] [REMOTE ] AGM: Full fetch complete (13322 records). [2025-10-22T17:06:04.285823] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-22T17:06:04.655199] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-22T17:06:04.655300] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-22T17:06:04.655550] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-22T17:06:04.655593] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-22T17:06:04.656082] [DEBUG] [LOCAL ] AGM: Trimmed 13322 records to 10617 (keeping 200 days of data) [2025-10-22T17:06:04.722918] [DEBUG] [LOCAL ] AGM: Primary data saved (10617 records). [2025-10-22T17:06:04.723026] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-22T17:06:04.723101] [INFO ] [MAIN ] Update Progress: 54/2367 symbols completed. AGM took 16.4s. Estimated remaining: 4h 17m 4s. Rate: 9.0 symbols/min [2025-10-22T17:06:04.894144] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:04.922924] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-22T17:06:04.924109] [DEBUG] [LOCAL ] AGRO: Loaded 32640 existing records from primary storage. [2025-10-22T17:06:04.925639] [INFO ] [MAIN ] AGRO: Loaded 32640 existing records. [2025-10-22T17:06:05.106221] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:05.106439] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-22T17:06:05.106487] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-22T17:06:05.106721] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-22T17:06:05.106778] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-22T17:06:05.463617] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:05.717744] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-22T17:06:05.970409] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T17:06:06.517686] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-22T17:06:06.775502] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T17:06:07.174237] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T17:06:07.317721] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-22T17:06:08.090046] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T17:06:08.117614] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-22T17:06:08.917736] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-22T17:06:09.074895] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T17:06:09.640626] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T17:06:09.717614] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-22T17:06:10.341071] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:06:10.517638] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-22T17:06:11.317815] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-22T17:06:11.605485] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T17:06:11.614254] [INFO ] [REMOTE ] AGL: Full fetch complete (75950 records). [2025-10-22T17:06:11.614397] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-22T17:06:12.089991] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-22T17:06:12.097238] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-22T17:06:12.111359] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-22T17:06:12.113550] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T17:06:12.112104] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-22T17:06:12.121128] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-22T17:06:12.124035] [DEBUG] [LOCAL ] AGL: Trimmed 75950 records to 52595 (keeping 200 days of data) [2025-10-22T17:06:12.416109] [DEBUG] [LOCAL ] AGL: Primary data saved (52595 records). [2025-10-22T17:06:12.416248] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-22T17:06:12.417766] [INFO ] [MAIN ] Update Progress: 55/2367 symbols completed. AGL took 29.3s. Estimated remaining: 4h 17m 41s. Rate: 9.0 symbols/min [2025-10-22T17:06:12.615393] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:12.650834] [DEBUG] [LOCAL ] AGX: Loaded 32682 existing records from primary storage. [2025-10-22T17:06:12.651097] [INFO ] [MAIN ] AGX: Loaded 32682 existing records. [2025-10-22T17:06:12.853117] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:12.853524] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-22T17:06:12.853776] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-22T17:06:12.854045] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-22T17:06:12.854105] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-22T17:06:12.919777] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-22T17:06:13.224976] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:13.272499] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T17:06:13.273312] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T17:06:13.717695] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-22T17:06:14.255832] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T17:06:14.517755] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-22T17:06:15.317745] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-22T17:06:15.551479] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T17:06:15.981928] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T17:06:16.117852] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-22T17:06:16.892536] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:06:16.917628] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-22T17:06:17.717788] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-22T17:06:18.323745] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T17:06:18.517688] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-22T17:06:18.544989] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T17:06:19.099688] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T17:06:19.317799] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-22T17:06:19.834225] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T17:06:20.117738] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-22T17:06:20.451099] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T17:06:20.917758] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-22T17:06:21.410025] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T17:06:21.717809] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-22T17:06:22.517790] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-22T17:06:22.918664] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T17:06:22.928709] [INFO ] [REMOTE ] AGI: Full fetch complete (77322 records). [2025-10-22T17:06:22.928978] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-22T17:06:23.330462] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-22T17:06:23.374253] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T17:06:23.402105] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-22T17:06:23.409836] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-22T17:06:23.411786] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-22T17:06:23.412329] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-22T17:06:23.415419] [DEBUG] [LOCAL ] AGI: Trimmed 77322 records to 53423 (keeping 200 days of data) [2025-10-22T17:06:23.542367] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T17:06:23.786894] [DEBUG] [LOCAL ] AGI: Primary data saved (53423 records). [2025-10-22T17:06:23.787091] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-22T17:06:23.788111] [INFO ] [MAIN ] Update Progress: 56/2367 symbols completed. AGI took 45.2s. Estimated remaining: 4h 20m 47s. Rate: 8.9 symbols/min [2025-10-22T17:06:23.961390] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:24.002328] [DEBUG] [LOCAL ] AHH: Loaded 40272 existing records from primary storage. [2025-10-22T17:06:24.002733] [INFO ] [MAIN ] AHH: Loaded 40272 existing records. [2025-10-22T17:06:24.122950] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-22T17:06:24.195496] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:24.196322] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-22T17:06:24.196451] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-22T17:06:24.196824] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-22T17:06:24.196937] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-22T17:06:24.573639] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:06:24.616379] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:24.917743] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-22T17:06:25.546484] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T17:06:25.717772] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-22T17:06:26.365381] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:06:26.517765] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-22T17:06:27.229287] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T17:06:27.235267] [INFO ] [REMOTE ] AGRO: Full fetch complete (48849 records). [2025-10-22T17:06:27.235461] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-22T17:06:27.326705] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-22T17:06:27.670265] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-22T17:06:27.670454] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-22T17:06:27.671125] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-22T17:06:27.671194] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-22T17:06:27.672635] [DEBUG] [LOCAL ] AGRO: Trimmed 48849 records to 32457 (keeping 200 days of data) [2025-10-22T17:06:27.864915] [DEBUG] [LOCAL ] AGRO: Primary data saved (32457 records). [2025-10-22T17:06:27.865060] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-22T17:06:27.866303] [INFO ] [MAIN ] Update Progress: 57/2367 symbols completed. AGRO took 23.1s. Estimated remaining: 4h 18m 51s. Rate: 8.9 symbols/min [2025-10-22T17:06:28.049357] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:28.049630] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-22T17:06:28.049728] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-22T17:06:28.050038] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-22T17:06:28.050110] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-22T17:06:28.050233] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-22T17:06:28.050364] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-22T17:06:28.122945] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-22T17:06:28.387661] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T17:06:28.468797] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:28.718085] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T17:06:28.917632] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-22T17:06:29.120060] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:06:29.120523] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-22T17:06:29.120683] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:06:29.120770] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-22T17:06:29.120857] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:06:29.120953] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-22T17:06:29.121063] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-22T17:06:29.121137] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-22T17:06:29.121232] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-22T17:06:29.121312] [INFO ] [MAIN ] Update Progress: 58/2367 symbols completed. AHL took 1.3s. Estimated remaining: 4h 15m 7s. Rate: 9.1 symbols/min [2025-10-22T17:06:29.309461] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:29.355731] [DEBUG] [LOCAL ] AHR: Loaded 48969 existing records from primary storage. [2025-10-22T17:06:29.356144] [INFO ] [MAIN ] AHR: Loaded 48969 existing records. [2025-10-22T17:06:29.550086] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:29.568572] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-22T17:06:29.569156] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-22T17:06:29.569885] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T17:06:29.576340] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-22T17:06:29.576444] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-22T17:06:29.723548] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-22T17:06:29.952917] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:30.517609] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-22T17:06:30.916684] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T17:06:31.317677] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-22T17:06:31.735046] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T17:06:32.117720] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-22T17:06:32.917632] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-22T17:06:32.988873] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:06:33.714843] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:06:33.723886] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-22T17:06:33.838248] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T17:06:34.517694] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-22T17:06:35.304769] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:06:35.317616] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-22T17:06:35.873070] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T17:06:35.878232] [INFO ] [REMOTE ] AGO: Full fetch complete (39790 records). [2025-10-22T17:06:35.878372] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-22T17:06:36.124626] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-22T17:06:36.266300] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-22T17:06:36.266393] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-22T17:06:36.266874] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-22T17:06:36.266940] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-22T17:06:36.268063] [DEBUG] [LOCAL ] AGO: Trimmed 39790 records to 27710 (keeping 200 days of data) [2025-10-22T17:06:36.433068] [DEBUG] [LOCAL ] AGO: Primary data saved (27710 records). [2025-10-22T17:06:36.433197] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-22T17:06:36.433283] [INFO ] [MAIN ] Update Progress: 59/2367 symbols completed. AGO took 42.6s. Estimated remaining: 4h 15m 27s. Rate: 9.0 symbols/min [2025-10-22T17:06:36.610107] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:36.617572] [DEBUG] [LOCAL ] AHT: Loaded 6381 existing records from primary storage. [2025-10-22T17:06:36.617859] [INFO ] [MAIN ] AHT: Loaded 6381 existing records. [2025-10-22T17:06:36.799744] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:36.800054] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-22T17:06:36.800127] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-22T17:06:36.800274] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-22T17:06:36.800325] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-22T17:06:36.921031] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-22T17:06:36.932119] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T17:06:37.191142] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:37.717749] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-22T17:06:37.884942] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T17:06:38.281962] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T17:06:38.371029] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T17:06:38.517633] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-22T17:06:39.233495] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T17:06:39.317739] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-22T17:06:39.945114] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T17:06:40.117689] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-22T17:06:40.917730] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-22T17:06:41.018052] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T17:06:41.717733] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-22T17:06:42.316081] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T17:06:42.517753] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-22T17:06:42.553531] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T17:06:43.317778] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-22T17:06:44.047306] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T17:06:44.117717] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-22T17:06:44.818942] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:06:44.872677] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T17:06:44.917915] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-22T17:06:45.717688] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-22T17:06:45.756796] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T17:06:46.517695] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-22T17:06:47.074959] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T17:06:47.136590] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T17:06:47.317742] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-22T17:06:48.117718] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-22T17:06:48.917761] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-22T17:06:49.717751] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-22T17:06:50.543721] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T17:06:50.546022] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-22T17:06:50.707046] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:06:50.875040] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (3.56 seconds). [2025-10-22T17:06:50.880503] [INFO ] [REMOTE ] AGX: Full fetch complete (49017 records). [2025-10-22T17:06:50.880613] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-22T17:06:51.272571] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-22T17:06:51.272766] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-22T17:06:51.273323] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-22T17:06:51.273404] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-22T17:06:51.274570] [DEBUG] [LOCAL ] AGX: Trimmed 49017 records to 32652 (keeping 200 days of data) [2025-10-22T17:06:51.329763] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-22T17:06:51.369677] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T17:06:51.391382] [INFO ] [REMOTE ] AHT: Full fetch complete (9090 records). [2025-10-22T17:06:51.397759] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-22T17:06:51.406280] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (3.29 seconds). [2025-10-22T17:06:51.872009] [DEBUG] [LOCAL ] AGX: Primary data saved (32652 records). [2025-10-22T17:06:51.894044] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-22T17:06:51.894151] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-22T17:06:51.895128] [INFO ] [MAIN ] Update Progress: 60/2367 symbols completed. AGX took 39.5s. Estimated remaining: 4h 20m 59s. Rate: 8.8 symbols/min [2025-10-22T17:06:51.895214] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-22T17:06:51.927245] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-22T17:06:51.959126] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-22T17:06:51.986355] [DEBUG] [LOCAL ] AHT: Trimmed 9090 records to 6358 (keeping 200 days of data) [2025-10-22T17:06:52.082995] [DEBUG] [LOCAL ] AHT: Primary data saved (6358 records). [2025-10-22T17:06:52.100761] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-22T17:06:52.100675] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:52.100907] [INFO ] [MAIN ] Update Progress: 61/2367 symbols completed. AHT took 15.7s. Estimated remaining: 4h 16m 44s. Rate: 9.0 symbols/min [2025-10-22T17:06:52.122804] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-22T17:06:52.272792] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:52.309389] [DEBUG] [LOCAL ] AI: Loaded 53765 existing records from primary storage. [2025-10-22T17:06:52.309810] [INFO ] [MAIN ] AI: Loaded 53765 existing records. [2025-10-22T17:06:52.518720] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:52.515109] [DEBUG] [LOCAL ] AIG: Loaded 53461 existing records from primary storage. [2025-10-22T17:06:52.519026] [INFO ] [MAIN ] AIG: Loaded 53461 existing records. [2025-10-22T17:06:52.541195] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-22T17:06:52.553573] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-22T17:06:52.597349] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-22T17:06:52.613036] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-22T17:06:52.819690] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:52.830435] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-22T17:06:52.830546] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-22T17:06:52.902255] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-22T17:06:52.902383] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-22T17:06:53.189703] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:53.228937] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-22T17:06:53.413991] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-22T17:06:53.487805] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:53.718875] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-22T17:06:53.722072] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T17:06:54.517785] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-22T17:06:55.317778] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-22T17:06:55.458142] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T17:06:55.676408] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-22T17:06:55.752979] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T17:06:56.117637] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-22T17:06:56.899553] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T17:06:56.917619] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-22T17:06:57.717745] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-22T17:06:57.804934] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T17:06:58.285107] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T17:06:58.517733] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-22T17:06:59.317753] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-22T17:06:59.864302] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-22T17:06:59.944325] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:07:00.117614] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-22T17:07:00.917679] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-22T17:07:01.101500] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T17:07:01.717677] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-22T17:07:02.066235] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T17:07:02.517687] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-22T17:07:02.954634] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T17:07:03.276556] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T17:07:03.283626] [INFO ] [REMOTE ] AHH: Full fetch complete (59508 records). [2025-10-22T17:07:03.283806] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-22T17:07:03.322957] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-22T17:07:03.704426] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-22T17:07:03.704508] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-22T17:07:03.705199] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-22T17:07:03.705280] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-22T17:07:03.706570] [DEBUG] [LOCAL ] AHH: Trimmed 59508 records to 40160 (keeping 200 days of data) [2025-10-22T17:07:03.937452] [DEBUG] [LOCAL ] AHH: Primary data saved (40160 records). [2025-10-22T17:07:03.937680] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-22T17:07:03.937808] [INFO ] [MAIN ] Update Progress: 62/2367 symbols completed. AHH took 40.1s. Estimated remaining: 4h 19m 49s. Rate: 8.9 symbols/min [2025-10-22T17:07:04.101806] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T17:07:04.135831] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-22T17:07:04.172836] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:04.173067] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-22T17:07:04.173122] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-22T17:07:04.173271] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-22T17:07:04.173334] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-22T17:07:04.173411] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-22T17:07:04.173459] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-22T17:07:04.651520] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:04.917749] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-22T17:07:05.429736] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T17:07:05.717686] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-22T17:07:05.936982] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:07:05.937296] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-22T17:07:05.937382] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:07:05.937430] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-22T17:07:05.937489] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:07:05.937560] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-22T17:07:05.937624] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-22T17:07:05.937696] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-22T17:07:05.937797] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-22T17:07:05.937848] [INFO ] [MAIN ] Update Progress: 63/2367 symbols completed. AII took 2.0s. Estimated remaining: 4h 16m 48s. Rate: 9.0 symbols/min [2025-10-22T17:07:06.120386] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:06.155453] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T17:07:06.184878] [DEBUG] [LOCAL ] AIN: Loaded 24431 existing records from primary storage. [2025-10-22T17:07:06.185146] [INFO ] [MAIN ] AIN: Loaded 24431 existing records. [2025-10-22T17:07:06.361006] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:07:06.361312] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-22T17:07:06.361360] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-22T17:07:06.361525] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-22T17:07:06.361562] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-22T17:07:06.534622] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-22T17:07:06.696069] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T17:07:06.742227] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:06.742370] [INFO ] [REMOTE ] AHR: Full fetch complete (70454 records). [2025-10-22T17:07:06.742863] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-22T17:07:06.743793] [FATAL] [VALIDATOR ] AHR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:07:06.743885] [FATAL] [MAIN ] AHR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:07:06.743929] [WARN ] [MAIN ] AHR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:07:06.743995] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-22T17:07:06.744062] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-22T17:07:06.744099] [INFO ] [LOCAL ] AHR: Starting deletion of derivative data. [2025-10-22T17:07:06.744242] [DEBUG] [LOCAL ] AHR: Deleted derivative data file. [2025-10-22T17:07:06.744915] [INFO ] [MAIN ] Update Progress: 64/2367 symbols completed. AHR took 37.6s. Estimated remaining: 4h 13m 10s. Rate: 9.1 symbols/min [2025-10-22T17:07:06.915865] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:06.931774] [DEBUG] [LOCAL ] AIO: Loaded 13039 existing records from primary storage. [2025-10-22T17:07:06.932033] [INFO ] [MAIN ] AIO: Loaded 13039 existing records. [2025-10-22T17:07:07.105944] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:07:07.106219] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-22T17:07:07.106299] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-22T17:07:07.106480] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-22T17:07:07.106521] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-22T17:07:07.322884] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-22T17:07:07.475525] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:08.117759] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-22T17:07:08.368156] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T17:07:08.573119] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T17:07:08.917691] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-22T17:07:09.717673] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-22T17:07:10.518834] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-22T17:07:10.531821] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T17:07:10.628976] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-22T17:07:10.650864] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T17:07:11.280087] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T17:07:11.317671] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-22T17:07:12.117722] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-22T17:07:12.386242] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T17:07:12.917668] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-22T17:07:13.717763] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-22T17:07:14.067203] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T17:07:14.251305] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T17:07:14.517725] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-22T17:07:14.570763] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T17:07:15.317727] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-22T17:07:16.117719] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-22T17:07:16.488496] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:07:16.917617] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-22T17:07:17.018411] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-22T17:07:17.717675] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-22T17:07:18.075103] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T17:07:18.131155] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T17:07:18.517788] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-22T17:07:19.317744] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-22T17:07:20.117726] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-22T17:07:20.198319] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-22T17:07:20.331917] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T17:07:20.362209] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T17:07:20.917742] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-22T17:07:21.208404] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T17:07:21.717697] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-22T17:07:22.517689] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-22T17:07:23.317662] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-22T17:07:23.491262] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-22T17:07:23.541004] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:07:23.545727] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T17:07:24.117686] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-22T17:07:24.327317] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T17:07:24.662005] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-22T17:07:24.917745] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-22T17:07:25.704443] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T17:07:25.717622] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-22T17:07:26.517688] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-22T17:07:26.603855] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T17:07:27.317768] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-22T17:07:28.117725] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-22T17:07:28.517622] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T17:07:28.527911] [INFO ] [REMOTE ] AIG: Full fetch complete (77565 records). [2025-10-22T17:07:28.528160] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-22T17:07:28.941677] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-22T17:07:29.000058] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-22T17:07:29.000248] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-22T17:07:29.001335] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-22T17:07:29.001452] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-22T17:07:29.004330] [DEBUG] [LOCAL ] AIG: Trimmed 77565 records to 53459 (keeping 200 days of data) [2025-10-22T17:07:29.128531] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-22T17:07:29.158244] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-22T17:07:29.166126] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-22T17:07:29.506316] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T17:07:29.722624] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-22T17:07:29.868154] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-22T17:07:29.871983] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-22T17:07:29.873298] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-22T17:07:29.878672] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-22T17:07:29.882804] [DEBUG] [LOCAL ] AIG: Primary data saved (53459 records). [2025-10-22T17:07:29.883028] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-22T17:07:29.883312] [INFO ] [MAIN ] Update Progress: 65/2367 symbols completed. AIG took 37.8s. Estimated remaining: 4h 22m 49s. Rate: 8.8 symbols/min [2025-10-22T17:07:29.948772] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53765 (keeping 200 days of data) [2025-10-22T17:07:30.133357] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T17:07:30.182799] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:30.193347] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-10-22T17:07:30.194001] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-10-22T17:07:30.201780] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-22T17:07:30.205484] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-22T17:07:30.218353] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-22T17:07:30.218486] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-22T17:07:30.518353] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-22T17:07:30.832998] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:30.849081] [DEBUG] [LOCAL ] AI: Primary data saved (53765 records). [2025-10-22T17:07:30.849223] [INFO ] [MAIN ] AI: Full history saved. [2025-10-22T17:07:30.850347] [INFO ] [MAIN ] Update Progress: 66/2367 symbols completed. AI took 39.0s. Estimated remaining: 4h 19m 17s. Rate: 8.9 symbols/min [2025-10-22T17:07:31.023622] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:31.024103] [DEBUG] [LOCAL ] AIT: No existing data file found in primary storage. [2025-10-22T17:07:31.024210] [WARN ] [MAIN ] AIT: No existing data found, performing full refresh instead. [2025-10-22T17:07:31.024399] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-22T17:07:31.024441] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-22T17:07:31.024481] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-10-22T17:07:31.024512] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-22T17:07:31.164238] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T17:07:31.200437] [INFO ] [REMOTE ] AIN: Full fetch complete (33723 records). [2025-10-22T17:07:31.261824] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-22T17:07:31.332721] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-22T17:07:31.580486] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:31.729517] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T17:07:31.866947] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-22T17:07:31.867061] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-22T17:07:31.867666] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-22T17:07:31.867781] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-22T17:07:31.868863] [DEBUG] [LOCAL ] AIN: Trimmed 33723 records to 24301 (keeping 200 days of data) [2025-10-22T17:07:32.025275] [DEBUG] [LOCAL ] AIN: Primary data saved (24301 records). [2025-10-22T17:07:32.025481] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-22T17:07:32.025590] [INFO ] [MAIN ] Update Progress: 67/2367 symbols completed. AIN took 26.1s. Estimated remaining: 4h 15m 58s. Rate: 9.0 symbols/min [2025-10-22T17:07:32.125836] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-22T17:07:32.203879] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:32.246784] [DEBUG] [LOCAL ] AIV: Loaded 41856 existing records from primary storage. [2025-10-22T17:07:32.247201] [INFO ] [MAIN ] AIV: Loaded 41856 existing records. [2025-10-22T17:07:32.437028] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:07:32.437349] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-22T17:07:32.437427] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-22T17:07:32.437978] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-22T17:07:32.438038] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-22T17:07:32.839104] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:32.842442] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T17:07:32.917627] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-22T17:07:33.676877] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T17:07:33.717610] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-22T17:07:33.937048] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-22T17:07:34.517773] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-22T17:07:34.900384] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T17:07:35.320745] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-22T17:07:36.117749] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-22T17:07:36.595637] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T17:07:36.713476] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T17:07:36.748556] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T17:07:36.751384] [INFO ] [REMOTE ] AIO: Full fetch complete (20069 records). [2025-10-22T17:07:36.751456] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-22T17:07:36.927948] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-22T17:07:37.123259] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-22T17:07:37.123363] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-22T17:07:37.123690] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-22T17:07:37.123757] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-22T17:07:37.124315] [DEBUG] [LOCAL ] AIO: Trimmed 20069 records to 12916 (keeping 200 days of data) [2025-10-22T17:07:37.202598] [DEBUG] [LOCAL ] AIO: Primary data saved (12916 records). [2025-10-22T17:07:37.202764] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-22T17:07:37.202853] [INFO ] [MAIN ] Update Progress: 68/2367 symbols completed. AIO took 30.5s. Estimated remaining: 4h 15m 1s. Rate: 9.0 symbols/min [2025-10-22T17:07:37.375591] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:37.405715] [DEBUG] [LOCAL ] AIZ: Loaded 29391 existing records from primary storage. [2025-10-22T17:07:37.406025] [INFO ] [MAIN ] AIZ: Loaded 29391 existing records. [2025-10-22T17:07:37.603522] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:07:37.603806] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-22T17:07:37.603858] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-22T17:07:37.604083] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-22T17:07:37.604137] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-22T17:07:37.722765] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-22T17:07:37.956309] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:38.250514] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T17:07:38.517756] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-22T17:07:39.269828] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T17:07:39.317686] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-22T17:07:39.906361] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T17:07:40.117746] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-22T17:07:40.698329] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T17:07:40.917745] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-22T17:07:41.560128] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:07:41.717732] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-22T17:07:42.365992] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:07:42.517674] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-22T17:07:43.317671] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-22T17:07:43.436694] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:07:44.064605] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T17:07:44.117624] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-22T17:07:44.835347] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T17:07:44.899315] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T17:07:44.917614] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-22T17:07:45.717631] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-22T17:07:46.292148] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T17:07:46.517688] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-22T17:07:46.542131] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T17:07:47.317733] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-22T17:07:48.117762] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-22T17:07:48.556111] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T17:07:48.732157] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T17:07:48.917696] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-22T17:07:49.363707] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T17:07:49.717746] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-22T17:07:49.923299] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T17:07:50.517629] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-22T17:07:51.084365] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T17:07:51.317687] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-22T17:07:51.969415] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T17:07:52.117741] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-22T17:07:52.729733] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T17:07:52.917762] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-22T17:07:53.481772] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T17:07:53.717736] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-22T17:07:54.124123] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T17:07:54.517795] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-22T17:07:54.966009] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T17:07:55.317676] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-22T17:07:55.814148] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T17:07:56.117725] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-22T17:07:56.917770] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-22T17:07:57.131496] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:07:57.141022] [INFO ] [REMOTE ] AIV: Full fetch complete (60367 records). [2025-10-22T17:07:57.141214] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-22T17:07:57.610544] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-22T17:07:57.610690] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-22T17:07:57.611399] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-22T17:07:57.611561] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-22T17:07:57.612835] [DEBUG] [LOCAL ] AIV: Trimmed 60367 records to 41857 (keeping 200 days of data) [2025-10-22T17:07:57.717687] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-22T17:07:57.774207] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T17:07:57.916166] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T17:07:57.931108] [DEBUG] [LOCAL ] AIV: Primary data saved (41857 records). [2025-10-22T17:07:57.931749] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-22T17:07:57.932496] [INFO ] [MAIN ] Update Progress: 69/2367 symbols completed. AIV took 25.9s. Estimated remaining: 4h 22m 43s. Rate: 8.7 symbols/min [2025-10-22T17:07:58.097510] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:58.104436] [DEBUG] [LOCAL ] AIZN: Loaded 3846 existing records from primary storage. [2025-10-22T17:07:58.104702] [INFO ] [MAIN ] AIZN: Loaded 3846 existing records. [2025-10-22T17:07:58.277470] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:07:58.277745] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-22T17:07:58.277802] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-22T17:07:58.277966] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-22T17:07:58.278020] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-22T17:07:58.524742] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-22T17:07:58.654287] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:59.080701] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T17:07:59.317737] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-22T17:07:59.618589] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:08:00.117673] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-22T17:08:00.359519] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:08:00.914990] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T17:08:00.917601] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-22T17:08:01.377359] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T17:08:01.717674] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-22T17:08:02.517732] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-22T17:08:03.158029] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T17:08:03.163581] [INFO ] [REMOTE ] AIR: Full fetch complete (40091 records). [2025-10-22T17:08:03.163716] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-22T17:08:03.164299] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:08:03.164386] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:08:03.164429] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:08:03.164467] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-22T17:08:03.164524] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-22T17:08:03.164558] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-10-22T17:08:03.164596] [DEBUG] [LOCAL ] AIR: No derivative data file found to delete. [2025-10-22T17:08:03.164671] [INFO ] [MAIN ] Update Progress: 70/2367 symbols completed. AIR took 33.3s. Estimated remaining: 4h 21m 43s. Rate: 8.8 symbols/min [2025-10-22T17:08:03.319385] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-22T17:08:03.345339] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:03.392201] [DEBUG] [LOCAL ] AJG: Loaded 46428 existing records from primary storage. [2025-10-22T17:08:03.392586] [INFO ] [MAIN ] AJG: Loaded 46428 existing records. [2025-10-22T17:08:03.581034] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:03.581283] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-22T17:08:03.581331] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-22T17:08:03.581518] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-22T17:08:03.581555] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-22T17:08:03.951221] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:03.976428] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T17:08:03.978025] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T17:08:04.117692] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-22T17:08:04.917761] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-22T17:08:05.540485] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T17:08:05.717667] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-22T17:08:05.951299] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T17:08:06.098935] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-22T17:08:06.517737] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-22T17:08:07.317683] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-22T17:08:07.955200] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:08:08.117629] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-22T17:08:08.521398] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T17:08:08.917754] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-22T17:08:09.496969] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T17:08:09.504856] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T17:08:09.506527] [INFO ] [REMOTE ] AIT: Full fetch complete (39116 records). [2025-10-22T17:08:09.506987] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-22T17:08:09.722819] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-22T17:08:09.870181] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-22T17:08:09.870259] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-22T17:08:09.870723] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-22T17:08:09.870783] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-22T17:08:09.871583] [DEBUG] [LOCAL ] AIT: Trimmed 39116 records to 26566 (keeping 200 days of data) [2025-10-22T17:08:10.032158] [DEBUG] [LOCAL ] AIT: Primary data saved (26566 records). [2025-10-22T17:08:10.032277] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-22T17:08:10.032344] [INFO ] [MAIN ] Update Progress: 71/2367 symbols completed. AIT took 39.2s. Estimated remaining: 4h 21m 37s. Rate: 8.8 symbols/min [2025-10-22T17:08:10.197612] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:10.197798] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-22T17:08:10.197842] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-22T17:08:10.197948] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-22T17:08:10.197988] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-22T17:08:10.198028] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-22T17:08:10.198059] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-22T17:08:10.528116] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-22T17:08:10.548921] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:11.059539] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T17:08:11.063857] [INFO ] [REMOTE ] AIZ: Full fetch complete (42809 records). [2025-10-22T17:08:11.063966] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-22T17:08:11.175456] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T17:08:11.324895] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-22T17:08:11.452292] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-22T17:08:11.452373] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-22T17:08:11.452887] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-22T17:08:11.452947] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-22T17:08:11.453818] [DEBUG] [LOCAL ] AIZ: Trimmed 42809 records to 29244 (keeping 200 days of data) [2025-10-22T17:08:11.628357] [DEBUG] [LOCAL ] AIZ: Primary data saved (29244 records). [2025-10-22T17:08:11.628483] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-22T17:08:11.628562] [INFO ] [MAIN ] Update Progress: 72/2367 symbols completed. AIZ took 34.4s. Estimated remaining: 4h 18m 43s. Rate: 8.9 symbols/min [2025-10-22T17:08:11.795630] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:11.836974] [DEBUG] [LOCAL ] AKR: Loaded 46115 existing records from primary storage. [2025-10-22T17:08:11.837259] [INFO ] [MAIN ] AKR: Loaded 46115 existing records. [2025-10-22T17:08:12.021893] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T17:08:12.021765] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:12.023325] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-22T17:08:12.023376] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-22T17:08:12.023689] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-22T17:08:12.023745] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-22T17:08:12.121681] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-22T17:08:12.371063] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:12.694524] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T17:08:12.917632] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-22T17:08:13.388040] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T17:08:13.717682] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-22T17:08:14.517672] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-22T17:08:15.081227] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T17:08:15.317625] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-22T17:08:15.451523] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T17:08:15.786222] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T17:08:16.117681] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-22T17:08:16.513934] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-22T17:08:16.917754] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-22T17:08:17.717623] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-22T17:08:18.209987] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T17:08:18.517687] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-22T17:08:19.317297] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T17:08:19.327394] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-22T17:08:19.817494] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-22T17:08:19.903025] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:08:20.117669] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-22T17:08:20.917683] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-22T17:08:21.712064] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:08:21.721217] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-22T17:08:22.500736] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T17:08:22.501847] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:08:22.517604] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-22T17:08:23.317694] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-22T17:08:24.016952] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T17:08:24.018180] [INFO ] [REMOTE ] AIZN: Full fetch complete (5776 records). [2025-10-22T17:08:24.018250] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-22T17:08:24.018600] [FATAL] [VALIDATOR ] AIZN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:08:24.018722] [FATAL] [MAIN ] AIZN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:08:24.018766] [WARN ] [MAIN ] AIZN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:08:24.018806] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-22T17:08:24.018864] [DEBUG] [LOCAL ] AIZN: No primary data file found to delete. [2025-10-22T17:08:24.018899] [INFO ] [LOCAL ] AIZN: Starting deletion of derivative data. [2025-10-22T17:08:24.019053] [DEBUG] [LOCAL ] AIZN: Deleted derivative data file. [2025-10-22T17:08:24.019134] [INFO ] [MAIN ] Update Progress: 73/2367 symbols completed. AIZN took 26.1s. Estimated remaining: 4h 21m 33s. Rate: 8.8 symbols/min [2025-10-22T17:08:24.122947] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-22T17:08:24.217420] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:24.219404] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T17:08:24.269286] [DEBUG] [LOCAL ] AL: Loaded 44794 existing records from primary storage. [2025-10-22T17:08:24.269584] [INFO ] [MAIN ] AL: Loaded 44794 existing records. [2025-10-22T17:08:24.441767] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:24.442004] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-22T17:08:24.442054] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-22T17:08:24.442266] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-22T17:08:24.442321] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-22T17:08:24.680590] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T17:08:24.792183] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:24.917630] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-22T17:08:25.717756] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-22T17:08:26.070393] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-22T17:08:26.522859] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-22T17:08:26.542255] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:08:27.317741] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-22T17:08:28.109712] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:08:28.118734] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-22T17:08:28.362501] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T17:08:28.376569] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-22T17:08:28.917761] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-22T17:08:29.717741] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-22T17:08:30.461131] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T17:08:30.475571] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T17:08:30.477273] [INFO ] [REMOTE ] AKA: Full fetch complete (2821 records). [2025-10-22T17:08:30.477357] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-22T17:08:30.522777] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-22T17:08:30.675134] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T17:08:30.675407] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:08:30.675499] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:08:30.675593] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-22T17:08:30.675718] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-22T17:08:30.675794] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-22T17:08:30.675869] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-22T17:08:30.676014] [INFO ] [MAIN ] Update Progress: 74/2367 symbols completed. AKA took 20.6s. Estimated remaining: 4h 21m 21s. Rate: 8.8 symbols/min [2025-10-22T17:08:30.886098] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:30.935298] [DEBUG] [LOCAL ] ALB: Loaded 53366 existing records from primary storage. [2025-10-22T17:08:30.935609] [INFO ] [MAIN ] ALB: Loaded 53366 existing records. [2025-10-22T17:08:31.114736] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:31.114963] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-22T17:08:31.115022] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-22T17:08:31.115234] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-22T17:08:31.115298] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-22T17:08:31.324779] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-22T17:08:31.476622] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:32.117633] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-22T17:08:32.253258] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T17:08:32.917774] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-22T17:08:33.267836] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T17:08:33.717752] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-22T17:08:34.178699] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T17:08:34.519760] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-22T17:08:34.534567] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T17:08:35.287741] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T17:08:35.317672] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-22T17:08:35.830732] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:08:36.117693] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-22T17:08:36.917692] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-22T17:08:37.011794] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T17:08:37.676289] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T17:08:37.717734] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-22T17:08:38.517694] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-22T17:08:38.669612] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T17:08:39.317802] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-22T17:08:39.381501] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T17:08:39.843859] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T17:08:40.117684] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-22T17:08:40.917732] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-22T17:08:41.255779] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T17:08:41.653603] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T17:08:41.717620] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-22T17:08:42.055387] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T17:08:42.517767] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-22T17:08:43.317731] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-22T17:08:43.468676] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T17:08:43.476280] [INFO ] [REMOTE ] AKR: Full fetch complete (65519 records). [2025-10-22T17:08:43.476401] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-22T17:08:43.856584] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-22T17:08:43.856716] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-22T17:08:43.857445] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-22T17:08:43.857570] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-22T17:08:43.859179] [DEBUG] [LOCAL ] AKR: Trimmed 65519 records to 46103 (keeping 200 days of data) [2025-10-22T17:08:43.974225] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T17:08:44.126979] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-22T17:08:44.173571] [DEBUG] [LOCAL ] AKR: Primary data saved (46103 records). [2025-10-22T17:08:44.174138] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-22T17:08:44.174926] [INFO ] [MAIN ] Update Progress: 75/2367 symbols completed. AKR took 32.5s. Estimated remaining: 4h 24m 37s. Rate: 8.7 symbols/min [2025-10-22T17:08:44.339524] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:44.385915] [DEBUG] [LOCAL ] ALC: Loaded 51216 existing records from primary storage. [2025-10-22T17:08:44.386218] [INFO ] [MAIN ] ALC: Loaded 51216 existing records. [2025-10-22T17:08:44.558764] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:44.558984] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-22T17:08:44.559031] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-22T17:08:44.559442] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-22T17:08:44.559478] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-22T17:08:44.909867] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:44.917633] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-22T17:08:45.445245] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-22T17:08:45.717679] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-22T17:08:45.755190] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:08:46.346928] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T17:08:46.355564] [INFO ] [REMOTE ] AL: Full fetch complete (63656 records). [2025-10-22T17:08:46.355786] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-22T17:08:46.528094] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-22T17:08:46.774986] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-22T17:08:46.775095] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-22T17:08:46.775880] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-22T17:08:46.775953] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-22T17:08:46.777836] [DEBUG] [LOCAL ] AL: Trimmed 63656 records to 44805 (keeping 200 days of data) [2025-10-22T17:08:47.060344] [DEBUG] [LOCAL ] AL: Primary data saved (44805 records). [2025-10-22T17:08:47.060501] [INFO ] [MAIN ] AL: Full history saved. [2025-10-22T17:08:47.061382] [INFO ] [MAIN ] Update Progress: 76/2367 symbols completed. AL took 23.0s. Estimated remaining: 4h 22m 29s. Rate: 8.7 symbols/min [2025-10-22T17:08:47.225174] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:47.256849] [DEBUG] [LOCAL ] ALE: Loaded 32060 existing records from primary storage. [2025-10-22T17:08:47.257201] [INFO ] [MAIN ] ALE: Loaded 32060 existing records. [2025-10-22T17:08:47.324077] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-22T17:08:47.432102] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:47.432321] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-22T17:08:47.432369] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-22T17:08:47.432545] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-22T17:08:47.432582] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-22T17:08:47.789875] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:47.905345] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T17:08:48.117684] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-22T17:08:48.353340] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T17:08:48.360790] [INFO ] [REMOTE ] AJG: Full fetch complete (68885 records). [2025-10-22T17:08:48.360922] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-22T17:08:48.777520] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-22T17:08:48.777726] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-22T17:08:48.778516] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-22T17:08:48.778606] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-22T17:08:48.780409] [DEBUG] [LOCAL ] AJG: Trimmed 68885 records to 46386 (keeping 200 days of data) [2025-10-22T17:08:48.918988] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-22T17:08:49.160630] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T17:08:49.272515] [DEBUG] [LOCAL ] AJG: Primary data saved (46386 records). [2025-10-22T17:08:49.272698] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-22T17:08:49.273598] [INFO ] [MAIN ] Update Progress: 77/2367 symbols completed. AJG took 46.1s. Estimated remaining: 4h 20m 3s. Rate: 8.8 symbols/min [2025-10-22T17:08:49.717761] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-22T17:08:50.021589] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T17:08:50.182913] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T17:08:50.517772] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-22T17:08:51.317674] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-22T17:08:51.412591] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T17:08:52.117756] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-22T17:08:52.410153] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T17:08:52.527023] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T17:08:52.917761] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-22T17:08:53.685592] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T17:08:53.717611] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-22T17:08:54.068563] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T17:08:54.517745] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-22T17:08:55.317683] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-22T17:08:55.461928] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:08:55.838119] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T17:08:56.117717] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-22T17:08:56.917727] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-22T17:08:57.798778] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-22T17:08:57.816727] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-22T17:08:57.835091] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T17:08:57.926461] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T17:08:58.517755] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-22T17:08:59.317638] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-22T17:08:59.655376] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:08:59.921498] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T17:09:00.117684] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-22T17:09:00.917631] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-22T17:09:01.295950] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-22T17:09:01.717626] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-22T17:09:01.995622] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T17:09:02.517744] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-22T17:09:03.142505] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-22T17:09:03.248275] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T17:09:03.317618] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-22T17:09:04.040269] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T17:09:04.117721] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-22T17:09:04.917749] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-22T17:09:05.121113] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:09:05.717761] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-22T17:09:06.378504] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T17:09:06.453842] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-22T17:09:06.462758] [INFO ] [REMOTE ] ALB: Full fetch complete (77074 records). [2025-10-22T17:09:06.462901] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-22T17:09:06.527209] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-22T17:09:06.861218] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-22T17:09:06.861302] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-22T17:09:06.862027] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-22T17:09:06.862092] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-22T17:09:06.863509] [DEBUG] [LOCAL ] ALB: Trimmed 77074 records to 53362 (keeping 200 days of data) [2025-10-22T17:09:07.209148] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T17:09:07.241833] [DEBUG] [LOCAL ] ALB: Primary data saved (53362 records). [2025-10-22T17:09:07.241980] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-22T17:09:07.242939] [INFO ] [MAIN ] Update Progress: 78/2367 symbols completed. ALB took 36.6s. Estimated remaining: 4h 25m 24s. Rate: 8.6 symbols/min [2025-10-22T17:09:07.317759] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-22T17:09:08.094434] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T17:09:08.100941] [INFO ] [REMOTE ] ALE: Full fetch complete (44363 records). [2025-10-22T17:09:08.101035] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-22T17:09:08.505413] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-22T17:09:08.505488] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-22T17:09:08.505957] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-22T17:09:08.506018] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-22T17:09:08.506937] [DEBUG] [LOCAL ] ALE: Trimmed 44363 records to 32075 (keeping 200 days of data) [2025-10-22T17:09:08.696461] [DEBUG] [LOCAL ] ALE: Primary data saved (32075 records). [2025-10-22T17:09:08.696612] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-22T17:09:08.696730] [INFO ] [MAIN ] Update Progress: 79/2367 symbols completed. ALE took 21.6s. Estimated remaining: 4h 22m 37s. Rate: 8.7 symbols/min [2025-10-22T17:09:09.241773] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T17:09:09.250694] [INFO ] [REMOTE ] ALC: Full fetch complete (73851 records). [2025-10-22T17:09:09.250852] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-22T17:09:09.642209] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-22T17:09:09.642297] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-22T17:09:09.643088] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-22T17:09:09.643152] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-22T17:09:09.644667] [DEBUG] [LOCAL ] ALC: Trimmed 73851 records to 51212 (keeping 200 days of data) [2025-10-22T17:09:09.942413] [DEBUG] [LOCAL ] ALC: Primary data saved (51212 records). [2025-10-22T17:09:09.942553] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-22T17:09:09.943159] [INFO ] [MAIN ] Update Progress: 80/2367 symbols completed. ALC took 25.8s. Estimated remaining: 4h 19m 49s. Rate: 8.8 symbols/min [2025-10-22T17:09:10.493948] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:10.567462] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:10.642904] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:10.646847] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:10.650106] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-22T17:09:10.650166] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-22T17:09:10.650252] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-22T17:09:10.650292] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-22T17:09:10.650341] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-22T17:09:10.650426] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-22T17:09:10.701407] [DEBUG] [LOCAL ] ALG: Loaded 9723 existing records from primary storage. [2025-10-22T17:09:10.726234] [INFO ] [MAIN ] ALG: Loaded 9723 existing records. [2025-10-22T17:09:10.889665] [DEBUG] [LOCAL ] ALEX: Loaded 30881 existing records from primary storage. [2025-10-22T17:09:10.945479] [INFO ] [MAIN ] ALEX: Loaded 30881 existing records. [2025-10-22T17:09:11.115924] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:11.196004] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-22T17:09:11.198197] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-22T17:09:11.247350] [DEBUG] [LOCAL ] ALIT: Loaded 52785 existing records from primary storage. [2025-10-22T17:09:11.258208] [INFO ] [MAIN ] ALIT: Loaded 52785 existing records. [2025-10-22T17:09:11.258009] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-22T17:09:11.297550] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-22T17:09:11.773184] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:11.827166] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-22T17:09:11.874440] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-22T17:09:11.910843] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:11.905815] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:11.945701] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-22T17:09:11.953296] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-22T17:09:11.953749] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-22T17:09:11.953627] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-22T17:09:11.954165] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-22T17:09:11.998300] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-22T17:09:12.035437] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-22T17:09:12.307781] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:09:12.383466] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-22T17:09:12.433731] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:09:12.491542] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-22T17:09:12.503905] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:12.573221] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:09:12.611394] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-22T17:09:12.664057] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-22T17:09:12.697320] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-22T17:09:12.707895] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-22T17:09:12.764279] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-22T17:09:12.782407] [INFO ] [MAIN ] Update Progress: 81/2367 symbols completed. ALH took 2.8s. Estimated remaining: 4h 17m 50s. Rate: 8.9 symbols/min [2025-10-22T17:09:13.001774] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:13.061104] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:13.062823] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-22T17:09:13.062013] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-22T17:09:13.145614] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:13.204425] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-22T17:09:13.204871] [INFO ] [MAIN ] ALK: Loaded 53087 existing records. [2025-10-22T17:09:13.386254] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:13.386535] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-22T17:09:13.386586] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-22T17:09:13.386847] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-22T17:09:13.386960] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-22T17:09:13.777530] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:09:13.783413] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:13.786783] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-22T17:09:13.787486] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-22T17:09:14.166957] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T17:09:14.172866] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-22T17:09:14.626829] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:09:14.643702] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T17:09:14.644295] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-22T17:09:14.647112] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-22T17:09:14.963940] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T17:09:15.203386] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T17:09:15.317784] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-22T17:09:15.592237] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T17:09:16.117745] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-22T17:09:16.150072] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T17:09:16.917631] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-22T17:09:16.957908] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:09:17.012238] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:09:17.717674] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-22T17:09:18.517631] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-22T17:09:18.534779] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T17:09:18.723792] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:09:19.317678] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-22T17:09:20.117675] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-22T17:09:20.312208] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:09:20.751999] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T17:09:20.768613] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T17:09:20.917667] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-22T17:09:21.717716] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-22T17:09:22.427266] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T17:09:22.517690] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-22T17:09:23.317691] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-22T17:09:23.540679] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T17:09:24.117753] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-22T17:09:24.278953] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T17:09:24.472194] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T17:09:24.923901] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-22T17:09:24.924739] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T17:09:25.717724] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-22T17:09:26.517722] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-22T17:09:26.742321] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T17:09:27.317678] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-22T17:09:27.517426] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T17:09:27.706602] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T17:09:28.057924] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T17:09:28.117759] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-22T17:09:28.887307] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T17:09:28.917612] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-22T17:09:29.638061] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T17:09:29.639788] [INFO ] [REMOTE ] ALG: Full fetch complete (15277 records). [2025-10-22T17:09:29.639857] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-22T17:09:29.722877] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-22T17:09:30.006715] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-22T17:09:30.006803] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-22T17:09:30.007069] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-22T17:09:30.007112] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-22T17:09:30.007721] [DEBUG] [LOCAL ] ALG: Trimmed 15277 records to 9714 (keeping 200 days of data) [2025-10-22T17:09:30.069548] [DEBUG] [LOCAL ] ALG: Primary data saved (9714 records). [2025-10-22T17:09:30.069717] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-22T17:09:30.069811] [INFO ] [MAIN ] Update Progress: 82/2367 symbols completed. ALG took 20.1s. Estimated remaining: 4h 22m 37s. Rate: 8.7 symbols/min [2025-10-22T17:09:30.242850] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:30.289024] [DEBUG] [LOCAL ] ALL: Loaded 49648 existing records from primary storage. [2025-10-22T17:09:30.289330] [INFO ] [MAIN ] ALL: Loaded 49648 existing records. [2025-10-22T17:09:30.465463] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:30.465709] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-22T17:09:30.465766] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-22T17:09:30.466093] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-22T17:09:30.466150] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-22T17:09:30.523711] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-22T17:09:30.819600] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:31.317720] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-22T17:09:31.524488] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:09:31.961254] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T17:09:32.117736] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-22T17:09:32.585810] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T17:09:32.917704] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-22T17:09:32.983541] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T17:09:33.717681] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-22T17:09:34.415361] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T17:09:34.517739] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-22T17:09:35.317628] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-22T17:09:35.653833] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T17:09:36.117678] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-22T17:09:36.307087] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T17:09:36.728314] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T17:09:36.917715] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-22T17:09:37.717742] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-22T17:09:37.870549] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T17:09:38.517637] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-22T17:09:38.916406] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T17:09:39.317685] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-22T17:09:39.536577] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:09:39.830996] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:09:39.838670] [INFO ] [REMOTE ] ALEX: Full fetch complete (44562 records). [2025-10-22T17:09:39.838794] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-22T17:09:40.124172] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-22T17:09:40.252183] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-22T17:09:40.252260] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-22T17:09:40.252743] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-22T17:09:40.252822] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-22T17:09:40.253764] [DEBUG] [LOCAL ] ALEX: Trimmed 44562 records to 30810 (keeping 200 days of data) [2025-10-22T17:09:40.435822] [DEBUG] [LOCAL ] ALEX: Primary data saved (30810 records). [2025-10-22T17:09:40.435948] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-22T17:09:40.436025] [INFO ] [MAIN ] Update Progress: 83/2367 symbols completed. ALEX took 30.5s. Estimated remaining: 4h 24m 5s. Rate: 8.6 symbols/min [2025-10-22T17:09:40.609066] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:40.658533] [DEBUG] [LOCAL ] ALLE: Loaded 43990 existing records from primary storage. [2025-10-22T17:09:40.658844] [INFO ] [MAIN ] ALLE: Loaded 43990 existing records. [2025-10-22T17:09:40.845245] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:40.845465] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-22T17:09:40.845513] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-22T17:09:40.846026] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-22T17:09:40.846084] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-22T17:09:40.922017] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-22T17:09:41.365748] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:41.395273] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-22T17:09:41.717670] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-22T17:09:41.808837] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:09:41.819099] [INFO ] [REMOTE ] ALIT: Full fetch complete (76623 records). [2025-10-22T17:09:41.819353] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-22T17:09:42.222880] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-22T17:09:42.222986] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-22T17:09:42.223752] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-22T17:09:42.223815] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-22T17:09:42.225208] [DEBUG] [LOCAL ] ALIT: Trimmed 76623 records to 52781 (keeping 200 days of data) [2025-10-22T17:09:42.518808] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-22T17:09:42.533222] [DEBUG] [LOCAL ] ALIT: Primary data saved (52781 records). [2025-10-22T17:09:42.533541] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-22T17:09:42.534356] [INFO ] [MAIN ] Update Progress: 84/2367 symbols completed. ALIT took 32.6s. Estimated remaining: 4h 21m 47s. Rate: 8.7 symbols/min [2025-10-22T17:09:42.699162] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T17:09:42.754529] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:42.806472] [DEBUG] [LOCAL ] ALLY: Loaded 53223 existing records from primary storage. [2025-10-22T17:09:42.806837] [INFO ] [MAIN ] ALLY: Loaded 53223 existing records. [2025-10-22T17:09:42.990408] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:42.990679] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-22T17:09:42.990742] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-22T17:09:42.990979] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-22T17:09:42.991036] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-22T17:09:43.322812] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-22T17:09:43.354606] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:43.488798] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T17:09:43.497499] [INFO ] [REMOTE ] ALK: Full fetch complete (77036 records). [2025-10-22T17:09:43.497632] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-22T17:09:43.884774] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-22T17:09:43.884861] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-22T17:09:43.885587] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-22T17:09:43.885686] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-22T17:09:43.887158] [DEBUG] [LOCAL ] ALK: Trimmed 77036 records to 53087 (keeping 200 days of data) [2025-10-22T17:09:44.119473] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-22T17:09:44.217051] [DEBUG] [LOCAL ] ALK: Primary data saved (53087 records). [2025-10-22T17:09:44.217285] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-22T17:09:44.217999] [INFO ] [MAIN ] Update Progress: 85/2367 symbols completed. ALK took 31.4s. Estimated remaining: 4h 19m 20s. Rate: 8.8 symbols/min [2025-10-22T17:09:44.231216] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T17:09:44.445577] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:44.486897] [DEBUG] [LOCAL ] ALSN: Loaded 43269 existing records from primary storage. [2025-10-22T17:09:44.487224] [INFO ] [MAIN ] ALSN: Loaded 43269 existing records. [2025-10-22T17:09:44.661601] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:44.661828] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-22T17:09:44.661915] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-22T17:09:44.662106] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-22T17:09:44.662145] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-22T17:09:44.920106] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-22T17:09:45.019990] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:45.210041] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T17:09:45.717636] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-22T17:09:46.143964] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T17:09:46.233366] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:09:46.517677] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-22T17:09:47.317724] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-22T17:09:47.474570] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T17:09:48.110423] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T17:09:48.123218] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-22T17:09:48.917669] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-22T17:09:49.020205] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T17:09:49.717822] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-22T17:09:50.517681] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-22T17:09:50.800855] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T17:09:50.900227] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-22T17:09:51.041996] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T17:09:51.317675] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-22T17:09:52.117754] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-22T17:09:52.317221] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T17:09:52.771155] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:09:52.917723] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-22T17:09:53.503342] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:09:53.717740] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-22T17:09:54.325325] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T17:09:54.517744] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-22T17:09:55.317758] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-22T17:09:56.110341] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T17:09:56.121195] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-22T17:09:56.148113] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-22T17:09:56.917631] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-22T17:09:57.032420] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T17:09:57.439595] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T17:09:57.717666] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-22T17:09:58.517745] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-22T17:09:59.322224] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-22T17:09:59.325105] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-22T17:09:59.389338] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T17:09:59.653802] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:10:00.117677] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-22T17:10:00.927944] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-22T17:10:00.934743] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T17:10:01.717744] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-22T17:10:02.085826] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T17:10:02.370888] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T17:10:02.517782] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-22T17:10:03.317724] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-22T17:10:03.732832] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T17:10:04.117685] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-22T17:10:04.317472] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:10:04.914866] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T17:10:04.917996] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-22T17:10:05.717633] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-22T17:10:06.090892] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T17:10:06.517616] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-22T17:10:06.703265] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T17:10:07.084524] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T17:10:07.317711] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-22T17:10:08.117683] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-22T17:10:08.483189] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T17:10:08.491304] [INFO ] [REMOTE ] ALL: Full fetch complete (72459 records). [2025-10-22T17:10:08.491471] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-22T17:10:08.886282] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-22T17:10:08.886360] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-22T17:10:08.887054] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-22T17:10:08.887117] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-22T17:10:08.888453] [DEBUG] [LOCAL ] ALL: Trimmed 72459 records to 49604 (keeping 200 days of data) [2025-10-22T17:10:08.944006] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-22T17:10:09.207620] [DEBUG] [LOCAL ] ALL: Primary data saved (49604 records). [2025-10-22T17:10:09.207904] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-22T17:10:09.208925] [INFO ] [MAIN ] Update Progress: 86/2367 symbols completed. ALL took 39.1s. Estimated remaining: 4h 27m 16s. Rate: 8.5 symbols/min [2025-10-22T17:10:09.355720] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:10:09.421310] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:09.459138] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T17:10:09.475548] [DEBUG] [LOCAL ] ALTG: Loaded 23188 existing records from primary storage. [2025-10-22T17:10:09.475916] [INFO ] [MAIN ] ALTG: Loaded 23188 existing records. [2025-10-22T17:10:09.652924] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:09.653195] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-22T17:10:09.653262] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-22T17:10:09.653464] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-22T17:10:09.653508] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-22T17:10:09.727446] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-22T17:10:10.011710] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:10.517772] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-22T17:10:10.828209] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T17:10:10.835123] [INFO ] [REMOTE ] ALLE: Full fetch complete (64954 records). [2025-10-22T17:10:10.835261] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-22T17:10:11.229173] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-22T17:10:11.229380] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-22T17:10:11.230180] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-22T17:10:11.230264] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-22T17:10:11.231702] [DEBUG] [LOCAL ] ALLE: Trimmed 64954 records to 43945 (keeping 200 days of data) [2025-10-22T17:10:11.336193] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-22T17:10:11.527578] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:10:11.568114] [DEBUG] [LOCAL ] ALLE: Primary data saved (43945 records). [2025-10-22T17:10:11.568269] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-22T17:10:11.569330] [INFO ] [MAIN ] Update Progress: 87/2367 symbols completed. ALLE took 31.1s. Estimated remaining: 4h 25m 6s. Rate: 8.6 symbols/min [2025-10-22T17:10:11.741726] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:11.753826] [DEBUG] [LOCAL ] ALUR: Loaded 9307 existing records from primary storage. [2025-10-22T17:10:11.754063] [INFO ] [MAIN ] ALUR: Loaded 9307 existing records. [2025-10-22T17:10:11.934528] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:11.934756] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-22T17:10:11.934806] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-22T17:10:11.934976] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-22T17:10:11.935030] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-22T17:10:12.139481] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-22T17:10:12.300321] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:12.478508] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T17:10:12.645861] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-22T17:10:12.654567] [INFO ] [REMOTE ] ALLY: Full fetch complete (77250 records). [2025-10-22T17:10:12.654729] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-22T17:10:12.922963] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-22T17:10:13.040784] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-22T17:10:13.040863] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-22T17:10:13.041575] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-22T17:10:13.041618] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-22T17:10:13.043098] [DEBUG] [LOCAL ] ALLY: Trimmed 77250 records to 53222 (keeping 200 days of data) [2025-10-22T17:10:13.378438] [DEBUG] [LOCAL ] ALLY: Primary data saved (53222 records). [2025-10-22T17:10:13.378635] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-22T17:10:13.379895] [INFO ] [MAIN ] Update Progress: 88/2367 symbols completed. ALLY took 30.8s. Estimated remaining: 4h 22m 45s. Rate: 8.7 symbols/min [2025-10-22T17:10:13.555419] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:13.595586] [DEBUG] [LOCAL ] ALV: Loaded 42182 existing records from primary storage. [2025-10-22T17:10:13.595915] [INFO ] [MAIN ] ALV: Loaded 42182 existing records. [2025-10-22T17:10:13.722880] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-22T17:10:13.773773] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:13.774352] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-22T17:10:13.774404] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-22T17:10:13.774582] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-22T17:10:13.774636] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-22T17:10:14.088914] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T17:10:14.149703] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:14.173018] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T17:10:14.517639] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-22T17:10:15.317684] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-22T17:10:16.117683] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-22T17:10:16.261948] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T17:10:16.300916] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-22T17:10:16.917627] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-22T17:10:17.175019] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T17:10:17.182043] [INFO ] [REMOTE ] ALSN: Full fetch complete (62401 records). [2025-10-22T17:10:17.182174] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-22T17:10:17.182964] [FATAL] [VALIDATOR ] ALSN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:10:17.183075] [FATAL] [MAIN ] ALSN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:10:17.183152] [WARN ] [MAIN ] ALSN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:10:17.183227] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-22T17:10:17.183318] [DEBUG] [LOCAL ] ALSN: No primary data file found to delete. [2025-10-22T17:10:17.183492] [INFO ] [LOCAL ] ALSN: Starting deletion of derivative data. [2025-10-22T17:10:17.183779] [DEBUG] [LOCAL ] ALSN: Deleted derivative data file. [2025-10-22T17:10:17.184436] [INFO ] [MAIN ] Update Progress: 89/2367 symbols completed. ALSN took 33.0s. Estimated remaining: 4h 21m 19s. Rate: 8.7 symbols/min [2025-10-22T17:10:17.364018] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:17.382212] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T17:10:17.394085] [DEBUG] [LOCAL ] ALX: Loaded 7228 existing records from primary storage. [2025-10-22T17:10:17.394294] [INFO ] [MAIN ] ALX: Loaded 7228 existing records. [2025-10-22T17:10:17.575233] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:17.575563] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-22T17:10:17.575623] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-22T17:10:17.575833] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-22T17:10:17.575892] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-22T17:10:17.722822] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-22T17:10:17.936969] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:18.517756] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-22T17:10:19.058614] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-22T17:10:19.317669] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-22T17:10:19.467838] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T17:10:20.073337] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:10:20.117628] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-22T17:10:20.491349] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T17:10:20.917716] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-22T17:10:21.185824] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:10:21.717632] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-22T17:10:22.106635] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T17:10:22.517736] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-22T17:10:23.041705] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T17:10:23.317715] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-22T17:10:23.355827] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T17:10:23.867004] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T17:10:24.117754] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-22T17:10:24.917728] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-22T17:10:24.980842] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-22T17:10:25.717731] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-22T17:10:26.104268] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-22T17:10:26.517684] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-22T17:10:27.294514] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-22T17:10:27.317622] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-22T17:10:27.898997] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T17:10:28.117677] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-22T17:10:28.917726] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-22T17:10:28.969822] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T17:10:29.401685] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T17:10:29.717667] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-22T17:10:30.063985] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T17:10:30.517752] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-22T17:10:31.307608] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T17:10:31.317626] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-22T17:10:31.370899] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:10:31.834167] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-22T17:10:32.117679] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-22T17:10:32.863913] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T17:10:32.917684] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-22T17:10:33.717671] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-22T17:10:33.913470] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T17:10:34.517675] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-22T17:10:34.625175] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T17:10:35.317682] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-22T17:10:35.521909] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T17:10:36.117720] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-22T17:10:36.849425] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T17:10:36.917627] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-22T17:10:37.114272] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T17:10:37.672713] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T17:10:37.677281] [INFO ] [REMOTE ] ALTG: Full fetch complete (33429 records). [2025-10-22T17:10:37.677367] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-22T17:10:37.722753] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-22T17:10:38.071923] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-22T17:10:38.072008] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-22T17:10:38.072403] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-22T17:10:38.072491] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-22T17:10:38.073274] [DEBUG] [LOCAL ] ALTG: Trimmed 33429 records to 23079 (keeping 200 days of data) [2025-10-22T17:10:38.195470] [DEBUG] [LOCAL ] ALTG: Primary data saved (23079 records). [2025-10-22T17:10:38.195592] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-22T17:10:38.195690] [INFO ] [MAIN ] Update Progress: 90/2367 symbols completed. ALTG took 29.0s. Estimated remaining: 4h 27m 9s. Rate: 8.5 symbols/min [2025-10-22T17:10:38.362372] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:38.410318] [DEBUG] [LOCAL ] AM: Loaded 51857 existing records from primary storage. [2025-10-22T17:10:38.410712] [INFO ] [MAIN ] AM: Loaded 51857 existing records. [2025-10-22T17:10:38.518949] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-22T17:10:38.599482] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:38.599712] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-22T17:10:38.599767] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-22T17:10:38.600244] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-22T17:10:38.600281] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-22T17:10:38.768759] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T17:10:38.969953] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:39.317683] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-22T17:10:40.117673] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-22T17:10:40.180717] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T17:10:40.836449] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-22T17:10:40.917678] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-22T17:10:41.064458] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:10:41.717776] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-22T17:10:41.720758] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T17:10:41.723041] [INFO ] [REMOTE ] ALUR: Full fetch complete (18319 records). [2025-10-22T17:10:41.723213] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-22T17:10:42.096458] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-22T17:10:42.096536] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-22T17:10:42.096852] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-22T17:10:42.096914] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-22T17:10:42.097437] [DEBUG] [LOCAL ] ALUR: Trimmed 18319 records to 9277 (keeping 200 days of data) [2025-10-22T17:10:42.149152] [DEBUG] [LOCAL ] ALUR: Primary data saved (9277 records). [2025-10-22T17:10:42.149293] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-22T17:10:42.149372] [INFO ] [MAIN ] Update Progress: 91/2367 symbols completed. ALUR took 30.6s. Estimated remaining: 4h 25m 45s. Rate: 8.6 symbols/min [2025-10-22T17:10:42.333562] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:42.367631] [DEBUG] [LOCAL ] AMBC: Loaded 36048 existing records from primary storage. [2025-10-22T17:10:42.367983] [INFO ] [MAIN ] AMBC: Loaded 36048 existing records. [2025-10-22T17:10:42.520138] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-22T17:10:42.563178] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:42.563843] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-22T17:10:42.563915] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-22T17:10:42.570297] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-22T17:10:42.570257] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:10:42.570489] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-22T17:10:42.930240] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:43.317718] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-22T17:10:44.117634] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-22T17:10:44.302787] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T17:10:44.501427] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T17:10:44.917718] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-22T17:10:45.044978] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T17:10:45.717685] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-22T17:10:46.127470] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:10:46.517637] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-22T17:10:46.623301] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T17:10:46.625562] [INFO ] [REMOTE ] ALX: Full fetch complete (8108 records). [2025-10-22T17:10:46.625634] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-22T17:10:47.019904] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-22T17:10:47.019996] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-22T17:10:47.020193] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-22T17:10:47.020230] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-22T17:10:47.020620] [DEBUG] [LOCAL ] ALX: Trimmed 8108 records to 7271 (keeping 200 days of data) [2025-10-22T17:10:47.064225] [DEBUG] [LOCAL ] ALX: Primary data saved (7271 records). [2025-10-22T17:10:47.064343] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-22T17:10:47.064415] [INFO ] [MAIN ] Update Progress: 92/2367 symbols completed. ALX took 29.9s. Estimated remaining: 4h 24m 46s. Rate: 8.6 symbols/min [2025-10-22T17:10:47.232126] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:47.271048] [DEBUG] [LOCAL ] AMBP: Loaded 44418 existing records from primary storage. [2025-10-22T17:10:47.271364] [INFO ] [MAIN ] AMBP: Loaded 44418 existing records. [2025-10-22T17:10:47.324353] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-22T17:10:47.448742] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:47.448944] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-22T17:10:47.448993] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-22T17:10:47.449223] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-22T17:10:47.449270] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-22T17:10:47.842083] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:48.117058] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T17:10:48.125829] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-22T17:10:48.917750] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-22T17:10:49.119019] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:10:49.717763] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-22T17:10:49.933989] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:10:50.517671] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-22T17:10:50.635377] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T17:10:51.317635] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-22T17:10:51.354375] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T17:10:51.582506] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T17:10:52.117712] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-22T17:10:52.881577] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T17:10:52.917626] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-22T17:10:53.379398] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T17:10:53.386665] [INFO ] [REMOTE ] ALV: Full fetch complete (62424 records). [2025-10-22T17:10:53.386787] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-22T17:10:53.727077] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-22T17:10:53.782228] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-22T17:10:53.782312] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-22T17:10:53.782947] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-22T17:10:53.783009] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-22T17:10:53.784284] [DEBUG] [LOCAL ] ALV: Trimmed 62424 records to 42191 (keeping 200 days of data) [2025-10-22T17:10:54.039971] [DEBUG] [LOCAL ] ALV: Primary data saved (42191 records). [2025-10-22T17:10:54.040103] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-22T17:10:54.040773] [INFO ] [MAIN ] Update Progress: 93/2367 symbols completed. ALV took 40.7s. Estimated remaining: 4h 24m 39s. Rate: 8.6 symbols/min [2025-10-22T17:10:54.203133] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:54.203295] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-22T17:10:54.203331] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-22T17:10:54.203442] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-22T17:10:54.203482] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-22T17:10:54.203521] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-22T17:10:54.203551] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-22T17:10:54.523058] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-22T17:10:54.560295] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:54.705566] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T17:10:55.317627] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-22T17:10:55.436873] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:10:55.513231] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:10:55.513485] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-22T17:10:55.513571] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:10:55.513616] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-22T17:10:55.513740] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:10:55.513817] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-22T17:10:55.513879] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-22T17:10:55.513914] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-22T17:10:55.513952] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-22T17:10:55.513995] [INFO ] [MAIN ] Update Progress: 94/2367 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 22m 19s. Rate: 8.7 symbols/min [2025-10-22T17:10:55.684729] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:55.734694] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-22T17:10:55.734999] [INFO ] [MAIN ] AMC: Loaded 53766 existing records. [2025-10-22T17:10:55.915483] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:55.915775] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-22T17:10:55.915831] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-22T17:10:55.916086] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-22T17:10:55.916122] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-22T17:10:56.075382] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T17:10:56.126720] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-22T17:10:56.294390] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:56.917759] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-22T17:10:57.518576] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T17:10:57.717723] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-22T17:10:58.517757] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-22T17:10:58.585994] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:10:59.317743] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-22T17:10:59.359690] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T17:10:59.907882] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T17:11:00.117763] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-22T17:11:00.917630] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-22T17:11:01.477830] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T17:11:01.582621] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-22T17:11:01.717638] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-22T17:11:02.434711] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T17:11:02.517719] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-22T17:11:03.317682] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-22T17:11:03.672591] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T17:11:03.672058] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T17:11:04.117714] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-22T17:11:04.573675] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T17:11:04.917638] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-22T17:11:05.717638] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-22T17:11:05.920383] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T17:11:06.517719] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-22T17:11:07.276079] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-22T17:11:07.317750] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-22T17:11:08.099758] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-22T17:11:08.117620] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-22T17:11:08.156319] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T17:11:08.166779] [INFO ] [REMOTE ] AMBC: Full fetch complete (51881 records). [2025-10-22T17:11:08.167046] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-22T17:11:08.573973] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-22T17:11:08.574066] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-22T17:11:08.574774] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-22T17:11:08.574844] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-22T17:11:08.576283] [DEBUG] [LOCAL ] AMBC: Trimmed 51881 records to 35885 (keeping 200 days of data) [2025-10-22T17:11:08.778479] [DEBUG] [LOCAL ] AMBC: Primary data saved (35885 records). [2025-10-22T17:11:08.778739] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-22T17:11:08.778913] [INFO ] [MAIN ] Update Progress: 95/2367 symbols completed. AMBC took 26.6s. Estimated remaining: 4h 24m 44s. Rate: 8.6 symbols/min [2025-10-22T17:11:08.929894] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-22T17:11:08.965478] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:08.997974] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T17:11:09.054619] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-22T17:11:09.055012] [INFO ] [MAIN ] AMCR: Loaded 53670 existing records. [2025-10-22T17:11:09.268640] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:11:09.268897] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-22T17:11:09.268947] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-22T17:11:09.269131] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-22T17:11:09.269171] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-22T17:11:09.625010] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:09.651555] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T17:11:09.717683] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-22T17:11:10.517763] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-22T17:11:11.317632] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-22T17:11:11.387975] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-22T17:11:11.759719] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:11:12.117619] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-22T17:11:12.235102] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T17:11:12.917715] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-22T17:11:13.239461] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T17:11:13.717804] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-22T17:11:13.823378] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T17:11:13.830037] [INFO ] [REMOTE ] AMBP: Full fetch complete (64994 records). [2025-10-22T17:11:13.830182] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-22T17:11:14.211016] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-22T17:11:14.211134] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-22T17:11:14.211783] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-22T17:11:14.211845] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-22T17:11:14.213056] [DEBUG] [LOCAL ] AMBP: Trimmed 64994 records to 44318 (keeping 200 days of data) [2025-10-22T17:11:14.463051] [DEBUG] [LOCAL ] AMBP: Primary data saved (44318 records). [2025-10-22T17:11:14.463213] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-22T17:11:14.463869] [INFO ] [MAIN ] Update Progress: 96/2367 symbols completed. AMBP took 27.4s. Estimated remaining: 4h 24m 6s. Rate: 8.6 symbols/min [2025-10-22T17:11:14.526672] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-22T17:11:14.656479] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T17:11:14.673361] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:14.682318] [INFO ] [REMOTE ] AM: Full fetch complete (75675 records). [2025-10-22T17:11:14.682474] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-22T17:11:15.066290] [DEBUG] [LOCAL ] AME: Loaded 48489 existing records from primary storage. [2025-10-22T17:11:15.085124] [INFO ] [MAIN ] AME: Loaded 48489 existing records. [2025-10-22T17:11:15.103177] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-22T17:11:15.103254] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-22T17:11:15.146756] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-22T17:11:15.168910] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-22T17:11:15.219798] [DEBUG] [LOCAL ] AM: Trimmed 75675 records to 51849 (keeping 200 days of data) [2025-10-22T17:11:15.396567] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:11:15.406151] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-22T17:11:15.406251] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-22T17:11:15.409455] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-22T17:11:15.410057] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-22T17:11:15.901252] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:15.908790] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-22T17:11:15.982906] [DEBUG] [LOCAL ] AM: Primary data saved (51849 records). [2025-10-22T17:11:15.983182] [INFO ] [MAIN ] AM: Full history saved. [2025-10-22T17:11:15.984015] [INFO ] [MAIN ] Update Progress: 97/2367 symbols completed. AM took 37.8s. Estimated remaining: 4h 21m 51s. Rate: 8.7 symbols/min [2025-10-22T17:11:16.118370] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T17:11:16.140463] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-22T17:11:16.203451] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:16.236133] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-22T17:11:16.267447] [DEBUG] [LOCAL ] AMG: Loaded 20131 existing records from primary storage. [2025-10-22T17:11:16.267820] [INFO ] [MAIN ] AMG: Loaded 20131 existing records. [2025-10-22T17:11:16.474310] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:11:16.474520] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-22T17:11:16.474566] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-22T17:11:16.474807] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-22T17:11:16.474863] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-22T17:11:16.816526] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:16.917671] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-22T17:11:17.653875] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:11:17.717638] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-22T17:11:17.895957] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T17:11:18.156009] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T17:11:18.517782] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-22T17:11:19.317871] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-22T17:11:19.600848] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T17:11:19.992501] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-22T17:11:20.117731] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-22T17:11:20.803816] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T17:11:20.917679] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-22T17:11:21.587744] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T17:11:21.717711] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-22T17:11:22.517760] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-22T17:11:22.755171] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T17:11:23.317724] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-22T17:11:23.546184] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T17:11:24.117678] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-22T17:11:24.845134] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-22T17:11:24.917619] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-22T17:11:25.087724] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:11:25.150088] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T17:11:25.717726] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-22T17:11:26.517721] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-22T17:11:26.839317] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T17:11:27.148376] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-22T17:11:27.317670] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-22T17:11:28.117668] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-22T17:11:28.397876] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T17:11:28.917760] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-22T17:11:29.278311] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T17:11:29.707268] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-22T17:11:29.717716] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-22T17:11:30.517634] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-22T17:11:30.558535] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T17:11:31.317669] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-22T17:11:31.350296] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T17:11:31.567009] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T17:11:32.117763] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-22T17:11:32.917678] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-22T17:11:33.084485] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T17:11:33.717769] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-22T17:11:33.862422] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-22T17:11:33.874573] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-22T17:11:33.874787] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-22T17:11:34.287280] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-22T17:11:34.287376] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-22T17:11:34.288165] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-22T17:11:34.288232] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-22T17:11:34.289835] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53766 (keeping 200 days of data) [2025-10-22T17:11:34.520903] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-22T17:11:34.603579] [DEBUG] [LOCAL ] AMC: Primary data saved (53766 records). [2025-10-22T17:11:34.603874] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-22T17:11:34.604919] [INFO ] [MAIN ] Update Progress: 98/2367 symbols completed. AMC took 39.1s. Estimated remaining: 4h 26m 15s. Rate: 8.5 symbols/min [2025-10-22T17:11:34.785286] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:34.785674] [DEBUG] [LOCAL ] AMH: No existing data file found in primary storage. [2025-10-22T17:11:34.785761] [WARN ] [MAIN ] AMH: No existing data found, performing full refresh instead. [2025-10-22T17:11:34.786068] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-22T17:11:34.786131] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-22T17:11:34.801054] [DEBUG] [LOCAL ] AMH: No primary data file found to delete. [2025-10-22T17:11:34.808082] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-22T17:11:34.892387] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T17:11:35.185914] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:35.317680] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-22T17:11:35.635530] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T17:11:35.995083] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T17:11:36.117753] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-22T17:11:36.663776] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T17:11:36.917753] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-22T17:11:37.717639] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-22T17:11:37.922720] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:11:38.517708] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-22T17:11:39.028764] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T17:11:39.266608] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-22T17:11:39.276083] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-22T17:11:39.276230] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-22T17:11:39.323224] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-22T17:11:39.665343] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-22T17:11:39.665478] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-22T17:11:39.666243] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-22T17:11:39.666308] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-22T17:11:39.667825] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 53670 (keeping 200 days of data) [2025-10-22T17:11:39.980732] [DEBUG] [LOCAL ] AMCR: Primary data saved (53670 records). [2025-10-22T17:11:39.980891] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-22T17:11:39.981547] [INFO ] [MAIN ] Update Progress: 99/2367 symbols completed. AMCR took 31.2s. Estimated remaining: 4h 25m 30s. Rate: 8.5 symbols/min [2025-10-22T17:11:40.121684] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-22T17:11:40.194263] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:40.194523] [DEBUG] [LOCAL ] AMN: No existing data file found in primary storage. [2025-10-22T17:11:40.194702] [WARN ] [MAIN ] AMN: No existing data found, performing full refresh instead. [2025-10-22T17:11:40.194837] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-22T17:11:40.194905] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-22T17:11:40.218858] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-22T17:11:40.219045] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-22T17:11:40.238197] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T17:11:40.611496] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:40.917803] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-22T17:11:41.287005] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T17:11:41.438077] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T17:11:41.443536] [INFO ] [REMOTE ] AMG: Full fetch complete (29587 records). [2025-10-22T17:11:41.443761] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-22T17:11:41.727145] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-22T17:11:41.972303] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-22T17:11:41.972392] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-22T17:11:41.972809] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-22T17:11:41.972872] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-22T17:11:41.973683] [DEBUG] [LOCAL ] AMG: Trimmed 29587 records to 20036 (keeping 200 days of data) [2025-10-22T17:11:42.095821] [DEBUG] [LOCAL ] AMG: Primary data saved (20036 records). [2025-10-22T17:11:42.095923] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-22T17:11:42.095996] [INFO ] [MAIN ] Update Progress: 100/2367 symbols completed. AMG took 26.1s. Estimated remaining: 4h 23m 32s. Rate: 8.6 symbols/min [2025-10-22T17:11:42.261597] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:42.292604] [DEBUG] [LOCAL ] AMP: Loaded 31914 existing records from primary storage. [2025-10-22T17:11:42.292911] [INFO ] [MAIN ] AMP: Loaded 31914 existing records. [2025-10-22T17:11:42.469727] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:11:42.470037] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-22T17:11:42.470185] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-22T17:11:42.470469] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-22T17:11:42.470525] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-22T17:11:42.523769] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-22T17:11:42.825045] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T17:11:42.854922] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:43.317622] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-22T17:11:43.534839] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:11:44.117769] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-22T17:11:44.285226] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T17:11:44.789771] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T17:11:44.917668] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-22T17:11:45.713500] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:11:45.720671] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-22T17:11:46.517737] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-22T17:11:46.620933] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T17:11:47.317768] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-22T17:11:47.428004] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T17:11:48.090323] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T17:11:48.117620] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-22T17:11:48.917625] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-22T17:11:49.272408] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T17:11:49.281127] [INFO ] [REMOTE ] AME: Full fetch complete (70045 records). [2025-10-22T17:11:49.281314] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-22T17:11:49.702326] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-22T17:11:49.702508] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-22T17:11:49.703271] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-22T17:11:49.703350] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-22T17:11:49.704896] [DEBUG] [LOCAL ] AME: Trimmed 70045 records to 48418 (keeping 200 days of data) [2025-10-22T17:11:49.774962] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-22T17:11:49.831954] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T17:11:50.066247] [DEBUG] [LOCAL ] AME: Primary data saved (48418 records). [2025-10-22T17:11:50.066378] [INFO ] [MAIN ] AME: Full history saved. [2025-10-22T17:11:50.066855] [INFO ] [MAIN ] Update Progress: 101/2367 symbols completed. AME took 35.6s. Estimated remaining: 4h 23m 47s. Rate: 8.6 symbols/min [2025-10-22T17:11:50.256009] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:50.282473] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T17:11:50.336284] [DEBUG] [LOCAL ] AMPX: Loaded 52398 existing records from primary storage. [2025-10-22T17:11:50.336713] [INFO ] [MAIN ] AMPX: Loaded 52398 existing records. [2025-10-22T17:11:50.518056] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-22T17:11:50.532037] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:11:50.532302] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-22T17:11:50.532521] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-22T17:11:50.533575] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-22T17:11:50.533635] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-22T17:11:50.902695] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:51.317746] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-22T17:11:51.344477] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:11:52.117628] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-22T17:11:52.156187] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T17:11:52.917631] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-22T17:11:53.057462] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:11:53.619267] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T17:11:53.717625] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-22T17:11:54.517636] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-22T17:11:54.627607] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T17:11:55.317672] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-22T17:11:55.343869] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T17:11:56.117679] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-22T17:11:56.329336] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T17:11:56.917671] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-22T17:11:56.958406] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T17:11:57.717738] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-22T17:11:57.888886] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T17:11:58.517756] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-22T17:11:58.637047] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T17:11:59.202637] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T17:11:59.317631] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-22T17:11:59.871987] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T17:12:00.117707] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-22T17:12:00.917630] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-22T17:12:01.115770] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:12:01.717671] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-22T17:12:02.182805] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T17:12:02.446323] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T17:12:02.517675] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-22T17:12:03.161229] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T17:12:03.317703] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-22T17:12:04.013892] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T17:12:04.117613] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-22T17:12:04.917831] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-22T17:12:05.355257] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T17:12:05.517876] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T17:12:05.717681] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-22T17:12:06.517763] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-22T17:12:06.630629] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T17:12:07.317702] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-22T17:12:07.680979] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T17:12:07.687954] [INFO ] [REMOTE ] AMN: Full fetch complete (60224 records). [2025-10-22T17:12:07.688112] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-22T17:12:08.077980] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-22T17:12:08.078124] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-22T17:12:08.078802] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-22T17:12:08.078881] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-22T17:12:08.105844] [DEBUG] [LOCAL ] AMN: Trimmed 60224 records to 41641 (keeping 200 days of data) [2025-10-22T17:12:08.107996] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T17:12:08.118288] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-22T17:12:08.356785] [DEBUG] [LOCAL ] AMN: Primary data saved (41641 records). [2025-10-22T17:12:08.356951] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-22T17:12:08.357035] [INFO ] [MAIN ] Update Progress: 102/2367 symbols completed. AMN took 28.4s. Estimated remaining: 4h 27m 51s. Rate: 8.5 symbols/min [2025-10-22T17:12:08.521700] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:08.555155] [DEBUG] [LOCAL ] AMPY: Loaded 39389 existing records from primary storage. [2025-10-22T17:12:08.555425] [INFO ] [MAIN ] AMPY: Loaded 39389 existing records. [2025-10-22T17:12:08.726991] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:08.727197] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-22T17:12:08.727258] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-22T17:12:08.727606] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-22T17:12:08.727730] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-22T17:12:08.936223] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-22T17:12:09.090144] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:09.118211] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T17:12:09.647869] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T17:12:09.656596] [INFO ] [REMOTE ] AMH: Full fetch complete (75112 records). [2025-10-22T17:12:09.656790] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-22T17:12:09.722892] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-22T17:12:10.039906] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-22T17:12:10.040001] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-22T17:12:10.040729] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-22T17:12:10.040791] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-22T17:12:10.042284] [DEBUG] [LOCAL ] AMH: Trimmed 75112 records to 51830 (keeping 200 days of data) [2025-10-22T17:12:10.346585] [DEBUG] [LOCAL ] AMH: Primary data saved (51830 records). [2025-10-22T17:12:10.346736] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-22T17:12:10.346812] [INFO ] [MAIN ] Update Progress: 103/2367 symbols completed. AMH took 35.7s. Estimated remaining: 4h 25m 52s. Rate: 8.5 symbols/min [2025-10-22T17:12:10.513294] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:10.517666] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-22T17:12:10.543283] [DEBUG] [LOCAL ] AMR: Loaded 28870 existing records from primary storage. [2025-10-22T17:12:10.543604] [INFO ] [MAIN ] AMR: Loaded 28870 existing records. [2025-10-22T17:12:10.751775] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:10.760072] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-22T17:12:10.761043] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T17:12:10.760567] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-22T17:12:10.762851] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-22T17:12:10.766259] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-22T17:12:10.797142] [INFO ] [REMOTE ] AMP: Full fetch complete (47622 records). [2025-10-22T17:12:10.835133] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-22T17:12:11.497108] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:11.503509] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-22T17:12:11.522629] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:12:11.610289] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-22T17:12:11.610417] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-22T17:12:11.611095] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-22T17:12:11.611161] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-22T17:12:11.612563] [DEBUG] [LOCAL ] AMP: Trimmed 47622 records to 31807 (keeping 200 days of data) [2025-10-22T17:12:11.828910] [DEBUG] [LOCAL ] AMP: Primary data saved (31807 records). [2025-10-22T17:12:11.829057] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-22T17:12:11.829158] [INFO ] [MAIN ] Update Progress: 104/2367 symbols completed. AMP took 29.7s. Estimated remaining: 4h 23m 44s. Rate: 8.6 symbols/min [2025-10-22T17:12:11.995775] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:12.032155] [DEBUG] [LOCAL ] AMRC: Loaded 38589 existing records from primary storage. [2025-10-22T17:12:12.032448] [INFO ] [MAIN ] AMRC: Loaded 38589 existing records. [2025-10-22T17:12:12.121151] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-22T17:12:12.210797] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:12.211148] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-22T17:12:12.211207] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-22T17:12:12.211573] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-22T17:12:12.211618] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-22T17:12:12.567174] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:12.596233] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-22T17:12:12.764833] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:12:12.917715] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-22T17:12:13.252529] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T17:12:13.717728] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-22T17:12:13.993391] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T17:12:14.517752] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-22T17:12:15.104840] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T17:12:15.317736] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-22T17:12:16.117765] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-22T17:12:16.661594] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T17:12:16.838355] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-22T17:12:16.917633] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-22T17:12:17.454416] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:12:17.717714] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-22T17:12:18.517756] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-22T17:12:18.829837] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T17:12:18.946263] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-22T17:12:19.317771] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-22T17:12:20.024283] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T17:12:20.117714] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-22T17:12:20.466724] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T17:12:20.917716] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-22T17:12:21.717707] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-22T17:12:21.817761] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T17:12:22.268723] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T17:12:22.517728] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-22T17:12:23.317702] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-22T17:12:23.894553] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T17:12:23.932834] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T17:12:24.117752] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-22T17:12:24.833487] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:12:24.917791] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-22T17:12:25.717757] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-22T17:12:26.302017] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T17:12:26.389334] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-22T17:12:26.397804] [INFO ] [REMOTE ] AMPX: Full fetch complete (74856 records). [2025-10-22T17:12:26.397960] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-22T17:12:26.398800] [FATAL] [VALIDATOR ] AMPX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:12:26.398894] [FATAL] [MAIN ] AMPX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:12:26.398937] [WARN ] [MAIN ] AMPX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:12:26.399023] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-22T17:12:26.399106] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-22T17:12:26.399145] [INFO ] [LOCAL ] AMPX: Starting deletion of derivative data. [2025-10-22T17:12:26.399391] [DEBUG] [LOCAL ] AMPX: Deleted derivative data file. [2025-10-22T17:12:26.400120] [INFO ] [MAIN ] Update Progress: 105/2367 symbols completed. AMPX took 36.3s. Estimated remaining: 4h 26m 20s. Rate: 8.5 symbols/min [2025-10-22T17:12:26.522853] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-22T17:12:26.573273] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:26.573441] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-22T17:12:26.573478] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-22T17:12:26.573589] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-22T17:12:26.573628] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-22T17:12:26.573710] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-22T17:12:26.573751] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-22T17:12:26.919466] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:27.221414] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:12:27.317675] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-22T17:12:27.543750] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:12:27.544038] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-22T17:12:27.544135] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:12:27.544180] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-22T17:12:27.544213] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:12:27.544249] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-22T17:12:27.544323] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-22T17:12:27.544359] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-22T17:12:27.544397] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-22T17:12:27.544441] [INFO ] [MAIN ] Update Progress: 106/2367 symbols completed. AMRZ took 1.1s. Estimated remaining: 4h 24m 7s. Rate: 8.6 symbols/min [2025-10-22T17:12:27.720194] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:27.774091] [DEBUG] [LOCAL ] AMT: Loaded 52448 existing records from primary storage. [2025-10-22T17:12:27.774393] [INFO ] [MAIN ] AMT: Loaded 52448 existing records. [2025-10-22T17:12:27.957995] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:27.958295] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-22T17:12:27.958385] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-22T17:12:27.958973] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-22T17:12:27.959033] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-22T17:12:28.123667] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-22T17:12:28.211790] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T17:12:28.355370] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:28.919338] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-22T17:12:29.717634] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-22T17:12:29.798313] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T17:12:30.523938] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-22T17:12:30.542604] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:12:31.068220] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T17:12:31.317734] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-22T17:12:32.075631] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T17:12:32.117664] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-22T17:12:32.633783] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T17:12:32.917782] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-22T17:12:33.428852] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:12:33.717753] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-22T17:12:34.410122] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T17:12:34.517707] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-22T17:12:35.160111] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T17:12:35.317755] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-22T17:12:35.887410] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T17:12:36.117733] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-22T17:12:36.636146] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T17:12:36.643281] [INFO ] [REMOTE ] AMRC: Full fetch complete (54595 records). [2025-10-22T17:12:36.643381] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-22T17:12:36.922835] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-22T17:12:37.042574] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-22T17:12:37.042673] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-22T17:12:37.043252] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-22T17:12:37.043295] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-22T17:12:37.044382] [DEBUG] [LOCAL ] AMRC: Trimmed 54595 records to 38551 (keeping 200 days of data) [2025-10-22T17:12:37.259622] [DEBUG] [LOCAL ] AMRC: Primary data saved (38551 records). [2025-10-22T17:12:37.259792] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-22T17:12:37.259874] [INFO ] [MAIN ] Update Progress: 107/2367 symbols completed. AMRC took 25.4s. Estimated remaining: 4h 24m 57s. Rate: 8.5 symbols/min [2025-10-22T17:12:37.444099] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:37.470563] [DEBUG] [LOCAL ] AMTB: Loaded 20430 existing records from primary storage. [2025-10-22T17:12:37.470920] [INFO ] [MAIN ] AMTB: Loaded 20430 existing records. [2025-10-22T17:12:37.676553] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:37.676830] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-22T17:12:37.676996] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-22T17:12:37.677184] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-22T17:12:37.677225] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-22T17:12:37.730393] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-22T17:12:38.048564] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:38.075929] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-22T17:12:38.239992] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T17:12:38.517755] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-22T17:12:39.044474] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T17:12:39.317636] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-22T17:12:39.723587] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T17:12:40.117717] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-22T17:12:40.917668] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-22T17:12:41.172493] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T17:12:41.182151] [INFO ] [REMOTE ] AMPY: Full fetch complete (53351 records). [2025-10-22T17:12:41.182312] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-22T17:12:41.614677] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-22T17:12:41.614770] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-22T17:12:41.615313] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-22T17:12:41.615354] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-22T17:12:41.616466] [DEBUG] [LOCAL ] AMPY: Trimmed 53351 records to 39376 (keeping 200 days of data) [2025-10-22T17:12:41.727867] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-22T17:12:41.854878] [DEBUG] [LOCAL ] AMPY: Primary data saved (39376 records). [2025-10-22T17:12:41.855013] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-22T17:12:41.855142] [INFO ] [MAIN ] Update Progress: 108/2367 symbols completed. AMPY took 33.5s. Estimated remaining: 4h 23m 59s. Rate: 8.6 symbols/min [2025-10-22T17:12:42.025973] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:42.031415] [DEBUG] [LOCAL ] AMTD: Loaded 3827 existing records from primary storage. [2025-10-22T17:12:42.031595] [INFO ] [MAIN ] AMTD: Loaded 3827 existing records. [2025-10-22T17:12:42.212682] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:42.213254] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-22T17:12:42.213471] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-22T17:12:42.213752] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-22T17:12:42.213954] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-22T17:12:42.370047] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-22T17:12:42.459682] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:12:42.521692] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-22T17:12:42.548165] [INFO ] [REMOTE ] AMR: Full fetch complete (40717 records). [2025-10-22T17:12:42.573510] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-22T17:12:42.767420] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:42.879718] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T17:12:43.080943] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-22T17:12:43.081027] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-22T17:12:43.081483] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-22T17:12:43.081522] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-22T17:12:43.082488] [DEBUG] [LOCAL ] AMR: Trimmed 40717 records to 28786 (keeping 200 days of data) [2025-10-22T17:12:43.253236] [DEBUG] [LOCAL ] AMR: Primary data saved (28786 records). [2025-10-22T17:12:43.253389] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-22T17:12:43.254148] [INFO ] [MAIN ] Update Progress: 109/2367 symbols completed. AMR took 32.9s. Estimated remaining: 4h 21m 55s. Rate: 8.6 symbols/min [2025-10-22T17:12:43.327784] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-22T17:12:43.423747] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:43.471541] [DEBUG] [LOCAL ] AMTM: Loaded 50302 existing records from primary storage. [2025-10-22T17:12:43.471890] [INFO ] [MAIN ] AMTM: Loaded 50302 existing records. [2025-10-22T17:12:43.644223] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:43.644428] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-22T17:12:43.644475] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-22T17:12:43.644689] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-22T17:12:43.644749] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-22T17:12:43.925689] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T17:12:44.001401] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:44.117625] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-22T17:12:44.528726] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T17:12:44.917679] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-22T17:12:45.412703] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T17:12:45.717624] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-22T17:12:45.834827] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T17:12:46.326280] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T17:12:46.517765] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-22T17:12:47.317705] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-22T17:12:48.117709] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-22T17:12:48.307597] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T17:12:48.358016] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T17:12:48.917675] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-22T17:12:49.717725] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-22T17:12:49.907719] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T17:12:50.163368] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T17:12:50.517742] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-22T17:12:51.317718] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-22T17:12:51.486866] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:12:51.952201] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T17:12:52.117699] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-22T17:12:52.511238] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T17:12:52.917631] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-22T17:12:53.530260] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T17:12:53.567601] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:12:53.717730] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-22T17:12:54.517632] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-22T17:12:54.681473] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T17:12:55.317721] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-22T17:12:56.117748] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-22T17:12:56.451402] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T17:12:56.496812] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T17:12:56.500450] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-22T17:12:56.917704] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-22T17:12:57.565540] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T17:12:57.717637] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-22T17:12:58.048584] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-22T17:12:58.517671] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-22T17:12:59.176138] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T17:12:59.317677] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-22T17:13:00.117753] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-22T17:13:00.418032] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T17:13:00.823623] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T17:13:00.917741] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-22T17:13:01.717742] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-22T17:13:01.873869] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T17:13:01.875273] [INFO ] [REMOTE ] AMTD: Full fetch complete (5422 records). [2025-10-22T17:13:01.875350] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-22T17:13:02.262290] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-22T17:13:02.262414] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-22T17:13:02.262581] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-22T17:13:02.262621] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-22T17:13:02.263014] [DEBUG] [LOCAL ] AMTD: Trimmed 5422 records to 3812 (keeping 200 days of data) [2025-10-22T17:13:02.284379] [DEBUG] [LOCAL ] AMTD: Primary data saved (3812 records). [2025-10-22T17:13:02.284467] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-22T17:13:02.284541] [INFO ] [MAIN ] Update Progress: 110/2367 symbols completed. AMTD took 20.4s. Estimated remaining: 4h 25m 56s. Rate: 8.5 symbols/min [2025-10-22T17:13:02.450872] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:02.460670] [DEBUG] [LOCAL ] AMWL: Loaded 9764 existing records from primary storage. [2025-10-22T17:13:02.460904] [INFO ] [MAIN ] AMWL: Loaded 9764 existing records. [2025-10-22T17:13:02.522780] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-22T17:13:02.634285] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:02.634492] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-22T17:13:02.634540] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-22T17:13:02.634712] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-22T17:13:02.634768] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-22T17:13:02.978739] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:03.317738] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-22T17:13:03.649535] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T17:13:04.117718] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-22T17:13:04.308530] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-22T17:13:04.483885] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T17:13:04.917751] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-22T17:13:05.109565] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T17:13:05.717675] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-22T17:13:06.517697] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-22T17:13:06.660459] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:13:06.664103] [INFO ] [REMOTE ] AMTB: Full fetch complete (29602 records). [2025-10-22T17:13:06.664238] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-22T17:13:07.072868] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-22T17:13:07.073081] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-22T17:13:07.074008] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-22T17:13:07.074107] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-22T17:13:07.101401] [DEBUG] [LOCAL ] AMTB: Trimmed 29602 records to 20336 (keeping 200 days of data) [2025-10-22T17:13:07.108326] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T17:13:07.240516] [DEBUG] [LOCAL ] AMTB: Primary data saved (20336 records). [2025-10-22T17:13:07.240666] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-22T17:13:07.240763] [INFO ] [MAIN ] Update Progress: 111/2367 symbols completed. AMTB took 30.0s. Estimated remaining: 4h 25m 6s. Rate: 8.5 symbols/min [2025-10-22T17:13:07.319226] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-22T17:13:07.350498] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T17:13:07.422689] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:07.468463] [DEBUG] [LOCAL ] AMX: Loaded 49203 existing records from primary storage. [2025-10-22T17:13:07.468820] [INFO ] [MAIN ] AMX: Loaded 49203 existing records. [2025-10-22T17:13:07.641215] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:07.641478] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-22T17:13:07.641535] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-22T17:13:07.641770] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-22T17:13:07.641826] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-22T17:13:07.983131] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:08.117634] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-22T17:13:08.917741] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-22T17:13:09.717666] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-22T17:13:09.761423] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-22T17:13:09.770123] [INFO ] [REMOTE ] AMT: Full fetch complete (76166 records). [2025-10-22T17:13:09.770249] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-22T17:13:10.066207] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T17:13:10.202315] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-22T17:13:10.202443] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-22T17:13:10.203226] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-22T17:13:10.203288] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-22T17:13:10.204732] [DEBUG] [LOCAL ] AMT: Trimmed 76166 records to 52430 (keeping 200 days of data) [2025-10-22T17:13:10.522584] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-22T17:13:10.525068] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T17:13:10.551237] [DEBUG] [LOCAL ] AMT: Primary data saved (52430 records). [2025-10-22T17:13:10.551358] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-22T17:13:10.551917] [INFO ] [MAIN ] Update Progress: 112/2367 symbols completed. AMT took 43.0s. Estimated remaining: 4h 23m 44s. Rate: 8.6 symbols/min [2025-10-22T17:13:10.719699] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:10.751606] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T17:13:10.784948] [DEBUG] [LOCAL ] AN: Loaded 31126 existing records from primary storage. [2025-10-22T17:13:10.785280] [INFO ] [MAIN ] AN: Loaded 31126 existing records. [2025-10-22T17:13:10.957977] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:10.958181] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-22T17:13:10.958228] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-22T17:13:10.958579] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-22T17:13:10.958635] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-22T17:13:11.309192] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:11.317676] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-22T17:13:12.117678] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-22T17:13:12.501679] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-22T17:13:12.917735] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-22T17:13:13.167167] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T17:13:13.722769] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-22T17:13:13.734848] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:13:14.517757] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-22T17:13:14.644288] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T17:13:14.809997] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T17:13:15.317732] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-22T17:13:15.861366] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T17:13:16.117729] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-22T17:13:16.813774] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T17:13:16.917668] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-22T17:13:17.259619] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T17:13:17.717674] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-22T17:13:18.517750] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-22T17:13:18.644266] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T17:13:19.197356] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T17:13:19.317710] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-22T17:13:20.117730] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-22T17:13:20.192392] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T17:13:20.761819] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T17:13:20.833536] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:13:20.917629] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-22T17:13:21.680543] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T17:13:21.717675] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-22T17:13:22.517725] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-22T17:13:23.317672] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-22T17:13:23.437132] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T17:13:24.088559] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T17:13:24.117677] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-22T17:13:24.729381] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T17:13:24.737531] [INFO ] [REMOTE ] AMTM: Full fetch complete (73626 records). [2025-10-22T17:13:24.737709] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-22T17:13:24.919092] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-22T17:13:25.163290] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-22T17:13:25.163396] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-22T17:13:25.164395] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-22T17:13:25.164474] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-22T17:13:25.166574] [DEBUG] [LOCAL ] AMTM: Trimmed 73626 records to 50253 (keeping 200 days of data) [2025-10-22T17:13:25.553591] [DEBUG] [LOCAL ] AMTM: Primary data saved (50253 records). [2025-10-22T17:13:25.553873] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-22T17:13:25.554825] [INFO ] [MAIN ] Update Progress: 113/2367 symbols completed. AMTM took 42.3s. Estimated remaining: 4h 26m 16s. Rate: 8.5 symbols/min [2025-10-22T17:13:25.718362] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-22T17:13:25.826815] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:25.839482] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T17:13:25.886630] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:13:25.948079] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-22T17:13:25.948429] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-22T17:13:26.135669] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:26.135946] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-22T17:13:26.136009] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-22T17:13:26.136403] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-22T17:13:26.136461] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-22T17:13:26.484417] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:26.517618] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-22T17:13:26.973344] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:13:27.317714] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-22T17:13:28.117769] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-22T17:13:28.805934] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-22T17:13:28.887453] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T17:13:28.917633] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-22T17:13:28.929249] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T17:13:29.717767] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-22T17:13:30.517749] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-22T17:13:30.698982] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T17:13:30.702286] [INFO ] [REMOTE ] AMWL: Full fetch complete (14810 records). [2025-10-22T17:13:30.702371] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-22T17:13:31.061003] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-22T17:13:31.061201] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-22T17:13:31.061545] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-22T17:13:31.061627] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-22T17:13:31.062490] [DEBUG] [LOCAL ] AMWL: Trimmed 14810 records to 9814 (keeping 200 days of data) [2025-10-22T17:13:31.115027] [DEBUG] [LOCAL ] AMWL: Primary data saved (9814 records). [2025-10-22T17:13:31.115149] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-22T17:13:31.115230] [INFO ] [MAIN ] Update Progress: 114/2367 symbols completed. AMWL took 28.8s. Estimated remaining: 4h 25m 39s. Rate: 8.5 symbols/min [2025-10-22T17:13:31.286832] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:31.317758] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-22T17:13:31.337031] [DEBUG] [LOCAL ] ANF: Loaded 52051 existing records from primary storage. [2025-10-22T17:13:31.337443] [INFO ] [MAIN ] ANF: Loaded 52051 existing records. [2025-10-22T17:13:31.549129] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-22T17:13:31.553054] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:31.563573] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-22T17:13:31.564300] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-22T17:13:31.564748] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-22T17:13:31.564805] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-22T17:13:31.927838] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:31.949312] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:13:32.117715] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-22T17:13:32.917627] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-22T17:13:33.024182] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T17:13:33.717631] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-22T17:13:34.331524] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T17:13:34.420165] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-22T17:13:34.517771] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-22T17:13:35.317760] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-22T17:13:35.718474] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T17:13:35.751956] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T17:13:36.117781] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-22T17:13:36.917721] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-22T17:13:37.718151] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-22T17:13:37.720890] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-22T17:13:37.907618] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T17:13:38.220183] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T17:13:38.225256] [INFO ] [REMOTE ] AN: Full fetch complete (47089 records). [2025-10-22T17:13:38.225351] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-22T17:13:38.522874] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-22T17:13:38.599214] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-22T17:13:38.599292] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-22T17:13:38.599924] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-22T17:13:38.599997] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-22T17:13:38.601003] [DEBUG] [LOCAL ] AN: Trimmed 47089 records to 31030 (keeping 200 days of data) [2025-10-22T17:13:38.782581] [DEBUG] [LOCAL ] AN: Primary data saved (31030 records). [2025-10-22T17:13:38.782740] [INFO ] [MAIN ] AN: Full history saved. [2025-10-22T17:13:38.782826] [INFO ] [MAIN ] Update Progress: 115/2367 symbols completed. AN took 28.2s. Estimated remaining: 4h 25m 43s. Rate: 8.5 symbols/min [2025-10-22T17:13:38.951232] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:38.951432] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-22T17:13:38.951500] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-22T17:13:38.951614] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-22T17:13:38.951683] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-22T17:13:38.951742] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-22T17:13:38.951796] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-22T17:13:39.322783] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-22T17:13:39.336634] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:39.546897] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T17:13:40.117676] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-22T17:13:40.313899] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:13:40.314204] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-22T17:13:40.314307] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:13:40.314356] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-22T17:13:40.314418] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:13:40.314489] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-22T17:13:40.314551] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-22T17:13:40.314586] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-22T17:13:40.314624] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-22T17:13:40.314731] [INFO ] [MAIN ] Update Progress: 116/2367 symbols completed. ANGX took 1.5s. Estimated remaining: 4h 23m 49s. Rate: 8.5 symbols/min [2025-10-22T17:13:40.494926] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:40.514116] [DEBUG] [LOCAL ] ANRO: Loaded 19651 existing records from primary storage. [2025-10-22T17:13:40.514361] [INFO ] [MAIN ] ANRO: Loaded 19651 existing records. [2025-10-22T17:13:40.704215] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:40.704529] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-22T17:13:40.704587] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-22T17:13:40.704791] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-22T17:13:40.704852] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-22T17:13:40.922843] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-22T17:13:41.106577] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:41.131081] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:13:41.158071] [INFO ] [REMOTE ] AMX: Full fetch complete (71033 records). [2025-10-22T17:13:41.174171] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-22T17:13:41.246258] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-22T17:13:41.575955] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-22T17:13:41.576034] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-22T17:13:41.576742] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-22T17:13:41.576804] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-22T17:13:41.578192] [DEBUG] [LOCAL ] AMX: Trimmed 71033 records to 49176 (keeping 200 days of data) [2025-10-22T17:13:41.745359] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-22T17:13:41.869301] [DEBUG] [LOCAL ] AMX: Primary data saved (49176 records). [2025-10-22T17:13:41.869456] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-22T17:13:41.869564] [INFO ] [MAIN ] Update Progress: 117/2367 symbols completed. AMX took 34.6s. Estimated remaining: 4h 21m 56s. Rate: 8.6 symbols/min [2025-10-22T17:13:42.517727] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-22T17:13:42.765754] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T17:13:43.317772] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-22T17:13:43.580560] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T17:13:43.759420] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T17:13:44.117664] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-22T17:13:44.895332] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T17:13:44.917618] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-22T17:13:45.717672] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-22T17:13:46.518315] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-22T17:13:46.530244] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-22T17:13:46.618944] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:13:46.887066] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T17:13:47.317775] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-22T17:13:48.117720] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-22T17:13:48.714586] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T17:13:48.917667] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-22T17:13:49.161055] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T17:13:49.376176] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T17:13:49.717719] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-22T17:13:50.517716] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-22T17:13:50.900503] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T17:13:51.023797] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T17:13:51.317723] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-22T17:13:52.034437] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T17:13:52.117612] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-22T17:13:52.621185] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T17:13:52.917766] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-22T17:13:53.259896] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:13:53.717707] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-22T17:13:53.802679] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T17:13:53.811391] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-22T17:13:53.811526] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-22T17:13:54.201175] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-22T17:13:54.201269] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-22T17:13:54.202089] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-22T17:13:54.202157] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-22T17:13:54.203721] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-22T17:13:54.516795] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-22T17:13:54.516918] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-22T17:13:54.517624] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-22T17:13:54.517593] [INFO ] [MAIN ] Update Progress: 118/2367 symbols completed. ANET took 29.0s. Estimated remaining: 4h 23m 37s. Rate: 8.5 symbols/min [2025-10-22T17:13:54.881393] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T17:13:55.317768] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-22T17:13:56.259033] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T17:13:56.262802] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-22T17:13:56.346212] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T17:13:56.816501] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T17:13:56.917626] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-22T17:13:57.717701] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-22T17:13:58.738309] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:13:58.749046] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-22T17:13:58.793842] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:13:58.799428] [INFO ] [REMOTE ] ANRO: Full fetch complete (30348 records). [2025-10-22T17:13:58.799512] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-22T17:13:59.198187] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-22T17:13:59.198281] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-22T17:13:59.198740] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-22T17:13:59.198802] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-22T17:13:59.199536] [DEBUG] [LOCAL ] ANRO: Trimmed 30348 records to 19715 (keeping 200 days of data) [2025-10-22T17:13:59.310259] [DEBUG] [LOCAL ] ANRO: Primary data saved (19715 records). [2025-10-22T17:13:59.310393] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-22T17:13:59.310471] [INFO ] [MAIN ] Update Progress: 119/2367 symbols completed. ANRO took 19.0s. Estimated remaining: 4h 22m 48s. Rate: 8.6 symbols/min [2025-10-22T17:14:00.870417] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T17:14:00.879871] [INFO ] [REMOTE ] ANF: Full fetch complete (75790 records). [2025-10-22T17:14:00.880022] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-22T17:14:01.268055] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-22T17:14:01.268151] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-22T17:14:01.268946] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-22T17:14:01.269013] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-22T17:14:01.270460] [DEBUG] [LOCAL ] ANF: Trimmed 75790 records to 52040 (keeping 200 days of data) [2025-10-22T17:14:01.573724] [DEBUG] [LOCAL ] ANF: Primary data saved (52040 records). [2025-10-22T17:14:01.574062] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-22T17:14:01.574707] [INFO ] [MAIN ] Update Progress: 120/2367 symbols completed. ANF took 30.5s. Estimated remaining: 4h 21m 12s. Rate: 8.6 symbols/min [2025-10-22T17:14:02.268559] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:02.327499] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:02.328400] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:02.320446] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-22T17:14:02.335688] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-22T17:14:02.355267] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-22T17:14:02.354935] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:02.355413] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-22T17:14:02.355682] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-22T17:14:02.355868] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-22T17:14:02.508772] [DEBUG] [LOCAL ] AOMR: Loaded 16383 existing records from primary storage. [2025-10-22T17:14:02.547423] [INFO ] [MAIN ] AOMR: Loaded 16383 existing records. [2025-10-22T17:14:02.555208] [DEBUG] [LOCAL ] ANVS: Loaded 23984 existing records from primary storage. [2025-10-22T17:14:02.576897] [INFO ] [MAIN ] ANVS: Loaded 23984 existing records. [2025-10-22T17:14:02.840858] [DEBUG] [LOCAL ] AOD: Loaded 30971 existing records from primary storage. [2025-10-22T17:14:02.891599] [INFO ] [MAIN ] AOD: Loaded 30971 existing records. [2025-10-22T17:14:03.209246] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:03.259210] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:03.279167] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:03.276155] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-22T17:14:03.279574] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-22T17:14:03.285436] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-22T17:14:03.279502] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-22T17:14:03.302720] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-22T17:14:03.320331] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-22T17:14:03.307970] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-22T17:14:03.391347] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-22T17:14:03.361197] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:03.391565] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-22T17:14:03.464722] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-22T17:14:03.497042] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-22T17:14:03.565368] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-22T17:14:03.568747] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-22T17:14:03.596296] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:14:03.718531] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-22T17:14:03.767566] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:14:03.825673] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-22T17:14:03.834489] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:14:03.873293] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-22T17:14:03.915455] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-22T17:14:03.953899] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-22T17:14:04.045540] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-22T17:14:04.086175] [INFO ] [MAIN ] Update Progress: 121/2367 symbols completed. AOMD took 2.5s. Estimated remaining: 4h 19m 42s. Rate: 8.6 symbols/min [2025-10-22T17:14:04.280453] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:04.338225] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-22T17:14:04.482315] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:04.529932] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-22T17:14:04.609676] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:04.634341] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:04.634950] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-22T17:14:04.672491] [DEBUG] [LOCAL ] AON: Loaded 45103 existing records from primary storage. [2025-10-22T17:14:04.672801] [INFO ] [MAIN ] AON: Loaded 45103 existing records. [2025-10-22T17:14:04.845624] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:04.845837] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-22T17:14:04.845915] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-22T17:14:04.846398] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-22T17:14:04.846458] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-22T17:14:05.139752] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T17:14:05.152777] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-22T17:14:05.208639] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:05.209351] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-22T17:14:05.930740] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T17:14:05.936938] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-22T17:14:05.951573] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T17:14:05.955726] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-22T17:14:06.204086] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:14:06.212421] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-22T17:14:06.817455] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T17:14:06.821578] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-22T17:14:07.046187] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T17:14:07.130183] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T17:14:07.317750] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-22T17:14:07.351614] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T17:14:07.632614] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T17:14:08.117726] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-22T17:14:08.917713] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-22T17:14:09.020814] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T17:14:09.257025] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T17:14:09.717732] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-22T17:14:10.006044] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T17:14:10.517734] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-22T17:14:11.317633] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-22T17:14:11.336586] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T17:14:11.483248] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:14:12.117742] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-22T17:14:12.274999] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-22T17:14:12.917628] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-22T17:14:12.954093] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T17:14:13.717762] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-22T17:14:13.859505] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T17:14:14.517780] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-22T17:14:15.317799] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-22T17:14:15.355907] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T17:14:15.847032] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T17:14:16.117670] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-22T17:14:16.296207] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T17:14:16.917732] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-22T17:14:17.561416] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T17:14:17.717696] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-22T17:14:18.424014] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T17:14:18.517708] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-22T17:14:18.963209] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T17:14:19.317735] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-22T17:14:20.123499] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-22T17:14:20.128579] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T17:14:20.232211] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T17:14:20.917753] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-22T17:14:21.462217] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-22T17:14:21.717716] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-22T17:14:22.426531] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T17:14:22.429012] [INFO ] [REMOTE ] AOMR: Full fetch complete (23201 records). [2025-10-22T17:14:22.429082] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-22T17:14:22.519448] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-22T17:14:22.629466] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T17:14:22.834480] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-22T17:14:22.834579] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-22T17:14:22.834955] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-22T17:14:22.835016] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-22T17:14:22.835561] [DEBUG] [LOCAL ] AOMR: Trimmed 23201 records to 16310 (keeping 200 days of data) [2025-10-22T17:14:22.929568] [DEBUG] [LOCAL ] AOMR: Primary data saved (16310 records). [2025-10-22T17:14:22.929720] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-22T17:14:22.929806] [INFO ] [MAIN ] Update Progress: 122/2367 symbols completed. AOMR took 21.3s. Estimated remaining: 4h 23m 14s. Rate: 8.5 symbols/min [2025-10-22T17:14:23.096691] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:23.121565] [DEBUG] [LOCAL ] AORT: Loaded 28922 existing records from primary storage. [2025-10-22T17:14:23.121829] [INFO ] [MAIN ] AORT: Loaded 28922 existing records. [2025-10-22T17:14:23.292978] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:23.293140] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-22T17:14:23.293187] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-22T17:14:23.293379] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-22T17:14:23.293435] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-22T17:14:23.323409] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-22T17:14:23.644782] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:23.868687] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T17:14:24.117720] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-22T17:14:24.595028] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T17:14:24.917626] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-22T17:14:24.987318] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T17:14:25.717709] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-22T17:14:26.517631] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-22T17:14:26.662324] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T17:14:27.024468] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:14:27.317742] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-22T17:14:27.849849] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T17:14:28.117694] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-22T17:14:28.699382] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T17:14:28.917712] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-22T17:14:29.478745] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T17:14:29.717706] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-22T17:14:30.231274] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:14:30.517730] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-22T17:14:31.317669] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-22T17:14:31.443382] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:14:31.915800] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T17:14:31.922468] [INFO ] [REMOTE ] AOD: Full fetch complete (44924 records). [2025-10-22T17:14:31.922624] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-22T17:14:32.122806] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-22T17:14:32.319126] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-22T17:14:32.319231] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-22T17:14:32.319915] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-22T17:14:32.320041] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-22T17:14:32.321212] [DEBUG] [LOCAL ] AOD: Trimmed 44924 records to 30865 (keeping 200 days of data) [2025-10-22T17:14:32.515778] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T17:14:32.517274] [DEBUG] [LOCAL ] AOD: Primary data saved (30865 records). [2025-10-22T17:14:32.522634] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-22T17:14:32.523421] [INFO ] [MAIN ] Update Progress: 123/2367 symbols completed. AOD took 30.9s. Estimated remaining: 4h 23m 54s. Rate: 8.5 symbols/min [2025-10-22T17:14:32.704556] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:32.753634] [DEBUG] [LOCAL ] AOS: Loaded 48651 existing records from primary storage. [2025-10-22T17:14:32.754091] [INFO ] [MAIN ] AOS: Loaded 48651 existing records. [2025-10-22T17:14:32.938604] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-22T17:14:33.009021] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:33.009364] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-22T17:14:33.009440] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-22T17:14:33.010071] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-22T17:14:33.010145] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-22T17:14:33.590128] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:33.610510] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T17:14:33.717735] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-22T17:14:34.517736] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-22T17:14:34.914984] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T17:14:34.922293] [INFO ] [REMOTE ] AON: Full fetch complete (65156 records). [2025-10-22T17:14:34.935851] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-22T17:14:34.937048] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T17:14:34.986339] [INFO ] [REMOTE ] ANVS: Full fetch complete (36884 records). [2025-10-22T17:14:35.013421] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-22T17:14:35.341926] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-22T17:14:35.695120] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-22T17:14:35.695534] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-22T17:14:35.712959] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-22T17:14:35.713081] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-22T17:14:35.727016] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-22T17:14:35.727194] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-22T17:14:35.727714] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-22T17:14:35.727798] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-22T17:14:35.728552] [DEBUG] [LOCAL ] AON: Trimmed 65156 records to 45033 (keeping 200 days of data) [2025-10-22T17:14:35.729712] [DEBUG] [LOCAL ] ANVS: Trimmed 36884 records to 23982 (keeping 200 days of data) [2025-10-22T17:14:36.102454] [DEBUG] [LOCAL ] ANVS: Primary data saved (23982 records). [2025-10-22T17:14:36.104086] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-22T17:14:36.105624] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T17:14:36.112136] [INFO ] [MAIN ] Update Progress: 124/2367 symbols completed. ANVS took 34.5s. Estimated remaining: 4h 22m 44s. Rate: 8.5 symbols/min [2025-10-22T17:14:36.137754] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-22T17:14:36.353221] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:36.363205] [DEBUG] [LOCAL ] AON: Primary data saved (45033 records). [2025-10-22T17:14:36.363438] [INFO ] [MAIN ] AON: Full history saved. [2025-10-22T17:14:36.363548] [INFO ] [MAIN ] Update Progress: 125/2367 symbols completed. AON took 32.2s. Estimated remaining: 4h 20m 35s. Rate: 8.6 symbols/min [2025-10-22T17:14:36.451045] [DEBUG] [LOCAL ] AP: Loaded 7409 existing records from primary storage. [2025-10-22T17:14:36.467712] [INFO ] [MAIN ] AP: Loaded 7409 existing records. [2025-10-22T17:14:36.710434] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:36.740792] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:36.741108] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-22T17:14:36.741162] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-22T17:14:36.741318] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-22T17:14:36.741373] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-22T17:14:37.003417] [DEBUG] [LOCAL ] APAM: Loaded 35815 existing records from primary storage. [2025-10-22T17:14:37.020533] [INFO ] [MAIN ] APAM: Loaded 35815 existing records. [2025-10-22T17:14:37.293362] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:37.299237] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-22T17:14:37.344725] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:37.345269] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-22T17:14:37.345382] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-22T17:14:37.345895] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-22T17:14:37.368681] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-22T17:14:37.440967] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T17:14:37.734253] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-22T17:14:37.774821] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:37.777345] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T17:14:38.058631] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T17:14:38.517635] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-22T17:14:39.317736] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-22T17:14:39.447480] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T17:14:39.799982] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-22T17:14:40.117628] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-22T17:14:40.746866] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T17:14:40.917734] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-22T17:14:41.695592] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:14:41.717638] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-22T17:14:42.257503] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T17:14:42.517726] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-22T17:14:43.317708] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-22T17:14:43.464424] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T17:14:43.627092] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T17:14:43.652070] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-22T17:14:44.117742] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-22T17:14:44.917749] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-22T17:14:45.463790] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T17:14:45.489408] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T17:14:45.717724] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-22T17:14:46.517740] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-22T17:14:46.812081] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:14:47.317715] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-22T17:14:47.628557] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T17:14:48.117736] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-22T17:14:48.253684] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:14:48.258421] [INFO ] [REMOTE ] AORT: Full fetch complete (42497 records). [2025-10-22T17:14:48.258514] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-22T17:14:48.649298] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-22T17:14:48.649371] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-22T17:14:48.649852] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-22T17:14:48.649913] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-22T17:14:48.650762] [DEBUG] [LOCAL ] AORT: Trimmed 42497 records to 28916 (keeping 200 days of data) [2025-10-22T17:14:48.813846] [DEBUG] [LOCAL ] AORT: Primary data saved (28916 records). [2025-10-22T17:14:48.813994] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-22T17:14:48.814116] [INFO ] [MAIN ] Update Progress: 126/2367 symbols completed. AORT took 25.9s. Estimated remaining: 4h 22m 6s. Rate: 8.6 symbols/min [2025-10-22T17:14:48.922893] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-22T17:14:48.981587] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:49.021459] [DEBUG] [LOCAL ] APD: Loaded 45477 existing records from primary storage. [2025-10-22T17:14:49.021783] [INFO ] [MAIN ] APD: Loaded 45477 existing records. [2025-10-22T17:14:49.214669] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:49.214854] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-22T17:14:49.214901] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-22T17:14:49.215342] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-22T17:14:49.215400] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-22T17:14:49.572140] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:49.600844] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T17:14:49.636464] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T17:14:49.717616] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-22T17:14:50.517725] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-22T17:14:51.317771] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-22T17:14:51.466536] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:14:52.117734] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-22T17:14:52.252791] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:14:52.656548] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T17:14:52.917767] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-22T17:14:53.406674] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T17:14:53.717738] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-22T17:14:54.065860] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T17:14:54.442490] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T17:14:54.517613] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-22T17:14:55.317624] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-22T17:14:55.333428] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T17:14:56.117666] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-22T17:14:56.917629] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-22T17:14:57.055884] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T17:14:57.720517] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-22T17:14:57.726005] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T17:14:58.281961] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T17:14:58.452374] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T17:14:58.517610] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-22T17:14:59.258441] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T17:14:59.317616] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-22T17:15:00.117720] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-22T17:15:00.143145] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T17:15:00.917740] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-22T17:15:01.576973] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T17:15:01.717710] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-22T17:15:01.879288] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T17:15:01.880872] [INFO ] [REMOTE ] AP: Full fetch complete (9080 records). [2025-10-22T17:15:01.880960] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-22T17:15:02.276243] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-22T17:15:02.276341] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-22T17:15:02.276597] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-22T17:15:02.276670] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-22T17:15:02.277286] [DEBUG] [LOCAL ] AP: Trimmed 9080 records to 7414 (keeping 200 days of data) [2025-10-22T17:15:02.319243] [DEBUG] [LOCAL ] AP: Primary data saved (7414 records). [2025-10-22T17:15:02.319382] [INFO ] [MAIN ] AP: Full history saved. [2025-10-22T17:15:02.319467] [INFO ] [MAIN ] Update Progress: 127/2367 symbols completed. AP took 26.2s. Estimated remaining: 4h 23m 53s. Rate: 8.5 symbols/min [2025-10-22T17:15:02.492989] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:02.519807] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-22T17:15:02.543105] [DEBUG] [LOCAL ] APG: Loaded 50625 existing records from primary storage. [2025-10-22T17:15:02.543429] [INFO ] [MAIN ] APG: Loaded 50625 existing records. [2025-10-22T17:15:02.748172] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:02.748397] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-22T17:15:02.748451] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-22T17:15:02.749045] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-22T17:15:02.749111] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-22T17:15:03.105589] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:03.153042] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T17:15:03.317721] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-22T17:15:04.117755] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-22T17:15:04.266921] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T17:15:04.769958] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T17:15:04.917710] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-22T17:15:05.724467] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-22T17:15:05.741816] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:15:06.324904] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T17:15:06.330432] [INFO ] [REMOTE ] APAM: Full fetch complete (51798 records). [2025-10-22T17:15:06.330600] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-22T17:15:06.331267] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:15:06.331358] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:15:06.331403] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:15:06.331471] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-22T17:15:06.331537] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-22T17:15:06.331574] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-10-22T17:15:06.331777] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-10-22T17:15:06.331871] [INFO ] [MAIN ] Update Progress: 128/2367 symbols completed. APAM took 30.0s. Estimated remaining: 4h 22m 53s. Rate: 8.5 symbols/min [2025-10-22T17:15:06.498451] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:06.530703] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-22T17:15:06.553410] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-22T17:15:06.553762] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-22T17:15:06.727009] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:06.727192] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-22T17:15:06.727242] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-22T17:15:06.727581] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-22T17:15:06.727635] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-22T17:15:07.071108] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:07.278111] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T17:15:07.317619] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-22T17:15:08.122759] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-22T17:15:08.146087] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T17:15:08.917706] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-22T17:15:09.114816] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T17:15:09.122923] [INFO ] [REMOTE ] AOS: Full fetch complete (71075 records). [2025-10-22T17:15:09.123076] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-22T17:15:09.528456] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-22T17:15:09.528688] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-22T17:15:09.529430] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-22T17:15:09.529508] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-22T17:15:09.556387] [DEBUG] [LOCAL ] AOS: Trimmed 71075 records to 48646 (keeping 200 days of data) [2025-10-22T17:15:09.558015] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:15:09.759707] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-22T17:15:09.878083] [DEBUG] [LOCAL ] AOS: Primary data saved (48646 records). [2025-10-22T17:15:09.878220] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-22T17:15:09.879052] [INFO ] [MAIN ] Update Progress: 129/2367 symbols completed. AOS took 37.4s. Estimated remaining: 4h 21m 45s. Rate: 8.6 symbols/min [2025-10-22T17:15:10.042920] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:10.043111] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-10-22T17:15:10.043150] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-10-22T17:15:10.043264] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-22T17:15:10.043306] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-22T17:15:10.043359] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-22T17:15:10.043422] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-22T17:15:10.424105] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:10.517714] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-22T17:15:11.100336] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-22T17:15:11.317722] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-22T17:15:11.488975] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T17:15:12.117664] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-22T17:15:12.232058] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T17:15:12.917707] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-22T17:15:13.648390] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-22T17:15:13.717712] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-22T17:15:13.806019] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T17:15:14.517637] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-22T17:15:14.695372] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T17:15:15.317703] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-22T17:15:15.751065] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T17:15:16.117746] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-22T17:15:16.167616] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:15:16.917765] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-22T17:15:17.064002] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T17:15:17.596333] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T17:15:17.717620] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-22T17:15:18.517732] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-22T17:15:18.813366] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T17:15:19.256154] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T17:15:19.317753] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-22T17:15:19.960219] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T17:15:20.117708] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-22T17:15:20.917669] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-22T17:15:21.257359] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T17:15:21.404820] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T17:15:21.717683] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-22T17:15:22.517628] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-22T17:15:22.568477] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:15:23.317635] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-22T17:15:23.582925] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T17:15:24.117732] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-22T17:15:24.254299] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T17:15:24.917752] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-22T17:15:25.113191] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:15:25.717760] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-22T17:15:25.998578] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T17:15:26.517633] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-22T17:15:26.810486] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T17:15:26.818361] [INFO ] [REMOTE ] APD: Full fetch complete (67330 records). [2025-10-22T17:15:26.818472] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-22T17:15:27.197761] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-22T17:15:27.197904] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-22T17:15:27.198634] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-22T17:15:27.198754] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-22T17:15:27.200134] [DEBUG] [LOCAL ] APD: Trimmed 67330 records to 45416 (keeping 200 days of data) [2025-10-22T17:15:27.319089] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-22T17:15:27.485760] [DEBUG] [LOCAL ] APD: Primary data saved (45416 records). [2025-10-22T17:15:27.485888] [INFO ] [MAIN ] APD: Full history saved. [2025-10-22T17:15:27.485968] [INFO ] [MAIN ] Update Progress: 130/2367 symbols completed. APD took 38.7s. Estimated remaining: 4h 24m 40s. Rate: 8.5 symbols/min [2025-10-22T17:15:27.653400] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:27.702995] [DEBUG] [LOCAL ] APO: Loaded 53390 existing records from primary storage. [2025-10-22T17:15:27.703299] [INFO ] [MAIN ] APO: Loaded 53390 existing records. [2025-10-22T17:15:27.869694] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-22T17:15:27.947384] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:27.947593] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-22T17:15:27.947706] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-22T17:15:27.948189] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-22T17:15:27.948257] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-22T17:15:28.150918] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-22T17:15:28.294702] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:28.437576] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T17:15:28.917752] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-22T17:15:29.252233] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T17:15:29.717713] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-22T17:15:29.960518] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T17:15:30.517733] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-22T17:15:30.742729] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:15:31.160342] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T17:15:31.168918] [INFO ] [REMOTE ] APG: Full fetch complete (72192 records). [2025-10-22T17:15:31.169068] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-22T17:15:31.322528] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-22T17:15:31.558307] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-22T17:15:31.558386] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-22T17:15:31.559095] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-22T17:15:31.559157] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-22T17:15:31.560525] [DEBUG] [LOCAL ] APG: Trimmed 72192 records to 50617 (keeping 200 days of data) [2025-10-22T17:15:31.860595] [DEBUG] [LOCAL ] APG: Primary data saved (50617 records). [2025-10-22T17:15:31.860821] [INFO ] [MAIN ] APG: Full history saved. [2025-10-22T17:15:31.861836] [INFO ] [MAIN ] Update Progress: 131/2367 symbols completed. APG took 29.5s. Estimated remaining: 4h 23m 47s. Rate: 8.5 symbols/min [2025-10-22T17:15:32.033342] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:32.042828] [DEBUG] [LOCAL ] APOS: Loaded 7132 existing records from primary storage. [2025-10-22T17:15:32.043051] [INFO ] [MAIN ] APOS: Loaded 7132 existing records. [2025-10-22T17:15:32.122314] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-22T17:15:32.223587] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:32.223885] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-22T17:15:32.233923] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-22T17:15:32.250542] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-22T17:15:32.250707] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-22T17:15:32.320733] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:15:32.637816] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:32.917719] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-22T17:15:33.233058] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T17:15:33.642562] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T17:15:33.717728] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-22T17:15:34.006024] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T17:15:34.517696] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-22T17:15:35.317665] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-22T17:15:35.822587] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T17:15:36.117741] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-22T17:15:36.446339] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T17:15:36.726598] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T17:15:36.917638] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-22T17:15:37.456388] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T17:15:37.717725] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-22T17:15:38.477913] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T17:15:38.486913] [INFO ] [REMOTE ] APLE: Full fetch complete (74796 records). [2025-10-22T17:15:38.487045] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-22T17:15:38.523926] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-22T17:15:38.887553] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-22T17:15:38.887661] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-22T17:15:38.888413] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-22T17:15:38.888461] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-22T17:15:38.890092] [DEBUG] [LOCAL ] APLE: Trimmed 74796 records to 51958 (keeping 200 days of data) [2025-10-22T17:15:39.199753] [DEBUG] [LOCAL ] APLE: Primary data saved (51958 records). [2025-10-22T17:15:39.199897] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-22T17:15:39.199967] [INFO ] [MAIN ] Update Progress: 132/2367 symbols completed. APLE took 29.3s. Estimated remaining: 4h 23m 44s. Rate: 8.5 symbols/min [2025-10-22T17:15:39.322766] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-22T17:15:39.370615] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:39.417940] [DEBUG] [LOCAL ] APTV: Loaded 51874 existing records from primary storage. [2025-10-22T17:15:39.418274] [INFO ] [MAIN ] APTV: Loaded 51874 existing records. [2025-10-22T17:15:39.600822] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:39.601179] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-22T17:15:39.601266] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-22T17:15:39.601505] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-22T17:15:39.601561] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-22T17:15:39.889687] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-22T17:15:39.950098] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-22T17:15:40.035708] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:40.117708] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-22T17:15:40.242451] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T17:15:40.908352] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T17:15:40.917600] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-22T17:15:41.642474] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T17:15:41.717688] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-22T17:15:42.404492] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T17:15:42.517698] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-22T17:15:43.317740] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-22T17:15:44.119027] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-22T17:15:44.121099] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T17:15:44.543589] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-22T17:15:44.917709] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-22T17:15:45.542567] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T17:15:45.717729] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-22T17:15:46.517720] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-22T17:15:46.571672] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-22T17:15:47.216217] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T17:15:47.317760] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-22T17:15:47.843162] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T17:15:48.117707] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-22T17:15:48.917629] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-22T17:15:49.118174] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:15:49.392693] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T17:15:49.631510] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T17:15:49.632903] [INFO ] [REMOTE ] APOS: Full fetch complete (10221 records). [2025-10-22T17:15:49.632971] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-22T17:15:49.722879] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-22T17:15:49.985237] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-22T17:15:49.985312] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-22T17:15:49.985536] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-22T17:15:49.985576] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-22T17:15:49.986026] [DEBUG] [LOCAL ] APOS: Trimmed 10221 records to 7058 (keeping 200 days of data) [2025-10-22T17:15:50.030537] [DEBUG] [LOCAL ] APOS: Primary data saved (7058 records). [2025-10-22T17:15:50.030695] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-22T17:15:50.030808] [INFO ] [MAIN ] Update Progress: 133/2367 symbols completed. APOS took 18.2s. Estimated remaining: 4h 24m 40s. Rate: 8.4 symbols/min [2025-10-22T17:15:50.198109] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:50.244518] [DEBUG] [LOCAL ] AQN: Loaded 51684 existing records from primary storage. [2025-10-22T17:15:50.244873] [INFO ] [MAIN ] AQN: Loaded 51684 existing records. [2025-10-22T17:15:50.425639] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:50.425896] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-22T17:15:50.425943] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-22T17:15:50.426220] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-22T17:15:50.426276] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-22T17:15:50.522940] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-22T17:15:50.776969] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:51.317668] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-22T17:15:51.589000] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T17:15:52.117710] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-22T17:15:52.427638] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T17:15:52.917702] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-22T17:15:53.525722] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-22T17:15:53.535014] [INFO ] [REMOTE ] APH: Full fetch complete (77869 records). [2025-10-22T17:15:53.535149] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-22T17:15:53.722798] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-22T17:15:53.941068] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-22T17:15:53.965405] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-22T17:15:53.969136] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-22T17:15:53.969283] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-22T17:15:53.971408] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T17:15:53.983224] [DEBUG] [LOCAL ] APH: Trimmed 77869 records to 53691 (keeping 200 days of data) [2025-10-22T17:15:54.307961] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-22T17:15:54.308093] [INFO ] [MAIN ] APH: Full history saved. [2025-10-22T17:15:54.308852] [INFO ] [MAIN ] Update Progress: 134/2367 symbols completed. APH took 48.0s. Estimated remaining: 4h 23m 46s. Rate: 8.5 symbols/min [2025-10-22T17:15:54.481067] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:54.488870] [DEBUG] [LOCAL ] AQNB: Loaded 3940 existing records from primary storage. [2025-10-22T17:15:54.489080] [INFO ] [MAIN ] AQNB: Loaded 3940 existing records. [2025-10-22T17:15:54.525343] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-22T17:15:54.669410] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:54.669618] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-22T17:15:54.669793] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-22T17:15:54.670114] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-22T17:15:54.670180] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-22T17:15:54.773418] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T17:15:55.080664] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:55.317705] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-22T17:15:55.855612] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-22T17:15:55.895786] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-22T17:15:55.897252] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T17:15:56.117702] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-22T17:15:56.917717] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-22T17:15:57.362569] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T17:15:57.717624] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-22T17:15:57.944663] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T17:15:58.517719] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-22T17:15:59.317734] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-22T17:15:59.411080] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T17:16:00.117860] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-22T17:16:00.350443] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T17:16:00.917627] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-22T17:16:01.100866] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T17:16:01.732480] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-22T17:16:01.740265] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T17:16:02.358725] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T17:16:02.517635] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-22T17:16:02.914719] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-22T17:16:02.940983] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T17:16:02.949828] [INFO ] [REMOTE ] APO: Full fetch complete (77467 records). [2025-10-22T17:16:02.949959] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-22T17:16:03.321595] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-22T17:16:03.374548] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-22T17:16:03.374629] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-22T17:16:03.375429] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-22T17:16:03.375478] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-22T17:16:03.376845] [DEBUG] [LOCAL ] APO: Trimmed 77467 records to 53388 (keeping 200 days of data) [2025-10-22T17:16:03.694483] [DEBUG] [LOCAL ] APO: Primary data saved (53388 records). [2025-10-22T17:16:03.694615] [INFO ] [MAIN ] APO: Full history saved. [2025-10-22T17:16:03.694722] [INFO ] [MAIN ] Update Progress: 135/2367 symbols completed. APO took 36.2s. Estimated remaining: 4h 24m 17s. Rate: 8.4 symbols/min [2025-10-22T17:16:03.859864] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:03.909950] [DEBUG] [LOCAL ] AR: Loaded 53590 existing records from primary storage. [2025-10-22T17:16:03.910282] [INFO ] [MAIN ] AR: Loaded 53590 existing records. [2025-10-22T17:16:04.012461] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T17:16:04.107241] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:16:04.107485] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-22T17:16:04.107534] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-22T17:16:04.108096] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-22T17:16:04.108155] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-22T17:16:04.122887] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-22T17:16:04.505180] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:04.834394] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T17:16:04.917638] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-22T17:16:05.717739] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-22T17:16:06.517725] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-22T17:16:06.763807] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T17:16:07.029851] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T17:16:07.317714] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-22T17:16:07.465598] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:16:08.117731] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-22T17:16:08.917728] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-22T17:16:09.038453] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T17:16:09.717707] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-22T17:16:09.920203] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T17:16:10.292776] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T17:16:10.522811] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-22T17:16:10.535767] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T17:16:11.107903] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T17:16:11.317735] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-22T17:16:12.117734] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-22T17:16:12.922901] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-22T17:16:12.936101] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T17:16:13.619461] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T17:16:13.620417] [INFO ] [REMOTE ] AQNB: Full fetch complete (5389 records). [2025-10-22T17:16:13.620483] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-22T17:16:13.719210] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-22T17:16:14.007944] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-22T17:16:14.008068] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-22T17:16:14.008365] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-22T17:16:14.008453] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-22T17:16:14.009014] [DEBUG] [LOCAL ] AQNB: Trimmed 5389 records to 3886 (keeping 200 days of data) [2025-10-22T17:16:14.035495] [DEBUG] [LOCAL ] AQNB: Primary data saved (3886 records). [2025-10-22T17:16:14.035868] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-22T17:16:14.035983] [INFO ] [MAIN ] Update Progress: 136/2367 symbols completed. AQNB took 19.7s. Estimated remaining: 4h 25m 3s. Rate: 8.4 symbols/min [2025-10-22T17:16:14.191495] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T17:16:14.272146] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:14.272306] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-22T17:16:14.272343] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-22T17:16:14.272449] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-22T17:16:14.272489] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-22T17:16:14.272529] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-22T17:16:14.272560] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-22T17:16:14.522807] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-22T17:16:14.624814] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:15.317715] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-22T17:16:15.635635] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T17:16:16.117696] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-22T17:16:16.505684] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T17:16:16.910238] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T17:16:16.920832] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-22T17:16:17.717747] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-22T17:16:18.043717] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T17:16:18.407444] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-22T17:16:18.420832] [INFO ] [REMOTE ] APTV: Full fetch complete (75833 records). [2025-10-22T17:16:18.421049] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-22T17:16:18.526502] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-22T17:16:18.883392] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T17:16:18.984419] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-22T17:16:18.984498] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-22T17:16:18.985226] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-22T17:16:18.985287] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-22T17:16:18.986711] [DEBUG] [LOCAL ] APTV: Trimmed 75833 records to 51849 (keeping 200 days of data) [2025-10-22T17:16:19.288703] [DEBUG] [LOCAL ] APTV: Primary data saved (51849 records). [2025-10-22T17:16:19.288875] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-22T17:16:19.289622] [INFO ] [MAIN ] Update Progress: 137/2367 symbols completed. APTV took 40.1s. Estimated remaining: 4h 24m 25s. Rate: 8.4 symbols/min [2025-10-22T17:16:19.322096] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-22T17:16:19.459722] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:19.476205] [DEBUG] [LOCAL ] ARDC: Loaded 15258 existing records from primary storage. [2025-10-22T17:16:19.476439] [INFO ] [MAIN ] ARDC: Loaded 15258 existing records. [2025-10-22T17:16:19.647402] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:16:19.647689] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-22T17:16:19.647753] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-22T17:16:19.647925] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-22T17:16:19.647962] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-22T17:16:20.009339] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:20.117701] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-22T17:16:20.171984] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-22T17:16:20.179785] [INFO ] [REMOTE ] AQN: Full fetch complete (74965 records). [2025-10-22T17:16:20.179907] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-22T17:16:20.180701] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:16:20.180793] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:16:20.180836] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:16:20.180876] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-22T17:16:20.180951] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-22T17:16:20.181008] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-22T17:16:20.181190] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-22T17:16:20.181724] [INFO ] [MAIN ] Update Progress: 138/2367 symbols completed. AQN took 30.2s. Estimated remaining: 4h 22m 37s. Rate: 8.5 symbols/min [2025-10-22T17:16:20.344297] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:20.371411] [DEBUG] [LOCAL ] ARDT: Loaded 27405 existing records from primary storage. [2025-10-22T17:16:20.371700] [INFO ] [MAIN ] ARDT: Loaded 27405 existing records. [2025-10-22T17:16:20.542457] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:16:20.542625] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-22T17:16:20.542704] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-22T17:16:20.542880] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-22T17:16:20.542917] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-22T17:16:20.884894] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:20.917609] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-22T17:16:21.261955] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T17:16:21.531856] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-22T17:16:21.717727] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-22T17:16:22.376257] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T17:16:22.517709] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-22T17:16:23.329958] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-22T17:16:23.336075] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T17:16:23.729529] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:16:24.117744] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-22T17:16:24.553355] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T17:16:24.917751] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-22T17:16:25.717706] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-22T17:16:25.905491] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T17:16:26.517715] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-22T17:16:26.628588] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:16:27.060936] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:16:27.317705] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-22T17:16:28.117634] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-22T17:16:28.196113] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T17:16:28.506784] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T17:16:28.917708] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-22T17:16:29.717704] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-22T17:16:29.905153] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T17:16:30.227138] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T17:16:30.517723] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-22T17:16:30.715779] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T17:16:31.317689] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-22T17:16:31.381998] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T17:16:32.117758] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-22T17:16:32.917755] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-22T17:16:33.088769] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:16:33.260066] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:16:33.717727] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-22T17:16:33.775992] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-22T17:16:34.517707] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-22T17:16:35.124200] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T17:16:35.267949] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T17:16:35.317611] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-22T17:16:36.117733] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-22T17:16:36.281607] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T17:16:36.917709] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-22T17:16:37.717627] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-22T17:16:37.960865] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T17:16:38.195181] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T17:16:38.517747] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-22T17:16:38.727307] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T17:16:39.317723] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-22T17:16:39.985000] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-22T17:16:40.117688] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-22T17:16:40.319941] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T17:16:40.917635] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-22T17:16:41.397000] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T17:16:41.717721] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-22T17:16:42.517684] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-22T17:16:42.751185] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T17:16:42.760372] [INFO ] [REMOTE ] AR: Full fetch complete (77348 records). [2025-10-22T17:16:42.760536] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-22T17:16:42.761453] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:16:42.761550] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:16:42.761593] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:16:42.761634] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-22T17:16:42.761749] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-22T17:16:42.761801] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-22T17:16:42.761984] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-10-22T17:16:42.762077] [INFO ] [MAIN ] Update Progress: 139/2367 symbols completed. AR took 39.1s. Estimated remaining: 4h 26m 39s. Rate: 8.4 symbols/min [2025-10-22T17:16:42.948875] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:42.949203] [DEBUG] [LOCAL ] ARE: No existing data file found in primary storage. [2025-10-22T17:16:42.949269] [WARN ] [MAIN ] ARE: No existing data found, performing full refresh instead. [2025-10-22T17:16:42.949545] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-22T17:16:42.949598] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-22T17:16:42.949809] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-22T17:16:42.949937] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-22T17:16:43.074207] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T17:16:43.324726] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-22T17:16:43.329314] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:44.054050] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:16:44.059206] [INFO ] [REMOTE ] ARDT: Full fetch complete (41598 records). [2025-10-22T17:16:44.059300] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-22T17:16:44.122794] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-22T17:16:44.429541] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-22T17:16:44.429634] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-22T17:16:44.430137] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-22T17:16:44.430181] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-22T17:16:44.431098] [DEBUG] [LOCAL ] ARDT: Trimmed 41598 records to 27391 (keeping 200 days of data) [2025-10-22T17:16:44.584415] [DEBUG] [LOCAL ] ARDT: Primary data saved (27391 records). [2025-10-22T17:16:44.584572] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-22T17:16:44.584751] [INFO ] [MAIN ] Update Progress: 140/2367 symbols completed. ARDT took 24.4s. Estimated remaining: 4h 25m 6s. Rate: 8.4 symbols/min [2025-10-22T17:16:44.755735] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:44.785255] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T17:16:44.835854] [DEBUG] [LOCAL ] ARES: Loaded 49679 existing records from primary storage. [2025-10-22T17:16:44.836183] [INFO ] [MAIN ] ARES: Loaded 49679 existing records. [2025-10-22T17:16:44.925146] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-22T17:16:45.025102] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:16:45.025361] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-22T17:16:45.025417] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-22T17:16:45.025776] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-22T17:16:45.025832] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-22T17:16:45.344599] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T17:16:45.429933] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:45.717729] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-22T17:16:46.465972] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T17:16:46.517705] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-22T17:16:46.915893] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T17:16:46.919233] [INFO ] [REMOTE ] ARDC: Full fetch complete (21391 records). [2025-10-22T17:16:46.919306] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-22T17:16:46.919860] [FATAL] [VALIDATOR ] ARDC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:16:46.919946] [FATAL] [MAIN ] ARDC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:16:46.919987] [WARN ] [MAIN ] ARDC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:16:46.920025] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-22T17:16:46.920092] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-22T17:16:46.920127] [INFO ] [LOCAL ] ARDC: Starting deletion of derivative data. [2025-10-22T17:16:46.920263] [DEBUG] [LOCAL ] ARDC: Deleted derivative data file. [2025-10-22T17:16:46.920327] [INFO ] [MAIN ] Update Progress: 141/2367 symbols completed. ARDC took 27.6s. Estimated remaining: 4h 23m 43s. Rate: 8.4 symbols/min [2025-10-22T17:16:47.085950] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:47.086119] [DEBUG] [LOCAL ] ARI: No existing data file found in primary storage. [2025-10-22T17:16:47.086156] [WARN ] [MAIN ] ARI: No existing data found, performing full refresh instead. [2025-10-22T17:16:47.086267] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-22T17:16:47.086330] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-22T17:16:47.086388] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-22T17:16:47.086421] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-22T17:16:47.322951] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-22T17:16:47.432638] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:47.752184] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T17:16:48.117715] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-22T17:16:48.917731] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-22T17:16:49.166839] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T17:16:49.717634] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-22T17:16:50.050485] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T17:16:50.274462] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T17:16:50.281364] [INFO ] [REMOTE ] ARCO: Full fetch complete (64694 records). [2025-10-22T17:16:50.281558] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-22T17:16:50.282723] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:16:50.282828] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:16:50.282871] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:16:50.282942] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-22T17:16:50.283007] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-22T17:16:50.283043] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-22T17:16:50.283081] [DEBUG] [LOCAL ] ARCO: No derivative data file found to delete. [2025-10-22T17:16:50.283137] [INFO ] [MAIN ] Update Progress: 142/2367 symbols completed. ARCO took 36.2s. Estimated remaining: 4h 22m 38s. Rate: 8.5 symbols/min [2025-10-22T17:16:50.449588] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:50.492819] [DEBUG] [LOCAL ] ARLO: Loaded 43536 existing records from primary storage. [2025-10-22T17:16:50.493098] [INFO ] [MAIN ] ARLO: Loaded 43536 existing records. [2025-10-22T17:16:50.522906] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-22T17:16:50.667827] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:16:50.668043] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-22T17:16:50.668091] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-22T17:16:50.668296] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-22T17:16:50.668335] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-22T17:16:51.016922] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:51.127412] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T17:16:51.317741] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-22T17:16:52.117713] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-22T17:16:52.152066] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T17:16:52.917694] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-22T17:16:53.054314] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T17:16:53.584505] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T17:16:53.717628] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-22T17:16:54.517634] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-22T17:16:54.564435] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:16:55.242688] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:16:55.317710] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-22T17:16:56.083891] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:16:56.117728] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-22T17:16:56.572259] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T17:16:56.917706] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-22T17:16:57.408991] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T17:16:57.717726] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-22T17:16:58.517764] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-22T17:16:58.938143] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T17:16:59.168374] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:16:59.317664] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-22T17:17:00.117711] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-22T17:17:00.514517] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T17:17:00.648097] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T17:17:00.917718] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-22T17:17:01.469173] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T17:17:01.717750] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-22T17:17:02.517627] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-22T17:17:02.744745] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T17:17:02.986843] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T17:17:03.317699] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-22T17:17:03.975026] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T17:17:04.117739] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-22T17:17:04.917695] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-22T17:17:05.283769] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T17:17:05.717690] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-22T17:17:05.791314] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T17:17:06.517619] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-22T17:17:06.920728] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T17:17:06.956875] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:17:07.317727] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-22T17:17:07.712371] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T17:17:08.117635] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-22T17:17:08.917629] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-22T17:17:09.278382] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T17:17:09.717728] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-22T17:17:09.727274] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T17:17:10.323176] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T17:17:10.517765] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-22T17:17:10.940883] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T17:17:11.317639] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-22T17:17:12.117717] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-22T17:17:12.917756] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-22T17:17:13.171995] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-10-22T17:17:13.717631] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-22T17:17:13.890106] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-22T17:17:13.997975] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T17:17:14.517770] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-22T17:17:14.889102] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T17:17:14.896204] [INFO ] [REMOTE ] ARLO: Full fetch complete (63147 records). [2025-10-22T17:17:14.896320] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-22T17:17:15.296090] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-22T17:17:15.296197] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-22T17:17:15.296933] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-22T17:17:15.297068] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-22T17:17:15.298501] [DEBUG] [LOCAL ] ARLO: Trimmed 63147 records to 43510 (keeping 200 days of data) [2025-10-22T17:17:15.360562] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-22T17:17:15.425273] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T17:17:15.588997] [DEBUG] [LOCAL ] ARLO: Primary data saved (43510 records). [2025-10-22T17:17:15.589131] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-22T17:17:15.589891] [INFO ] [MAIN ] Update Progress: 143/2367 symbols completed. ARLO took 25.3s. Estimated remaining: 4h 27m 14s. Rate: 8.3 symbols/min [2025-10-22T17:17:15.761432] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:15.761611] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-10-22T17:17:15.761676] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-10-22T17:17:15.761801] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-22T17:17:15.761842] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-22T17:17:15.761883] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-22T17:17:15.761934] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-22T17:17:16.140390] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:16.127207] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-22T17:17:16.169793] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T17:17:16.917692] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-22T17:17:17.046306] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T17:17:17.717776] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-22T17:17:17.895763] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:17:18.447140] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T17:17:18.455554] [INFO ] [REMOTE ] ARE: Full fetch complete (73055 records). [2025-10-22T17:17:18.455704] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-22T17:17:18.522845] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-22T17:17:18.886172] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-22T17:17:18.886299] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-22T17:17:18.887059] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-22T17:17:18.887147] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-22T17:17:18.905307] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T17:17:18.904621] [DEBUG] [LOCAL ] ARE: Trimmed 73055 records to 50927 (keeping 200 days of data) [2025-10-22T17:17:18.912445] [INFO ] [REMOTE ] ARI: Full fetch complete (61963 records). [2025-10-22T17:17:18.912565] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-22T17:17:18.913421] [FATAL] [VALIDATOR ] ARI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:17:18.913522] [FATAL] [MAIN ] ARI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:17:18.913564] [WARN ] [MAIN ] ARI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:17:18.913625] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-22T17:17:18.913729] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-22T17:17:18.913774] [INFO ] [LOCAL ] ARI: Starting deletion of derivative data. [2025-10-22T17:17:18.913816] [DEBUG] [LOCAL ] ARI: No derivative data file found to delete. [2025-10-22T17:17:18.913876] [INFO ] [MAIN ] Update Progress: 144/2367 symbols completed. ARI took 32.0s. Estimated remaining: 4h 26m 7s. Rate: 8.4 symbols/min [2025-10-22T17:17:19.272441] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:19.280804] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-10-22T17:17:19.306956] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-10-22T17:17:19.309383] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-22T17:17:19.309962] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-22T17:17:19.313679] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-22T17:17:19.316289] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-22T17:17:19.329271] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-22T17:17:19.776129] [DEBUG] [LOCAL ] ARE: Primary data saved (50927 records). [2025-10-22T17:17:19.780219] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-22T17:17:19.780361] [INFO ] [MAIN ] Update Progress: 145/2367 symbols completed. ARE took 37.0s. Estimated remaining: 4h 24m 23s. Rate: 8.4 symbols/min [2025-10-22T17:17:19.779942] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:19.946518] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:19.946762] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-22T17:17:19.946832] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-22T17:17:19.947017] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-22T17:17:19.947108] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-22T17:17:19.947233] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-22T17:17:19.947317] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-22T17:17:20.128890] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-22T17:17:20.260045] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T17:17:20.373029] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:20.917704] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-22T17:17:21.143165] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T17:17:21.717702] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-22T17:17:22.177213] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-22T17:17:22.517782] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-22T17:17:22.657015] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T17:17:23.317748] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-22T17:17:23.491549] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T17:17:23.500086] [INFO ] [REMOTE ] ARES: Full fetch complete (71729 records). [2025-10-22T17:17:23.500221] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-22T17:17:23.893626] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-22T17:17:23.893775] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-22T17:17:23.894520] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-22T17:17:23.894585] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-22T17:17:23.895996] [DEBUG] [LOCAL ] ARES: Trimmed 71729 records to 49676 (keeping 200 days of data) [2025-10-22T17:17:24.120838] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-22T17:17:24.205409] [DEBUG] [LOCAL ] ARES: Primary data saved (49676 records). [2025-10-22T17:17:24.205537] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-22T17:17:24.206397] [INFO ] [MAIN ] Update Progress: 146/2367 symbols completed. ARES took 39.6s. Estimated remaining: 4h 23m 34s. Rate: 8.4 symbols/min [2025-10-22T17:17:24.374302] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:24.374446] [DEBUG] [LOCAL ] ARW: No existing data file found in primary storage. [2025-10-22T17:17:24.374484] [WARN ] [MAIN ] ARW: No existing data found, performing full refresh instead. [2025-10-22T17:17:24.374593] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-22T17:17:24.374633] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-22T17:17:24.374719] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-22T17:17:24.374759] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-22T17:17:24.740067] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:24.768974] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-22T17:17:24.865382] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T17:17:24.917638] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-22T17:17:25.717729] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-22T17:17:25.856803] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T17:17:26.517626] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-22T17:17:26.710313] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:17:27.244407] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T17:17:27.317688] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-22T17:17:28.013845] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T17:17:28.117697] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-22T17:17:28.917717] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-22T17:17:29.313615] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T17:17:29.717743] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-22T17:17:29.864520] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T17:17:30.292796] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T17:17:30.517720] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-22T17:17:31.317634] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-22T17:17:31.398449] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T17:17:32.117728] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-22T17:17:32.541555] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T17:17:32.631490] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T17:17:32.917694] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-22T17:17:33.717632] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-22T17:17:34.115243] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T17:17:34.419720] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T17:17:34.517734] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-22T17:17:35.064820] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T17:17:35.317707] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-22T17:17:36.117637] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-22T17:17:36.227758] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T17:17:36.917631] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-22T17:17:36.966718] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T17:17:37.717731] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-22T17:17:38.163278] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T17:17:38.517706] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-22T17:17:38.614619] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:17:38.936244] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T17:17:39.317695] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-22T17:17:40.094009] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T17:17:40.117605] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-22T17:17:40.917731] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-22T17:17:41.045825] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T17:17:41.665785] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T17:17:41.717708] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-22T17:17:42.493319] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T17:17:42.517709] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-22T17:17:43.317722] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-22T17:17:43.759362] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:17:44.117761] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-22T17:17:44.237151] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T17:17:44.922785] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-22T17:17:44.940369] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T17:17:45.507309] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T17:17:45.717713] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-22T17:17:46.517697] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-22T17:17:46.604510] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:17:46.613683] [INFO ] [REMOTE ] ARMK: Full fetch complete (72990 records). [2025-10-22T17:17:46.613936] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-22T17:17:47.027116] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-22T17:17:47.027270] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-22T17:17:47.028205] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-22T17:17:47.028283] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-22T17:17:47.030139] [DEBUG] [LOCAL ] ARMK: Trimmed 72990 records to 50369 (keeping 200 days of data) [2025-10-22T17:17:47.324681] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-22T17:17:47.344365] [DEBUG] [LOCAL ] ARMK: Primary data saved (50369 records). [2025-10-22T17:17:47.345057] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-22T17:17:47.345242] [INFO ] [MAIN ] Update Progress: 147/2367 symbols completed. ARMK took 31.8s. Estimated remaining: 4h 27m 29s. Rate: 8.3 symbols/min [2025-10-22T17:17:47.514823] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:47.514986] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-22T17:17:47.515025] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-22T17:17:47.515135] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-22T17:17:47.515176] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-22T17:17:47.515219] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-22T17:17:47.515252] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-22T17:17:47.875056] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:47.928609] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T17:17:47.937591] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-22T17:17:48.117712] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-22T17:17:48.310718] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:17:48.311110] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-22T17:17:48.311208] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:17:48.311273] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-22T17:17:48.311335] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:17:48.311406] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-22T17:17:48.311469] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-22T17:17:48.311505] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-22T17:17:48.311545] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-22T17:17:48.311589] [INFO ] [MAIN ] Update Progress: 148/2367 symbols completed. ARX took 1.0s. Estimated remaining: 4h 25m 48s. Rate: 8.3 symbols/min [2025-10-22T17:17:48.476187] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:48.523875] [DEBUG] [LOCAL ] AS: Loaded 53198 existing records from primary storage. [2025-10-22T17:17:48.524200] [INFO ] [MAIN ] AS: Loaded 53198 existing records. [2025-10-22T17:17:48.698389] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:17:48.698607] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-22T17:17:48.698688] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-22T17:17:48.699141] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-22T17:17:48.699198] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-22T17:17:48.917832] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-22T17:17:49.057617] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:49.086172] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T17:17:49.717703] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-22T17:17:50.517731] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-22T17:17:51.198742] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-22T17:17:51.207410] [INFO ] [REMOTE ] ARR: Full fetch complete (75498 records). [2025-10-22T17:17:51.207611] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-22T17:17:51.319916] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-22T17:17:51.621084] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-22T17:17:51.621282] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-22T17:17:51.622226] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-22T17:17:51.622433] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-22T17:17:51.649674] [DEBUG] [LOCAL ] ARR: Trimmed 75498 records to 52091 (keeping 200 days of data) [2025-10-22T17:17:51.651349] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T17:17:51.978188] [DEBUG] [LOCAL ] ARR: Primary data saved (52091 records). [2025-10-22T17:17:51.978328] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-22T17:17:51.978400] [INFO ] [MAIN ] Update Progress: 149/2367 symbols completed. ARR took 32.2s. Estimated remaining: 4h 24m 49s. Rate: 8.4 symbols/min [2025-10-22T17:17:52.123058] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-22T17:17:52.148847] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:52.163820] [DEBUG] [LOCAL ] ASA: Loaded 15663 existing records from primary storage. [2025-10-22T17:17:52.164046] [INFO ] [MAIN ] ASA: Loaded 15663 existing records. [2025-10-22T17:17:52.340754] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:17:52.341049] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-22T17:17:52.341114] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-22T17:17:52.357143] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-22T17:17:52.359390] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-22T17:17:52.395127] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T17:17:52.483390] [INFO ] [REMOTE ] AROC: Full fetch complete (71041 records). [2025-10-22T17:17:52.521085] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-22T17:17:52.571304] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:17:52.619897] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:17:52.636760] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:17:52.650053] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-22T17:17:52.653584] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-22T17:17:52.659300] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-10-22T17:17:52.692347] [DEBUG] [LOCAL ] AROC: No derivative data file found to delete. [2025-10-22T17:17:52.692492] [INFO ] [MAIN ] Update Progress: 150/2367 symbols completed. AROC took 33.8s. Estimated remaining: 4h 23m 6s. Rate: 8.4 symbols/min [2025-10-22T17:17:52.788103] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:52.852951] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T17:17:52.928257] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:52.926722] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-22T17:17:52.977743] [DEBUG] [LOCAL ] ASAN: Loaded 52732 existing records from primary storage. [2025-10-22T17:17:52.978059] [INFO ] [MAIN ] ASAN: Loaded 52732 existing records. [2025-10-22T17:17:53.151984] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:17:53.152236] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-22T17:17:53.152282] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-22T17:17:53.152484] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-22T17:17:53.152546] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-22T17:17:53.508806] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:53.538590] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:17:53.717687] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-22T17:17:53.847283] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T17:17:54.517780] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-22T17:17:55.317632] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-22T17:17:55.365635] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T17:17:55.652227] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T17:17:56.117705] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-22T17:17:56.759039] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T17:17:56.917730] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-22T17:17:57.641638] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T17:17:57.717610] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-22T17:17:58.517731] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-22T17:17:58.811550] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T17:17:59.141875] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T17:17:59.317636] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-22T17:17:59.790470] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T17:17:59.796383] [INFO ] [REMOTE ] ARW: Full fetch complete (48680 records). [2025-10-22T17:17:59.796495] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-22T17:18:00.124096] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-22T17:18:00.179978] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-22T17:18:00.180185] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-22T17:18:00.180782] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-22T17:18:00.180851] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-22T17:18:00.181934] [DEBUG] [LOCAL ] ARW: Trimmed 48680 records to 33141 (keeping 200 days of data) [2025-10-22T17:18:00.372229] [DEBUG] [LOCAL ] ARW: Primary data saved (33141 records). [2025-10-22T17:18:00.372362] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-22T17:18:00.372436] [INFO ] [MAIN ] Update Progress: 151/2367 symbols completed. ARW took 36.2s. Estimated remaining: 4h 23m 7s. Rate: 8.4 symbols/min [2025-10-22T17:18:00.536951] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:00.578143] [DEBUG] [LOCAL ] ASB: Loaded 49698 existing records from primary storage. [2025-10-22T17:18:00.578431] [INFO ] [MAIN ] ASB: Loaded 49698 existing records. [2025-10-22T17:18:00.751633] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:18:00.751842] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-22T17:18:00.751920] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-22T17:18:00.752441] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-22T17:18:00.752501] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-22T17:18:00.930572] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-22T17:18:01.121571] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:01.129979] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T17:18:01.200498] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T17:18:01.717697] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-22T17:18:02.517629] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-22T17:18:02.799308] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T17:18:03.317740] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-22T17:18:03.617438] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T17:18:03.662357] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T17:18:04.117633] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-22T17:18:04.917722] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-22T17:18:05.011742] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T17:18:05.617166] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T17:18:05.717780] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-22T17:18:05.773419] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T17:18:06.517723] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-22T17:18:06.604865] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:18:07.317695] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-22T17:18:08.117738] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-22T17:18:08.172525] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T17:18:08.426931] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T17:18:08.917736] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-22T17:18:09.685100] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:18:09.717713] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-22T17:18:10.517636] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-22T17:18:10.649190] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:18:11.317705] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-22T17:18:11.500565] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T17:18:12.117753] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-22T17:18:12.520705] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T17:18:12.827955] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T17:18:12.917623] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-22T17:18:13.067001] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T17:18:13.717769] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-22T17:18:14.517746] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-22T17:18:14.895772] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T17:18:14.904496] [INFO ] [REMOTE ] AS: Full fetch complete (76921 records). [2025-10-22T17:18:14.904626] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-22T17:18:15.306765] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-22T17:18:15.306849] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-22T17:18:15.307582] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-22T17:18:15.307622] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-22T17:18:15.309065] [DEBUG] [LOCAL ] AS: Trimmed 76921 records to 53198 (keeping 200 days of data) [2025-10-22T17:18:15.359781] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-22T17:18:15.620670] [DEBUG] [LOCAL ] AS: Primary data saved (53198 records). [2025-10-22T17:18:15.620859] [INFO ] [MAIN ] AS: Full history saved. [2025-10-22T17:18:15.621822] [INFO ] [MAIN ] Update Progress: 152/2367 symbols completed. AS took 27.3s. Estimated remaining: 4h 24m 58s. Rate: 8.4 symbols/min [2025-10-22T17:18:15.771888] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-22T17:18:15.831547] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:15.836240] [DEBUG] [LOCAL ] ASBA: Loaded 3501 existing records from primary storage. [2025-10-22T17:18:15.836383] [INFO ] [MAIN ] ASBA: Loaded 3501 existing records. [2025-10-22T17:18:16.011054] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:18:16.011366] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-22T17:18:16.011510] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-22T17:18:16.011686] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-22T17:18:16.011753] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-22T17:18:16.120235] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-22T17:18:16.372174] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:16.400277] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T17:18:16.539976] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T17:18:16.917736] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-22T17:18:17.717757] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-22T17:18:18.262162] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T17:18:18.366669] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T17:18:18.517758] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-22T17:18:19.115908] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T17:18:19.120408] [INFO ] [REMOTE ] ASA: Full fetch complete (20812 records). [2025-10-22T17:18:19.120500] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-22T17:18:19.323272] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-22T17:18:19.497371] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-22T17:18:19.497455] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-22T17:18:19.497931] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-22T17:18:19.497995] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-22T17:18:19.498601] [DEBUG] [LOCAL ] ASA: Trimmed 20812 records to 15680 (keeping 200 days of data) [2025-10-22T17:18:19.594904] [DEBUG] [LOCAL ] ASA: Primary data saved (15680 records). [2025-10-22T17:18:19.595048] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-22T17:18:19.595125] [INFO ] [MAIN ] Update Progress: 153/2367 symbols completed. ASA took 27.6s. Estimated remaining: 4h 24m 5s. Rate: 8.4 symbols/min [2025-10-22T17:18:19.760239] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:19.760398] [DEBUG] [LOCAL ] ASC: No existing data file found in primary storage. [2025-10-22T17:18:19.760435] [WARN ] [MAIN ] ASC: No existing data found, performing full refresh instead. [2025-10-22T17:18:19.760542] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-22T17:18:19.760582] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-22T17:18:19.760622] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-22T17:18:19.760703] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-22T17:18:20.112413] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:20.117620] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-22T17:18:20.404245] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T17:18:20.526459] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T17:18:20.917740] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-22T17:18:21.385143] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T17:18:21.717755] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-22T17:18:21.743972] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T17:18:22.517744] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-22T17:18:23.252941] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T17:18:23.317697] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-22T17:18:24.117721] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-22T17:18:24.267594] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T17:18:24.380272] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T17:18:24.917752] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-22T17:18:25.717751] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-22T17:18:26.308749] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T17:18:26.350022] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T17:18:26.517743] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-22T17:18:27.138344] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T17:18:27.317720] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-22T17:18:27.320196] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T17:18:27.907186] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T17:18:28.117637] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-22T17:18:28.749981] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T17:18:28.917717] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-22T17:18:29.717701] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-22T17:18:30.517698] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-22T17:18:30.913374] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T17:18:30.922885] [INFO ] [REMOTE ] ASAN: Full fetch complete (76637 records). [2025-10-22T17:18:30.943786] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-22T17:18:30.945517] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:18:31.323064] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-22T17:18:31.346284] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-22T17:18:31.346358] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-22T17:18:31.347150] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-22T17:18:31.347303] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-22T17:18:31.348771] [DEBUG] [LOCAL ] ASAN: Trimmed 76637 records to 52732 (keeping 200 days of data) [2025-10-22T17:18:31.652961] [DEBUG] [LOCAL ] ASAN: Primary data saved (52732 records). [2025-10-22T17:18:31.653107] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-22T17:18:31.653185] [INFO ] [MAIN ] Update Progress: 154/2367 symbols completed. ASAN took 39.0s. Estimated remaining: 4h 25m 8s. Rate: 8.3 symbols/min [2025-10-22T17:18:31.837114] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:31.854998] [DEBUG] [LOCAL ] ASG: Loaded 19380 existing records from primary storage. [2025-10-22T17:18:31.855371] [INFO ] [MAIN ] ASG: Loaded 19380 existing records. [2025-10-22T17:18:32.039995] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:18:32.054889] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-22T17:18:32.069040] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T17:18:32.069236] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-22T17:18:32.073882] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-22T17:18:32.074229] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-22T17:18:32.121865] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-22T17:18:32.109629] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T17:18:32.462629] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:32.917698] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-22T17:18:33.688021] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:18:33.717617] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-22T17:18:34.111415] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-22T17:18:34.517759] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-22T17:18:34.942276] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T17:18:35.082557] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T17:18:35.317694] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-22T17:18:36.117720] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-22T17:18:36.917737] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-22T17:18:37.015482] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T17:18:37.085086] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:18:37.717758] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-22T17:18:38.517705] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-22T17:18:38.637451] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T17:18:38.646031] [INFO ] [REMOTE ] ASB: Full fetch complete (72248 records). [2025-10-22T17:18:38.646157] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-22T17:18:38.852186] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T17:18:39.072157] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-22T17:18:39.072232] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-22T17:18:39.072936] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-22T17:18:39.072998] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-22T17:18:39.074300] [DEBUG] [LOCAL ] ASB: Trimmed 72248 records to 49696 (keeping 200 days of data) [2025-10-22T17:18:39.317630] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-22T17:18:39.385440] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T17:18:39.395658] [DEBUG] [LOCAL ] ASB: Primary data saved (49696 records). [2025-10-22T17:18:39.395742] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-22T17:18:39.396583] [INFO ] [MAIN ] Update Progress: 155/2367 symbols completed. ASB took 39.0s. Estimated remaining: 4h 25m 9s. Rate: 8.3 symbols/min [2025-10-22T17:18:39.566497] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:39.588123] [DEBUG] [LOCAL ] ASGI: Loaded 23005 existing records from primary storage. [2025-10-22T17:18:39.588383] [INFO ] [MAIN ] ASGI: Loaded 23005 existing records. [2025-10-22T17:18:39.762899] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:18:39.763058] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-22T17:18:39.763104] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-22T17:18:39.763342] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-22T17:18:39.763379] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-22T17:18:40.014274] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T17:18:40.123419] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:40.123497] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-22T17:18:40.917814] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-22T17:18:41.456862] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-22T17:18:41.459327] [INFO ] [REMOTE ] ASBA: Full fetch complete (5224 records). [2025-10-22T17:18:41.459438] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-22T17:18:41.591738] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T17:18:41.722841] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-22T17:18:41.872581] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-22T17:18:41.872681] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-22T17:18:41.872838] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-22T17:18:41.872878] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-22T17:18:41.873236] [DEBUG] [LOCAL ] ASBA: Trimmed 5224 records to 3475 (keeping 200 days of data) [2025-10-22T17:18:41.893905] [DEBUG] [LOCAL ] ASBA: Primary data saved (3475 records). [2025-10-22T17:18:41.893977] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-22T17:18:41.894044] [INFO ] [MAIN ] Update Progress: 156/2367 symbols completed. ASBA took 26.3s. Estimated remaining: 4h 23m 55s. Rate: 8.4 symbols/min [2025-10-22T17:18:42.059899] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:42.101859] [DEBUG] [LOCAL ] ASGN: Loaded 36654 existing records from primary storage. [2025-10-22T17:18:42.102174] [INFO ] [MAIN ] ASGN: Loaded 36654 existing records. [2025-10-22T17:18:42.275227] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:18:42.275434] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-22T17:18:42.275491] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-22T17:18:42.275852] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-22T17:18:42.275907] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-22T17:18:42.522809] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-22T17:18:42.620511] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:43.217058] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T17:18:43.317614] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-22T17:18:43.789750] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T17:18:43.795800] [INFO ] [REMOTE ] ASC: Full fetch complete (56017 records). [2025-10-22T17:18:43.795894] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-22T17:18:44.130850] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-22T17:18:44.187196] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-22T17:18:44.187455] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-22T17:18:44.188099] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-22T17:18:44.188160] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-22T17:18:44.189310] [DEBUG] [LOCAL ] ASC: Trimmed 56017 records to 37184 (keeping 200 days of data) [2025-10-22T17:18:44.310530] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T17:18:44.427053] [DEBUG] [LOCAL ] ASC: Primary data saved (37184 records). [2025-10-22T17:18:44.427188] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-22T17:18:44.427261] [INFO ] [MAIN ] Update Progress: 157/2367 symbols completed. ASC took 24.8s. Estimated remaining: 4h 22m 43s. Rate: 8.4 symbols/min [2025-10-22T17:18:44.917690] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-22T17:18:45.717630] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-22T17:18:45.792866] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:18:46.517700] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-22T17:18:47.042017] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T17:18:47.317635] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-22T17:18:47.737725] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T17:18:47.985477] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (3.85 seconds). [2025-10-22T17:18:48.117626] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-22T17:18:48.397384] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T17:18:48.917745] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-22T17:18:49.382110] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T17:18:49.717752] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-22T17:18:50.019305] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T17:18:50.517695] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-22T17:18:50.819548] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T17:18:51.317711] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-22T17:18:52.117707] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-22T17:18:52.395159] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T17:18:52.917792] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-22T17:18:53.011424] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:18:53.324841] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-10-22T17:18:53.717762] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-22T17:18:54.517700] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-22T17:18:54.782431] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T17:18:55.250829] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T17:18:55.317617] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-22T17:18:55.390061] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:18:56.117712] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-22T17:18:56.396991] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T17:18:56.917636] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-22T17:18:57.225350] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T17:18:57.717756] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-22T17:18:58.079497] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T17:18:58.517794] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-22T17:18:58.924262] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T17:18:59.317757] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-22T17:18:59.691946] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T17:19:00.117634] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-22T17:19:00.359028] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:19:00.917741] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-22T17:19:01.598174] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T17:19:01.717774] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-22T17:19:01.928420] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T17:19:01.931667] [INFO ] [REMOTE ] ASG: Full fetch complete (30699 records). [2025-10-22T17:19:01.931769] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-22T17:19:01.932392] [FATAL] [VALIDATOR ] ASG: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:19:01.932481] [FATAL] [MAIN ] ASG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:19:01.932554] [WARN ] [MAIN ] ASG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:19:01.932639] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-22T17:19:01.932769] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-10-22T17:19:01.932822] [INFO ] [LOCAL ] ASG: Starting deletion of derivative data. [2025-10-22T17:19:01.933075] [DEBUG] [LOCAL ] ASG: Deleted derivative data file. [2025-10-22T17:19:01.933201] [INFO ] [MAIN ] Update Progress: 158/2367 symbols completed. ASG took 30.3s. Estimated remaining: 4h 25m 1s. Rate: 8.3 symbols/min [2025-10-22T17:19:02.517750] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-22T17:19:03.143022] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T17:19:03.317622] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-22T17:19:03.362058] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T17:19:04.117768] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-22T17:19:05.194210] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T17:19:05.201929] [INFO ] [REMOTE ] ASGN: Full fetch complete (53654 records). [2025-10-22T17:19:05.202049] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-22T17:19:05.468636] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T17:19:05.507761] [INFO ] [REMOTE ] ASGI: Full fetch complete (32884 records). [2025-10-22T17:19:05.510526] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-22T17:19:05.532123] [FATAL] [VALIDATOR ] ASGI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:19:05.537372] [FATAL] [MAIN ] ASGI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:19:05.559350] [WARN ] [MAIN ] ASGI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:19:05.566929] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-22T17:19:05.568253] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-10-22T17:19:05.583152] [INFO ] [LOCAL ] ASGI: Starting deletion of derivative data. [2025-10-22T17:19:05.584299] [DEBUG] [LOCAL ] ASGI: Deleted derivative data file. [2025-10-22T17:19:05.587837] [INFO ] [MAIN ] Update Progress: 159/2367 symbols completed. ASGI took 26.2s. Estimated remaining: 4h 24m 4s. Rate: 8.4 symbols/min [2025-10-22T17:19:05.601430] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-22T17:19:05.601494] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-22T17:19:05.602151] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-22T17:19:05.602213] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-22T17:19:05.603454] [DEBUG] [LOCAL ] ASGN: Trimmed 53654 records to 36689 (keeping 200 days of data) [2025-10-22T17:19:05.816043] [DEBUG] [LOCAL ] ASGN: Primary data saved (36689 records). [2025-10-22T17:19:05.816187] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-22T17:19:05.817019] [INFO ] [MAIN ] Update Progress: 160/2367 symbols completed. ASGN took 23.9s. Estimated remaining: 4h 22m 21s. Rate: 8.4 symbols/min [2025-10-22T17:19:06.460798] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:06.461992] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:06.511751] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:06.533935] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:06.534365] [DEBUG] [LOCAL ] ASH: No existing data file found in primary storage. [2025-10-22T17:19:06.534410] [WARN ] [MAIN ] ASH: No existing data found, performing full refresh instead. [2025-10-22T17:19:06.534500] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-22T17:19:06.534756] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-22T17:19:06.534871] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-10-22T17:19:06.535046] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-22T17:19:06.630695] [DEBUG] [LOCAL ] ASR: Loaded 9484 existing records from primary storage. [2025-10-22T17:19:06.657338] [INFO ] [MAIN ] ASR: Loaded 9484 existing records. [2025-10-22T17:19:06.719874] [DEBUG] [LOCAL ] ASIX: Loaded 23106 existing records from primary storage. [2025-10-22T17:19:06.774969] [INFO ] [MAIN ] ASIX: Loaded 23106 existing records. [2025-10-22T17:19:07.064170] [DEBUG] [LOCAL ] ASPN: Loaded 49890 existing records from primary storage. [2025-10-22T17:19:07.159731] [INFO ] [MAIN ] ASPN: Loaded 49890 existing records. [2025-10-22T17:19:07.246006] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:07.322613] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-22T17:19:07.347231] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-22T17:19:07.306975] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:07.361842] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-22T17:19:07.367105] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-22T17:19:07.385307] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-22T17:19:07.395715] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-22T17:19:07.439785] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-22T17:19:07.439994] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-22T17:19:07.455278] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:07.492431] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-22T17:19:07.762450] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:07.819175] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-22T17:19:07.873422] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-22T17:19:07.888557] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-22T17:19:07.931342] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-22T17:19:08.579677] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:08.636794] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:08.655275] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-22T17:19:08.669609] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-22T17:19:08.784806] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:08.785146] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-22T17:19:09.790112] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-22T17:19:09.799889] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-22T17:19:09.911680] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:19:09.924380] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-22T17:19:09.923457] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T17:19:09.930579] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-22T17:19:10.663831] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:19:10.678339] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-22T17:19:10.715627] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T17:19:10.910413] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T17:19:11.279738] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T17:19:11.317611] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-22T17:19:12.117686] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-22T17:19:12.316247] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:19:12.917721] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-22T17:19:13.281740] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T17:19:13.499576] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T17:19:13.717706] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-22T17:19:14.527183] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-22T17:19:14.530288] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T17:19:15.297811] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T17:19:15.317611] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-22T17:19:15.802278] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T17:19:16.117766] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-22T17:19:16.545953] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:19:16.917744] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-22T17:19:17.717723] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-22T17:19:17.791314] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T17:19:18.517810] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-22T17:19:18.592068] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:19:18.790677] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:19:19.276675] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T17:19:19.317750] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-22T17:19:20.117631] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-22T17:19:20.279195] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-22T17:19:20.917749] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-22T17:19:21.717752] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-22T17:19:21.743113] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:19:22.517705] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-22T17:19:22.885142] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T17:19:22.880488] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T17:19:23.317718] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-22T17:19:23.341935] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T17:19:24.117703] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-22T17:19:24.917696] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-22T17:19:25.017410] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T17:19:25.049856] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T17:19:25.717618] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-22T17:19:25.899883] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T17:19:26.517693] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-22T17:19:27.150252] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T17:19:27.317631] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-22T17:19:27.688727] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T17:19:28.000139] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T17:19:28.117637] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-22T17:19:28.804427] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T17:19:28.917702] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-22T17:19:29.717637] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-22T17:19:29.756601] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T17:19:30.517695] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-22T17:19:30.772223] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:19:31.317697] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-22T17:19:31.468258] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T17:19:31.470165] [INFO ] [REMOTE ] ASR: Full fetch complete (12514 records). [2025-10-22T17:19:31.470235] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-22T17:19:31.470660] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:19:31.470774] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:19:31.470861] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:19:31.470953] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-22T17:19:31.471030] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-10-22T17:19:31.471065] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-10-22T17:19:31.471362] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-10-22T17:19:31.471450] [INFO ] [MAIN ] Update Progress: 161/2367 symbols completed. ASR took 25.7s. Estimated remaining: 4h 26m 28s. Rate: 8.3 symbols/min [2025-10-22T17:19:31.650569] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:31.703293] [DEBUG] [LOCAL ] ASX: Loaded 52881 existing records from primary storage. [2025-10-22T17:19:31.703635] [INFO ] [MAIN ] ASX: Loaded 52881 existing records. [2025-10-22T17:19:31.877796] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:31.878006] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-22T17:19:31.878066] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-22T17:19:31.878359] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-22T17:19:31.878442] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-22T17:19:32.122717] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-22T17:19:32.223783] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:32.579280] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T17:19:32.583440] [INFO ] [REMOTE ] ASIX: Full fetch complete (31063 records). [2025-10-22T17:19:32.583518] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-22T17:19:32.925314] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-22T17:19:32.944427] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-22T17:19:32.944494] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-22T17:19:32.944927] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-22T17:19:32.945012] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-22T17:19:32.945846] [DEBUG] [LOCAL ] ASIX: Trimmed 31063 records to 22992 (keeping 200 days of data) [2025-10-22T17:19:33.088054] [DEBUG] [LOCAL ] ASIX: Primary data saved (22992 records). [2025-10-22T17:19:33.088186] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-22T17:19:33.088279] [INFO ] [MAIN ] Update Progress: 162/2367 symbols completed. ASIX took 27.3s. Estimated remaining: 4h 25m 4s. Rate: 8.3 symbols/min [2025-10-22T17:19:33.252987] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:33.286474] [DEBUG] [LOCAL ] ATEN: Loaded 37831 existing records from primary storage. [2025-10-22T17:19:33.286776] [INFO ] [MAIN ] ATEN: Loaded 37831 existing records. [2025-10-22T17:19:33.466422] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:33.466612] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-22T17:19:33.466693] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-22T17:19:33.467135] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-22T17:19:33.467189] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-22T17:19:33.721305] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-22T17:19:33.832291] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:33.853178] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:19:34.517749] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-22T17:19:34.568867] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T17:19:35.317748] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-22T17:19:35.772766] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-22T17:19:36.117628] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-22T17:19:36.187311] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T17:19:36.193920] [INFO ] [REMOTE ] ASH: Full fetch complete (55668 records). [2025-10-22T17:19:36.194021] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-22T17:19:36.574661] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-22T17:19:36.574751] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-22T17:19:36.575313] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-22T17:19:36.575353] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-22T17:19:36.576437] [DEBUG] [LOCAL ] ASH: Trimmed 55668 records to 37383 (keeping 200 days of data) [2025-10-22T17:19:36.801244] [DEBUG] [LOCAL ] ASH: Primary data saved (37383 records). [2025-10-22T17:19:36.801442] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-22T17:19:36.801527] [INFO ] [MAIN ] Update Progress: 163/2367 symbols completed. ASH took 31.0s. Estimated remaining: 4h 24m 10s. Rate: 8.3 symbols/min [2025-10-22T17:19:36.922886] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-22T17:19:36.972757] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:37.001920] [DEBUG] [LOCAL ] ATGE: Loaded 30618 existing records from primary storage. [2025-10-22T17:19:37.002180] [INFO ] [MAIN ] ATGE: Loaded 30618 existing records. [2025-10-22T17:19:37.183764] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:37.184096] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-22T17:19:37.184155] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-22T17:19:37.184563] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-22T17:19:37.184627] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-22T17:19:37.318687] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T17:19:37.595280] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:37.695363] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T17:19:37.717717] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-22T17:19:38.517693] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-22T17:19:38.561403] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:19:39.142686] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:19:39.317696] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-22T17:19:40.117711] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-22T17:19:40.247244] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:19:40.698634] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T17:19:40.917704] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-22T17:19:41.630433] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T17:19:41.717635] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-22T17:19:42.517624] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-22T17:19:42.988712] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T17:19:42.997266] [INFO ] [REMOTE ] ASPN: Full fetch complete (72607 records). [2025-10-22T17:19:42.997407] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-22T17:19:43.318233] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-22T17:19:43.401101] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-22T17:19:43.401300] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-22T17:19:43.402131] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-22T17:19:43.402210] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-22T17:19:43.414855] [DEBUG] [LOCAL ] ASPN: Trimmed 72607 records to 49875 (keeping 200 days of data) [2025-10-22T17:19:43.436759] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:19:43.724046] [DEBUG] [LOCAL ] ASPN: Primary data saved (49875 records). [2025-10-22T17:19:43.724271] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-22T17:19:43.724405] [INFO ] [MAIN ] Update Progress: 164/2367 symbols completed. ASPN took 37.9s. Estimated remaining: 4h 23m 59s. Rate: 8.3 symbols/min [2025-10-22T17:19:43.901361] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:43.921894] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T17:19:43.954449] [DEBUG] [LOCAL ] ATHM: Loaded 31322 existing records from primary storage. [2025-10-22T17:19:43.954767] [INFO ] [MAIN ] ATHM: Loaded 31322 existing records. [2025-10-22T17:19:44.126674] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-22T17:19:44.132078] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:44.133162] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-22T17:19:44.133235] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-22T17:19:44.133632] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-22T17:19:44.133747] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-22T17:19:44.527221] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:44.917787] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-22T17:19:44.959875] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T17:19:45.601150] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T17:19:45.717686] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-22T17:19:46.517731] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-22T17:19:46.815096] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T17:19:47.108104] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T17:19:47.317716] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-22T17:19:47.603338] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T17:19:48.117714] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-22T17:19:48.769091] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:19:48.917683] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-22T17:19:49.324296] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T17:19:49.717632] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-22T17:19:50.389846] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T17:19:50.517720] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-22T17:19:51.317626] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-22T17:19:51.361728] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T17:19:52.054859] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T17:19:52.117622] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-22T17:19:52.917024] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:19:52.925528] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-22T17:19:53.608588] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T17:19:53.717690] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-22T17:19:53.846723] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T17:19:54.517701] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-22T17:19:55.131534] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T17:19:55.317713] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-22T17:19:56.122727] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-22T17:19:56.140526] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T17:19:56.419572] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T17:19:56.917696] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-22T17:19:57.587419] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T17:19:57.593586] [INFO ] [REMOTE ] ATEN: Full fetch complete (56809 records). [2025-10-22T17:19:57.593784] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-22T17:19:57.722850] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-22T17:19:57.988267] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-22T17:19:57.988360] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-22T17:19:57.989039] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-22T17:19:57.989119] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-22T17:19:57.990381] [DEBUG] [LOCAL ] ATEN: Trimmed 56809 records to 37731 (keeping 200 days of data) [2025-10-22T17:19:58.239041] [DEBUG] [LOCAL ] ATEN: Primary data saved (37731 records). [2025-10-22T17:19:58.239208] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-22T17:19:58.239909] [INFO ] [MAIN ] Update Progress: 165/2367 symbols completed. ATEN took 25.2s. Estimated remaining: 4h 25m 29s. Rate: 8.3 symbols/min [2025-10-22T17:19:58.413158] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:58.422229] [DEBUG] [LOCAL ] ATHS: Loaded 6564 existing records from primary storage. [2025-10-22T17:19:58.422459] [INFO ] [MAIN ] ATHS: Loaded 6564 existing records. [2025-10-22T17:19:58.524534] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-22T17:19:58.631938] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T17:19:58.636583] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:58.636875] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-22T17:19:58.636950] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-22T17:19:58.648638] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-22T17:19:58.649117] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-22T17:19:59.007523] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:59.121005] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T17:19:59.317777] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-22T17:19:59.917141] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:20:00.117752] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-22T17:20:00.573544] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T17:20:00.917743] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-22T17:20:01.717748] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-22T17:20:01.799071] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T17:20:02.001608] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T17:20:02.517751] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-22T17:20:03.196788] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T17:20:03.317634] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-22T17:20:03.349133] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:20:04.086040] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T17:20:04.117621] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-22T17:20:04.701362] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T17:20:04.917716] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-22T17:20:05.717715] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-22T17:20:06.418868] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T17:20:06.517633] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-22T17:20:06.600556] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:20:07.240856] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T17:20:07.317696] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-22T17:20:08.117766] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-22T17:20:08.741729] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T17:20:08.917637] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-22T17:20:09.438797] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T17:20:09.447505] [INFO ] [REMOTE ] ASX: Full fetch complete (76799 records). [2025-10-22T17:20:09.447629] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-22T17:20:09.715261] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-22T17:20:09.721281] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-22T17:20:09.850287] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-22T17:20:09.850367] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-22T17:20:09.851105] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-22T17:20:09.851171] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-22T17:20:09.852565] [DEBUG] [LOCAL ] ASX: Trimmed 76799 records to 52880 (keeping 200 days of data) [2025-10-22T17:20:10.163765] [DEBUG] [LOCAL ] ASX: Primary data saved (52880 records). [2025-10-22T17:20:10.163912] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-22T17:20:10.164806] [INFO ] [MAIN ] Update Progress: 166/2367 symbols completed. ASX took 38.7s. Estimated remaining: 4h 26m 24s. Rate: 8.3 symbols/min [2025-10-22T17:20:10.338857] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:10.393007] [DEBUG] [LOCAL ] ATI: Loaded 51304 existing records from primary storage. [2025-10-22T17:20:10.393334] [INFO ] [MAIN ] ATI: Loaded 51304 existing records. [2025-10-22T17:20:10.522774] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-22T17:20:10.573330] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:10.573544] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-22T17:20:10.573593] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-22T17:20:10.573831] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-22T17:20:10.573889] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-22T17:20:10.919152] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:10.976519] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T17:20:11.140758] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-22T17:20:11.317713] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-22T17:20:12.117734] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-22T17:20:12.917708] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-22T17:20:12.932143] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T17:20:12.933522] [INFO ] [REMOTE ] ATHS: Full fetch complete (9629 records). [2025-10-22T17:20:12.933590] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-22T17:20:13.328553] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-22T17:20:13.328924] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-22T17:20:13.331091] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T17:20:13.339974] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-22T17:20:13.340181] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-22T17:20:13.341071] [DEBUG] [LOCAL ] ATHS: Trimmed 9629 records to 6496 (keeping 200 days of data) [2025-10-22T17:20:13.380118] [DEBUG] [LOCAL ] ATHS: Primary data saved (6496 records). [2025-10-22T17:20:13.380238] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-22T17:20:13.380317] [INFO ] [MAIN ] Update Progress: 167/2367 symbols completed. ATHS took 15.1s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-10-22T17:20:13.549993] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:13.581541] [DEBUG] [LOCAL ] ATKR: Loaded 34887 existing records from primary storage. [2025-10-22T17:20:13.581839] [INFO ] [MAIN ] ATKR: Loaded 34887 existing records. [2025-10-22T17:20:13.722805] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-22T17:20:13.759522] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:13.759860] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-22T17:20:13.759913] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-22T17:20:13.760168] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-22T17:20:13.760227] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-22T17:20:14.151665] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:14.163443] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T17:20:14.170182] [INFO ] [REMOTE ] ATGE: Full fetch complete (45595 records). [2025-10-22T17:20:14.170296] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-22T17:20:14.522966] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-22T17:20:14.603247] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-22T17:20:14.603333] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-22T17:20:14.603877] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-22T17:20:14.603938] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-22T17:20:14.604858] [DEBUG] [LOCAL ] ATGE: Trimmed 45595 records to 30426 (keeping 200 days of data) [2025-10-22T17:20:14.785147] [DEBUG] [LOCAL ] ATGE: Primary data saved (30426 records). [2025-10-22T17:20:14.785325] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-22T17:20:14.785414] [INFO ] [MAIN ] Update Progress: 168/2367 symbols completed. ATGE took 38.0s. Estimated remaining: 4h 24m 0s. Rate: 8.3 symbols/min [2025-10-22T17:20:14.958139] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:20:14.978177] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:15.019286] [DEBUG] [LOCAL ] ATMU: Loaded 38780 existing records from primary storage. [2025-10-22T17:20:15.019602] [INFO ] [MAIN ] ATMU: Loaded 38780 existing records. [2025-10-22T17:20:15.193008] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:15.193248] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-22T17:20:15.193304] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-22T17:20:15.193489] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-22T17:20:15.193543] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-22T17:20:15.322850] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-22T17:20:15.563751] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:16.117722] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-22T17:20:16.310366] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T17:20:16.602901] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T17:20:16.917681] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-22T17:20:17.654167] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:20:17.717710] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-22T17:20:18.517633] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-22T17:20:18.959781] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T17:20:19.317614] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-22T17:20:19.570759] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-22T17:20:20.117717] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-22T17:20:20.741771] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T17:20:20.793147] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T17:20:20.917705] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-22T17:20:21.544981] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T17:20:21.717613] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-22T17:20:22.384268] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T17:20:22.517826] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-22T17:20:22.968813] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T17:20:23.317702] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-22T17:20:24.117636] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-22T17:20:24.370792] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T17:20:24.729577] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T17:20:24.917773] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-22T17:20:25.571056] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T17:20:25.717742] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-22T17:20:26.517737] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-22T17:20:26.558038] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T17:20:27.241538] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:20:27.317708] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-22T17:20:28.098325] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T17:20:28.117620] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-22T17:20:28.442849] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T17:20:28.917746] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-22T17:20:29.717738] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-22T17:20:29.865691] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T17:20:30.465760] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T17:20:30.517702] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-22T17:20:30.745843] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T17:20:30.751071] [INFO ] [REMOTE ] ATHM: Full fetch complete (49532 records). [2025-10-22T17:20:30.751197] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-22T17:20:31.147290] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-22T17:20:31.147429] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-22T17:20:31.148163] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-22T17:20:31.148240] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-22T17:20:31.149527] [DEBUG] [LOCAL ] ATHM: Trimmed 49532 records to 31208 (keeping 200 days of data) [2025-10-22T17:20:31.324260] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-22T17:20:31.346662] [DEBUG] [LOCAL ] ATHM: Primary data saved (31208 records). [2025-10-22T17:20:31.346916] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-22T17:20:31.347008] [INFO ] [MAIN ] Update Progress: 169/2367 symbols completed. ATHM took 47.6s. Estimated remaining: 4h 25m 55s. Rate: 8.3 symbols/min [2025-10-22T17:20:31.512118] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:31.551112] [DEBUG] [LOCAL ] ATO: Loaded 41624 existing records from primary storage. [2025-10-22T17:20:31.551455] [INFO ] [MAIN ] ATO: Loaded 41624 existing records. [2025-10-22T17:20:31.721883] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:31.722088] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-22T17:20:31.722134] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-22T17:20:31.722345] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-22T17:20:31.722399] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-22T17:20:32.066290] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:32.117719] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-22T17:20:32.352834] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T17:20:32.412883] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T17:20:32.917701] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-22T17:20:33.415040] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T17:20:33.717742] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-22T17:20:34.517686] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-22T17:20:34.600838] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T17:20:34.937326] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T17:20:35.317744] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-22T17:20:35.995499] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T17:20:36.117710] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-22T17:20:36.759323] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T17:20:36.917699] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-22T17:20:37.316173] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T17:20:37.717696] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-22T17:20:38.205453] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T17:20:38.517757] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-22T17:20:39.255618] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:20:39.264257] [INFO ] [REMOTE ] ATI: Full fetch complete (74047 records). [2025-10-22T17:20:39.264418] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-22T17:20:39.322925] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-22T17:20:39.671628] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-22T17:20:39.671772] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-22T17:20:39.673151] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-22T17:20:39.673234] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-22T17:20:39.675226] [DEBUG] [LOCAL ] ATI: Trimmed 74047 records to 51283 (keeping 200 days of data) [2025-10-22T17:20:39.969367] [DEBUG] [LOCAL ] ATI: Primary data saved (51283 records). [2025-10-22T17:20:39.969494] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-22T17:20:39.970358] [INFO ] [MAIN ] Update Progress: 170/2367 symbols completed. ATI took 29.8s. Estimated remaining: 4h 26m 5s. Rate: 8.3 symbols/min [2025-10-22T17:20:40.118511] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-22T17:20:40.144955] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:40.169170] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T17:20:40.206105] [DEBUG] [LOCAL ] ATR: Loaded 30495 existing records from primary storage. [2025-10-22T17:20:40.206385] [INFO ] [MAIN ] ATR: Loaded 30495 existing records. [2025-10-22T17:20:40.389598] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:40.389844] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-22T17:20:40.389892] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-22T17:20:40.390073] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-22T17:20:40.390112] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-22T17:20:40.753127] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:40.917766] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-22T17:20:41.112724] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T17:20:41.119327] [INFO ] [REMOTE ] ATKR: Full fetch complete (53255 records). [2025-10-22T17:20:41.119489] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-22T17:20:41.530283] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-22T17:20:41.530389] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-22T17:20:41.531008] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-22T17:20:41.531077] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-22T17:20:41.532183] [DEBUG] [LOCAL ] ATKR: Trimmed 53255 records to 34853 (keeping 200 days of data) [2025-10-22T17:20:41.718834] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-22T17:20:41.743837] [DEBUG] [LOCAL ] ATKR: Primary data saved (34853 records). [2025-10-22T17:20:41.743937] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-22T17:20:41.744662] [INFO ] [MAIN ] Update Progress: 171/2367 symbols completed. ATKR took 28.4s. Estimated remaining: 4h 24m 47s. Rate: 8.3 symbols/min [2025-10-22T17:20:41.946529] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:41.974669] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T17:20:41.995053] [DEBUG] [LOCAL ] ATS: Loaded 17169 existing records from primary storage. [2025-10-22T17:20:41.995280] [INFO ] [MAIN ] ATS: Loaded 17169 existing records. [2025-10-22T17:20:42.172899] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:42.173150] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-22T17:20:42.173275] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-22T17:20:42.173482] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-22T17:20:42.173539] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-22T17:20:42.412084] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T17:20:42.526390] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-22T17:20:42.557372] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:43.317699] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-22T17:20:43.397748] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T17:20:44.042623] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:20:44.117687] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-22T17:20:44.628499] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:20:44.917696] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-22T17:20:45.601617] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T17:20:45.717692] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-22T17:20:46.357635] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T17:20:46.517730] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-22T17:20:46.861627] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T17:20:47.317776] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-22T17:20:48.012775] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T17:20:48.032954] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T17:20:48.117616] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-22T17:20:48.917724] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-22T17:20:49.055300] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T17:20:49.717731] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-22T17:20:50.400415] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T17:20:50.517638] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-22T17:20:50.759299] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T17:20:50.765586] [INFO ] [REMOTE ] ATMU: Full fetch complete (56956 records). [2025-10-22T17:20:50.765734] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-22T17:20:51.142452] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-22T17:20:51.142529] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-22T17:20:51.143119] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-22T17:20:51.143181] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-22T17:20:51.144294] [DEBUG] [LOCAL ] ATMU: Trimmed 56956 records to 38718 (keeping 200 days of data) [2025-10-22T17:20:51.341823] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-22T17:20:51.374173] [DEBUG] [LOCAL ] ATMU: Primary data saved (38718 records). [2025-10-22T17:20:51.374330] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-22T17:20:51.374429] [INFO ] [MAIN ] Update Progress: 172/2367 symbols completed. ATMU took 36.6s. Estimated remaining: 4h 25m 11s. Rate: 8.3 symbols/min [2025-10-22T17:20:51.540193] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:51.581685] [DEBUG] [LOCAL ] ATUS: Loaded 49928 existing records from primary storage. [2025-10-22T17:20:51.581995] [INFO ] [MAIN ] ATUS: Loaded 49928 existing records. [2025-10-22T17:20:51.755849] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:51.756053] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-22T17:20:51.756099] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-22T17:20:51.756487] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-22T17:20:51.756542] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-22T17:20:52.110379] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:52.122763] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-22T17:20:52.142863] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:20:52.712806] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T17:20:52.917635] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-22T17:20:53.110287] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T17:20:53.717690] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-22T17:20:54.431287] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T17:20:54.517788] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-22T17:20:54.624824] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T17:20:55.317755] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-22T17:20:56.083357] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:20:56.117717] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-22T17:20:56.891604] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T17:20:56.917700] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-22T17:20:57.464772] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T17:20:57.717627] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-22T17:20:58.405578] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T17:20:58.412373] [INFO ] [REMOTE ] ATO: Full fetch complete (60711 records). [2025-10-22T17:20:58.412538] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-22T17:20:58.522907] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-22T17:20:58.815090] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-22T17:20:58.815273] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-22T17:20:58.816021] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-22T17:20:58.821806] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-22T17:20:58.832834] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T17:20:58.840215] [DEBUG] [LOCAL ] ATO: Trimmed 60711 records to 41529 (keeping 200 days of data) [2025-10-22T17:20:59.092489] [DEBUG] [LOCAL ] ATO: Primary data saved (41529 records). [2025-10-22T17:20:59.092612] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-22T17:20:59.093427] [INFO ] [MAIN ] Update Progress: 173/2367 symbols completed. ATO took 27.7s. Estimated remaining: 4h 25m 9s. Rate: 8.3 symbols/min [2025-10-22T17:20:59.263784] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:59.311854] [DEBUG] [LOCAL ] AU: Loaded 53089 existing records from primary storage. [2025-10-22T17:20:59.312197] [INFO ] [MAIN ] AU: Loaded 53089 existing records. [2025-10-22T17:20:59.323468] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-22T17:20:59.496862] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:59.497100] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-22T17:20:59.497158] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-22T17:20:59.497900] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-22T17:20:59.497957] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-22T17:20:59.855299] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:00.117635] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-22T17:21:00.200896] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T17:21:00.342948] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T17:21:00.917724] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-22T17:21:01.231682] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T17:21:01.717776] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-22T17:21:02.517771] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-22T17:21:02.948437] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T17:21:03.120873] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-22T17:21:03.317760] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-22T17:21:03.988534] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T17:21:04.117690] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-22T17:21:04.917722] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-22T17:21:05.117914] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T17:21:05.717616] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-22T17:21:05.747753] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T17:21:06.418132] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T17:21:06.517730] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-22T17:21:07.317625] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-22T17:21:07.784272] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T17:21:07.843530] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T17:21:08.117748] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-22T17:21:08.926625] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-22T17:21:08.930037] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T17:21:09.717727] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-22T17:21:10.329612] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-22T17:21:10.517815] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-22T17:21:10.535190] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T17:21:10.540494] [INFO ] [REMOTE ] ATR: Full fetch complete (43971 records). [2025-10-22T17:21:10.540614] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-22T17:21:10.919522] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T17:21:10.979706] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-22T17:21:10.979816] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-22T17:21:10.980342] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-22T17:21:10.980403] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-22T17:21:10.981348] [DEBUG] [LOCAL ] ATR: Trimmed 43971 records to 30392 (keeping 200 days of data) [2025-10-22T17:21:11.168414] [DEBUG] [LOCAL ] ATR: Primary data saved (30392 records). [2025-10-22T17:21:11.168544] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-22T17:21:11.168620] [INFO ] [MAIN ] Update Progress: 174/2367 symbols completed. ATR took 31.2s. Estimated remaining: 4h 26m 3s. Rate: 8.2 symbols/min [2025-10-22T17:21:11.325497] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-22T17:21:11.358199] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:11.397384] [DEBUG] [LOCAL ] AUB: Loaded 45881 existing records from primary storage. [2025-10-22T17:21:11.397725] [INFO ] [MAIN ] AUB: Loaded 45881 existing records. [2025-10-22T17:21:11.568607] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:11.568846] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-22T17:21:11.568892] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-22T17:21:11.569373] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-22T17:21:11.569428] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-22T17:21:11.916956] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:12.117688] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-22T17:21:12.254618] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T17:21:12.437141] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T17:21:12.917771] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-22T17:21:13.687040] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:21:13.717718] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-22T17:21:14.517629] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-22T17:21:15.025471] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-22T17:21:15.317733] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-22T17:21:15.381786] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T17:21:16.129607] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-22T17:21:16.137049] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:21:16.917744] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-22T17:21:17.091229] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T17:21:17.093849] [INFO ] [REMOTE ] ATS: Full fetch complete (25475 records). [2025-10-22T17:21:17.093939] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-22T17:21:17.494427] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-22T17:21:17.494560] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-22T17:21:17.495032] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-22T17:21:17.495134] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-22T17:21:17.495912] [DEBUG] [LOCAL ] ATS: Trimmed 25475 records to 17012 (keeping 200 days of data) [2025-10-22T17:21:17.614768] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-22T17:21:17.648338] [DEBUG] [LOCAL ] ATS: Primary data saved (17012 records). [2025-10-22T17:21:17.648489] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-22T17:21:17.648569] [INFO ] [MAIN ] Update Progress: 175/2367 symbols completed. ATS took 35.9s. Estimated remaining: 4h 25m 46s. Rate: 8.2 symbols/min [2025-10-22T17:21:17.722727] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-22T17:21:17.831149] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:17.837272] [DEBUG] [LOCAL ] AUNA: Loaded 5226 existing records from primary storage. [2025-10-22T17:21:17.837489] [INFO ] [MAIN ] AUNA: Loaded 5226 existing records. [2025-10-22T17:21:18.024923] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:18.025281] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-22T17:21:18.025332] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-22T17:21:18.025709] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-22T17:21:18.025767] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-22T17:21:18.450273] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:21:18.449000] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:18.517761] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-22T17:21:19.317686] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-22T17:21:19.356469] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T17:21:19.579797] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T17:21:20.117712] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-22T17:21:20.917704] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-22T17:21:21.345076] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T17:21:21.717747] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-22T17:21:21.771579] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T17:21:22.346604] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T17:21:22.388251] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-22T17:21:22.517712] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-22T17:21:23.317733] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-22T17:21:24.117799] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-22T17:21:24.360020] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T17:21:24.917629] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-22T17:21:24.985960] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T17:21:25.717680] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-22T17:21:26.517633] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-22T17:21:26.623621] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-22T17:21:26.633918] [INFO ] [REMOTE ] AU: Full fetch complete (76631 records). [2025-10-22T17:21:26.634122] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-22T17:21:27.059874] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T17:21:27.094289] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-22T17:21:27.094938] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-22T17:21:27.095744] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-22T17:21:27.096185] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-22T17:21:27.097688] [DEBUG] [LOCAL ] AU: Trimmed 76631 records to 53089 (keeping 200 days of data) [2025-10-22T17:21:27.195092] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T17:21:27.320566] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-22T17:21:27.431621] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T17:21:27.442677] [INFO ] [REMOTE ] ATUS: Full fetch complete (71420 records). [2025-10-22T17:21:27.443693] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-22T17:21:27.572667] [DEBUG] [LOCAL ] AU: Primary data saved (53089 records). [2025-10-22T17:21:27.583817] [INFO ] [MAIN ] AU: Full history saved. [2025-10-22T17:21:27.600316] [INFO ] [MAIN ] Update Progress: 176/2367 symbols completed. AU took 28.5s. Estimated remaining: 4h 26m 12s. Rate: 8.2 symbols/min [2025-10-22T17:21:27.874193] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-22T17:21:28.015855] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:28.052401] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-22T17:21:28.052548] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-22T17:21:28.053509] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-22T17:21:28.053625] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-22T17:21:28.055459] [DEBUG] [LOCAL ] ATUS: Trimmed 71420 records to 49957 (keeping 200 days of data) [2025-10-22T17:21:28.134767] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-22T17:21:28.346052] [DEBUG] [LOCAL ] ATUS: Primary data saved (49957 records). [2025-10-22T17:21:28.356317] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-22T17:21:28.356447] [INFO ] [MAIN ] Update Progress: 177/2367 symbols completed. ATUS took 37.0s. Estimated remaining: 4h 24m 43s. Rate: 8.3 symbols/min [2025-10-22T17:21:28.388744] [DEBUG] [LOCAL ] AVA: Loaded 38417 existing records from primary storage. [2025-10-22T17:21:28.416875] [INFO ] [MAIN ] AVA: Loaded 38417 existing records. [2025-10-22T17:21:28.701183] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:28.734820] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:28.735052] [DEBUG] [LOCAL ] AVAL: No existing data file found in primary storage. [2025-10-22T17:21:28.735128] [WARN ] [MAIN ] AVAL: No existing data found, performing full refresh instead. [2025-10-22T17:21:28.735312] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-22T17:21:28.735427] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-22T17:21:28.735514] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-22T17:21:28.735369] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-22T17:21:28.735573] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-22T17:21:28.735708] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-22T17:21:28.788952] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-22T17:21:28.800939] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-22T17:21:28.836702] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T17:21:28.922715] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-22T17:21:29.511062] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:29.530854] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:29.717737] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-22T17:21:30.517719] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-22T17:21:30.534530] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T17:21:30.617612] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T17:21:31.284990] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T17:21:31.317688] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-22T17:21:32.062405] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T17:21:32.117613] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-22T17:21:32.917705] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-22T17:21:33.082589] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T17:21:33.422075] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T17:21:33.717638] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-22T17:21:34.517711] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-22T17:21:35.128839] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T17:21:35.317755] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-22T17:21:35.409066] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:21:36.117719] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-22T17:21:36.695364] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T17:21:36.696430] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T17:21:36.917621] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-22T17:21:37.717717] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-22T17:21:38.454023] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T17:21:38.517709] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-22T17:21:39.017148] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T17:21:39.092510] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-22T17:21:39.317687] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-22T17:21:40.117637] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-22T17:21:40.808912] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T17:21:40.917624] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-22T17:21:41.716169] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T17:21:41.724731] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-22T17:21:42.373347] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T17:21:42.517746] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-22T17:21:42.531835] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T17:21:42.533405] [INFO ] [REMOTE ] AUNA: Full fetch complete (7812 records). [2025-10-22T17:21:42.533487] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-22T17:21:42.888615] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-22T17:21:42.888761] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-22T17:21:42.889029] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-22T17:21:42.889091] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-22T17:21:42.889472] [DEBUG] [LOCAL ] AUNA: Trimmed 7812 records to 5250 (keeping 200 days of data) [2025-10-22T17:21:42.916958] [DEBUG] [LOCAL ] AUNA: Primary data saved (5250 records). [2025-10-22T17:21:42.917032] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-22T17:21:42.917103] [INFO ] [MAIN ] Update Progress: 178/2367 symbols completed. AUNA took 25.3s. Estimated remaining: 4h 26m 6s. Rate: 8.2 symbols/min [2025-10-22T17:21:43.084536] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:43.123168] [DEBUG] [LOCAL ] AVB: Loaded 42231 existing records from primary storage. [2025-10-22T17:21:43.123446] [INFO ] [MAIN ] AVB: Loaded 42231 existing records. [2025-10-22T17:21:43.235357] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T17:21:43.308572] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:43.308817] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-22T17:21:43.308863] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-22T17:21:43.309044] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-22T17:21:43.309080] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-22T17:21:43.322799] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-22T17:21:43.660606] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:44.117686] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-22T17:21:44.869494] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T17:21:44.917735] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-22T17:21:45.642057] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T17:21:45.665727] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:21:45.717616] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-22T17:21:46.517698] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-22T17:21:47.214709] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T17:21:47.317717] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-22T17:21:48.117454] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:21:48.124341] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-22T17:21:48.716266] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T17:21:48.724395] [INFO ] [REMOTE ] AUB: Full fetch complete (66390 records). [2025-10-22T17:21:48.724544] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-22T17:21:48.922737] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-22T17:21:49.120417] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-22T17:21:49.120546] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-22T17:21:49.121328] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-22T17:21:49.121391] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-22T17:21:49.122763] [DEBUG] [LOCAL ] AUB: Trimmed 66390 records to 45843 (keeping 200 days of data) [2025-10-22T17:21:49.402207] [DEBUG] [LOCAL ] AUB: Primary data saved (45843 records). [2025-10-22T17:21:49.402365] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-22T17:21:49.403473] [INFO ] [MAIN ] Update Progress: 179/2367 symbols completed. AUB took 38.2s. Estimated remaining: 4h 25m 49s. Rate: 8.2 symbols/min [2025-10-22T17:21:49.583014] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:49.583249] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-22T17:21:49.583376] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-22T17:21:49.583554] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-22T17:21:49.583620] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-22T17:21:49.583799] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-22T17:21:49.583953] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-22T17:21:49.695047] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T17:21:49.718057] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-22T17:21:49.973314] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:50.191986] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T17:21:50.517623] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-22T17:21:50.578866] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T17:21:50.704055] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:21:50.704382] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-22T17:21:50.704455] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:21:50.704496] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-22T17:21:50.704530] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:21:50.704569] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-22T17:21:50.704629] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-22T17:21:50.704744] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-22T17:21:50.704812] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-22T17:21:50.704862] [INFO ] [MAIN ] Update Progress: 180/2367 symbols completed. AVBC took 1.3s. Estimated remaining: 4h 24m 29s. Rate: 8.3 symbols/min [2025-10-22T17:21:50.881635] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:50.902462] [DEBUG] [LOCAL ] AVD: Loaded 21426 existing records from primary storage. [2025-10-22T17:21:50.902725] [INFO ] [MAIN ] AVD: Loaded 21426 existing records. [2025-10-22T17:21:51.087028] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:51.087274] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-22T17:21:51.087333] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-22T17:21:51.087509] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-22T17:21:51.087565] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-22T17:21:51.325176] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-22T17:21:51.454929] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:52.117694] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-22T17:21:52.926135] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-22T17:21:52.931247] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T17:21:53.717703] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-22T17:21:53.745749] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:21:53.796462] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T17:21:54.517721] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-22T17:21:54.760230] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T17:21:55.225848] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T17:21:55.317686] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-22T17:21:56.117712] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-22T17:21:56.917628] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-22T17:21:57.002863] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T17:21:57.654014] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:21:57.659803] [INFO ] [REMOTE ] AVA: Full fetch complete (55496 records). [2025-10-22T17:21:57.659940] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-22T17:21:57.725809] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-22T17:21:57.757937] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T17:21:57.778096] [INFO ] [REMOTE ] AVAL: Full fetch complete (15062 records). [2025-10-22T17:21:57.822320] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-22T17:21:58.377172] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-22T17:21:58.377877] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-22T17:21:58.384171] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-22T17:21:58.389490] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-22T17:21:58.464983] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-22T17:21:58.465317] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-22T17:21:58.465552] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-22T17:21:58.465629] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-22T17:21:58.465228] [DEBUG] [LOCAL ] AVA: Trimmed 55496 records to 38305 (keeping 200 days of data) [2025-10-22T17:21:58.467377] [DEBUG] [LOCAL ] AVAL: Trimmed 15062 records to 8482 (keeping 200 days of data) [2025-10-22T17:21:58.538627] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-22T17:21:58.613914] [DEBUG] [LOCAL ] AVAL: Primary data saved (8482 records). [2025-10-22T17:21:58.619984] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-22T17:21:58.620092] [INFO ] [MAIN ] Update Progress: 181/2367 symbols completed. AVAL took 30.3s. Estimated remaining: 4h 24m 30s. Rate: 8.3 symbols/min [2025-10-22T17:21:58.871811] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:58.932431] [DEBUG] [LOCAL ] AVA: Primary data saved (38305 records). [2025-10-22T17:21:58.933124] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-22T17:21:58.933280] [INFO ] [MAIN ] Update Progress: 182/2367 symbols completed. AVA took 31.3s. Estimated remaining: 4h 22m 59s. Rate: 8.3 symbols/min [2025-10-22T17:21:59.028974] [DEBUG] [LOCAL ] AVK: Loaded 18704 existing records from primary storage. [2025-10-22T17:21:59.045490] [INFO ] [MAIN ] AVK: Loaded 18704 existing records. [2025-10-22T17:21:59.205366] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:59.306369] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:59.307519] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-22T17:21:59.307608] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-22T17:21:59.307915] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-22T17:21:59.307970] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-22T17:21:59.440078] [DEBUG] [LOCAL ] AVNS: Loaded 33563 existing records from primary storage. [2025-10-22T17:21:59.451098] [INFO ] [MAIN ] AVNS: Loaded 33563 existing records. [2025-10-22T17:21:59.660698] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T17:21:59.682970] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-22T17:21:59.828279] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:59.845662] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-22T17:21:59.880417] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-22T17:21:59.887215] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-22T17:21:59.908384] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-22T17:21:59.941077] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-22T17:21:59.965315] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:00.122776] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-22T17:22:00.337902] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:00.917714] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-22T17:22:01.171007] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T17:22:01.443985] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T17:22:01.717746] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-22T17:22:02.456912] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T17:22:02.517767] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-22T17:22:02.752266] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T17:22:03.317718] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-22T17:22:03.627249] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T17:22:04.117731] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-22T17:22:04.841277] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T17:22:04.917707] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-22T17:22:04.990885] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T17:22:05.717672] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-22T17:22:05.819374] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:22:06.517742] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-22T17:22:07.206875] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T17:22:07.317741] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-22T17:22:07.331847] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T17:22:08.117708] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-22T17:22:08.379784] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T17:22:08.917753] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-22T17:22:09.536020] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T17:22:09.717709] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-22T17:22:10.099579] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T17:22:10.517758] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-22T17:22:10.851676] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T17:22:11.317726] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-22T17:22:11.637455] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T17:22:12.117703] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-22T17:22:12.455079] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T17:22:12.917691] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-22T17:22:13.099790] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T17:22:13.717699] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-22T17:22:14.517702] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-22T17:22:14.575895] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T17:22:14.794893] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T17:22:15.317752] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-22T17:22:15.732961] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T17:22:16.117632] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-22T17:22:16.416348] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T17:22:16.917727] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-22T17:22:17.493882] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T17:22:17.717758] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-22T17:22:18.063441] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T17:22:18.066452] [INFO ] [REMOTE ] AVD: Full fetch complete (32580 records). [2025-10-22T17:22:18.066532] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-22T17:22:18.431495] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-22T17:22:18.431605] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-22T17:22:18.432068] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-22T17:22:18.432140] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-22T17:22:18.433303] [DEBUG] [LOCAL ] AVD: Trimmed 32580 records to 21323 (keeping 200 days of data) [2025-10-22T17:22:18.522691] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-22T17:22:18.557208] [DEBUG] [LOCAL ] AVD: Primary data saved (21323 records). [2025-10-22T17:22:18.557333] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-22T17:22:18.557409] [INFO ] [MAIN ] Update Progress: 183/2367 symbols completed. AVD took 27.9s. Estimated remaining: 4h 25m 20s. Rate: 8.2 symbols/min [2025-10-22T17:22:18.725448] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:18.761607] [DEBUG] [LOCAL ] AVNT: Loaded 38781 existing records from primary storage. [2025-10-22T17:22:18.761906] [INFO ] [MAIN ] AVNT: Loaded 38781 existing records. [2025-10-22T17:22:18.938726] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:18.938980] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-22T17:22:18.939049] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-22T17:22:18.939240] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-22T17:22:18.939295] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-22T17:22:19.293016] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:19.317614] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-22T17:22:19.402600] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:22:19.410099] [INFO ] [REMOTE ] AVB: Full fetch complete (59416 records). [2025-10-22T17:22:19.410220] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-22T17:22:19.563552] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T17:22:19.845379] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-22T17:22:19.845452] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-22T17:22:19.846273] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-22T17:22:19.846330] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-22T17:22:19.847896] [DEBUG] [LOCAL ] AVB: Trimmed 59416 records to 42169 (keeping 200 days of data) [2025-10-22T17:22:20.107924] [DEBUG] [LOCAL ] AVB: Primary data saved (42169 records). [2025-10-22T17:22:20.108051] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-22T17:22:20.108772] [INFO ] [MAIN ] Update Progress: 184/2367 symbols completed. AVB took 37.2s. Estimated remaining: 4h 24m 4s. Rate: 8.3 symbols/min [2025-10-22T17:22:20.122854] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-22T17:22:20.278624] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:20.330244] [DEBUG] [LOCAL ] AVTR: Loaded 53572 existing records from primary storage. [2025-10-22T17:22:20.330603] [INFO ] [MAIN ] AVTR: Loaded 53572 existing records. [2025-10-22T17:22:20.503943] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:20.504124] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-22T17:22:20.504170] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-22T17:22:20.504624] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-22T17:22:20.504713] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-22T17:22:20.870338] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:20.892218] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:22:20.917624] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-22T17:22:21.637319] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T17:22:21.717745] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-22T17:22:22.517694] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-22T17:22:22.789359] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T17:22:23.203885] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T17:22:23.317744] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-22T17:22:23.706748] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T17:22:24.117735] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-22T17:22:24.721174] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T17:22:24.917750] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-22T17:22:25.240998] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T17:22:25.717956] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-22T17:22:25.920128] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T17:22:26.517720] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-22T17:22:27.280113] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T17:22:27.317605] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-22T17:22:28.097538] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T17:22:28.103442] [INFO ] [REMOTE ] AVNS: Full fetch complete (48439 records). [2025-10-22T17:22:28.103530] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-22T17:22:28.124669] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-22T17:22:28.497869] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-22T17:22:28.497969] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-22T17:22:28.498503] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-22T17:22:28.498545] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-22T17:22:28.499465] [DEBUG] [LOCAL ] AVNS: Trimmed 48439 records to 33534 (keeping 200 days of data) [2025-10-22T17:22:28.693150] [DEBUG] [LOCAL ] AVNS: Primary data saved (33534 records). [2025-10-22T17:22:28.693280] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-22T17:22:28.693357] [INFO ] [MAIN ] Update Progress: 185/2367 symbols completed. AVNS took 29.8s. Estimated remaining: 4h 24m 13s. Rate: 8.3 symbols/min [2025-10-22T17:22:28.862754] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:28.899698] [DEBUG] [LOCAL ] AVY: Loaded 38140 existing records from primary storage. [2025-10-22T17:22:28.899974] [INFO ] [MAIN ] AVY: Loaded 38140 existing records. [2025-10-22T17:22:28.931240] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-22T17:22:29.092181] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:29.092528] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-22T17:22:29.092876] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-22T17:22:29.093376] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-22T17:22:29.093587] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-22T17:22:29.172532] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:22:29.319250] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T17:22:29.510351] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:29.717927] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-22T17:22:30.488445] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T17:22:30.517708] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-22T17:22:31.304964] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T17:22:31.317613] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-22T17:22:31.951564] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T17:22:32.117717] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-22T17:22:32.626010] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:22:32.917723] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-22T17:22:33.717712] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-22T17:22:33.826900] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T17:22:34.223770] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:22:34.227549] [INFO ] [REMOTE ] AVK: Full fetch complete (26720 records). [2025-10-22T17:22:34.227619] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-22T17:22:34.518747] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-22T17:22:34.603711] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-22T17:22:34.603795] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-22T17:22:34.604186] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-22T17:22:34.604247] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-22T17:22:34.604979] [DEBUG] [LOCAL ] AVK: Trimmed 26720 records to 18618 (keeping 200 days of data) [2025-10-22T17:22:34.717563] [DEBUG] [LOCAL ] AVK: Primary data saved (18618 records). [2025-10-22T17:22:34.717764] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-22T17:22:34.717852] [INFO ] [MAIN ] Update Progress: 186/2367 symbols completed. AVK took 36.1s. Estimated remaining: 4h 23m 51s. Rate: 8.3 symbols/min [2025-10-22T17:22:34.888836] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:34.911908] [DEBUG] [LOCAL ] AWF: Loaded 24135 existing records from primary storage. [2025-10-22T17:22:34.912186] [INFO ] [MAIN ] AWF: Loaded 24135 existing records. [2025-10-22T17:22:35.102356] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:35.102663] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-22T17:22:35.102727] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-22T17:22:35.102967] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-22T17:22:35.103023] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-22T17:22:35.331359] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-22T17:22:35.423009] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:22:35.523049] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:36.121965] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-22T17:22:36.124311] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T17:22:36.917728] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-22T17:22:37.147155] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T17:22:37.421846] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T17:22:37.717704] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-22T17:22:38.293407] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T17:22:38.517707] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-22T17:22:38.904427] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T17:22:39.317688] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-22T17:22:39.836167] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T17:22:40.117684] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-22T17:22:40.635565] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T17:22:40.917694] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-22T17:22:41.605191] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T17:22:41.717638] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-22T17:22:42.113251] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T17:22:42.517802] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-22T17:22:43.317684] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-22T17:22:43.344841] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:22:43.952710] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T17:22:44.117728] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-22T17:22:44.917729] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-22T17:22:45.200007] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T17:22:45.236924] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T17:22:45.717720] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-22T17:22:46.245695] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T17:22:46.251734] [INFO ] [REMOTE ] AVNT: Full fetch complete (56095 records). [2025-10-22T17:22:46.251869] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-22T17:22:46.522888] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-22T17:22:46.678001] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-22T17:22:46.678085] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-22T17:22:46.678683] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-22T17:22:46.678744] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-22T17:22:46.679893] [DEBUG] [LOCAL ] AVNT: Trimmed 56095 records to 38618 (keeping 200 days of data) [2025-10-22T17:22:46.914153] [DEBUG] [LOCAL ] AVNT: Primary data saved (38618 records). [2025-10-22T17:22:46.914319] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-22T17:22:46.915195] [INFO ] [MAIN ] Update Progress: 187/2367 symbols completed. AVNT took 28.4s. Estimated remaining: 4h 24m 41s. Rate: 8.2 symbols/min [2025-10-22T17:22:47.085789] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:47.144181] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:22:47.157936] [DEBUG] [LOCAL ] AWI: Loaded 25268 existing records from primary storage. [2025-10-22T17:22:47.158339] [INFO ] [MAIN ] AWI: Loaded 25268 existing records. [2025-10-22T17:22:47.328134] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-22T17:22:47.334015] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:47.334304] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-22T17:22:47.334357] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-22T17:22:47.334554] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-22T17:22:47.334609] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-22T17:22:47.720363] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T17:22:47.724518] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:48.117699] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-22T17:22:48.922725] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-22T17:22:48.950480] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T17:22:49.302636] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T17:22:49.717745] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-22T17:22:50.396797] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T17:22:50.517705] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-22T17:22:50.927514] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:22:51.317694] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-22T17:22:51.924318] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T17:22:52.117695] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-22T17:22:52.593972] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T17:22:52.917720] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-22T17:22:53.450221] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T17:22:53.710784] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T17:22:53.717917] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-22T17:22:54.517759] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-22T17:22:55.329501] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-22T17:22:55.351589] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:22:55.651306] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T17:22:56.117707] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-22T17:22:56.653568] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T17:22:56.917752] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-22T17:22:57.717711] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-22T17:22:58.011770] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T17:22:58.021151] [INFO ] [REMOTE ] AVTR: Full fetch complete (77669 records). [2025-10-22T17:22:58.021313] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-22T17:22:58.429843] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T17:22:58.467624] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-22T17:22:58.467962] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-22T17:22:58.469372] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-22T17:22:58.469482] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-22T17:22:58.476832] [DEBUG] [LOCAL ] AVTR: Trimmed 77669 records to 53571 (keeping 200 days of data) [2025-10-22T17:22:58.486782] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T17:22:58.541119] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-22T17:22:58.819207] [DEBUG] [LOCAL ] AVTR: Primary data saved (53571 records). [2025-10-22T17:22:58.819363] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-22T17:22:58.820173] [INFO ] [MAIN ] Update Progress: 188/2367 symbols completed. AVTR took 38.7s. Estimated remaining: 4h 25m 27s. Rate: 8.2 symbols/min [2025-10-22T17:22:58.998836] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:59.047971] [DEBUG] [LOCAL ] AWK: Loaded 48465 existing records from primary storage. [2025-10-22T17:22:59.048327] [INFO ] [MAIN ] AWK: Loaded 48465 existing records. [2025-10-22T17:22:59.230805] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:59.231040] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-22T17:22:59.231087] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-22T17:22:59.231343] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-22T17:22:59.231397] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-22T17:22:59.322866] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-22T17:22:59.594553] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:59.803891] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T17:22:59.810065] [INFO ] [REMOTE ] AWF: Full fetch complete (36039 records). [2025-10-22T17:22:59.810279] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-22T17:23:00.125330] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-22T17:23:00.248630] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-22T17:23:00.248757] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-22T17:23:00.249207] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-22T17:23:00.249251] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-22T17:23:00.250228] [DEBUG] [LOCAL ] AWF: Trimmed 36039 records to 24048 (keeping 200 days of data) [2025-10-22T17:23:00.398989] [DEBUG] [LOCAL ] AWF: Primary data saved (24048 records). [2025-10-22T17:23:00.399139] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-22T17:23:00.399222] [INFO ] [MAIN ] Update Progress: 189/2367 symbols completed. AWF took 25.7s. Estimated remaining: 4h 24m 14s. Rate: 8.2 symbols/min [2025-10-22T17:23:00.577247] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:00.599392] [DEBUG] [LOCAL ] AWP: Loaded 21668 existing records from primary storage. [2025-10-22T17:23:00.599639] [INFO ] [MAIN ] AWP: Loaded 21668 existing records. [2025-10-22T17:23:00.782443] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:00.782782] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-22T17:23:00.782841] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-22T17:23:00.783506] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-22T17:23:00.783565] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-22T17:23:00.929164] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-22T17:23:01.190591] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:01.717807] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-22T17:23:05.999364] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (5.07 seconds). [2025-10-22T17:23:06.005939] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-22T17:23:06.029425] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (6.71 seconds). [2025-10-22T17:23:06.039481] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-22T17:23:06.086434] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (4.37 seconds). [2025-10-22T17:23:06.092364] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-22T17:23:06.629801] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (6.50 seconds). [2025-10-22T17:23:06.639435] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-22T17:23:07.119848] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T17:23:07.124030] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-22T17:23:07.221401] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T17:23:07.227439] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-22T17:23:07.425441] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T17:23:07.433901] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-22T17:23:08.239545] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T17:23:08.244448] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-22T17:23:08.546088] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T17:23:08.550860] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T17:23:08.917870] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-22T17:23:09.294849] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T17:23:09.309371] [INFO ] [REMOTE ] AVY: Full fetch complete (56702 records). [2025-10-22T17:23:09.322081] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-22T17:23:09.322855] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T17:23:09.706084] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-22T17:23:09.706160] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-22T17:23:09.706764] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-22T17:23:09.706826] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-22T17:23:09.708074] [DEBUG] [LOCAL ] AVY: Trimmed 56702 records to 38119 (keeping 200 days of data) [2025-10-22T17:23:09.765055] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-22T17:23:09.951226] [DEBUG] [LOCAL ] AVY: Primary data saved (38119 records). [2025-10-22T17:23:09.951380] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-22T17:23:09.952270] [INFO ] [MAIN ] Update Progress: 190/2367 symbols completed. AVY took 41.3s. Estimated remaining: 4h 24m 33s. Rate: 8.2 symbols/min [2025-10-22T17:23:10.122080] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:10.147157] [DEBUG] [LOCAL ] AWR: Loaded 22805 existing records from primary storage. [2025-10-22T17:23:10.147418] [INFO ] [MAIN ] AWR: Loaded 22805 existing records. [2025-10-22T17:23:10.325859] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:10.326184] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-22T17:23:10.326257] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-22T17:23:10.326600] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-22T17:23:10.326736] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-22T17:23:10.522884] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-22T17:23:10.695267] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:10.737988] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:23:10.857912] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T17:23:11.317634] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-22T17:23:11.734973] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T17:23:12.117734] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-22T17:23:12.502340] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T17:23:12.917696] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-22T17:23:13.146003] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T17:23:13.717751] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-22T17:23:14.517686] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-22T17:23:14.705554] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T17:23:15.097262] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T17:23:15.317629] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-22T17:23:15.618970] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T17:23:16.117712] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-22T17:23:16.917751] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-22T17:23:17.204448] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T17:23:17.285158] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T17:23:17.679362] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T17:23:17.717619] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-22T17:23:18.517743] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-22T17:23:18.996028] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T17:23:19.317761] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-22T17:23:20.123275] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-22T17:23:20.135102] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T17:23:20.343239] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:23:20.917691] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-22T17:23:21.270470] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T17:23:21.274924] [INFO ] [REMOTE ] AWI: Full fetch complete (36060 records). [2025-10-22T17:23:21.275016] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-22T17:23:21.646283] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-22T17:23:21.646355] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-22T17:23:21.646811] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-22T17:23:21.646873] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-22T17:23:21.647593] [DEBUG] [LOCAL ] AWI: Trimmed 36060 records to 25139 (keeping 200 days of data) [2025-10-22T17:23:21.739394] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-22T17:23:21.807800] [DEBUG] [LOCAL ] AWI: Primary data saved (25139 records). [2025-10-22T17:23:21.807935] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-22T17:23:21.808015] [INFO ] [MAIN ] Update Progress: 191/2367 symbols completed. AWI took 34.9s. Estimated remaining: 4h 25m 18s. Rate: 8.2 symbols/min [2025-10-22T17:23:21.944263] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T17:23:21.990674] [INFO ] [REMOTE ] AWP: Full fetch complete (31708 records). [2025-10-22T17:23:21.993980] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:21.994141] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-22T17:23:22.295600] [DEBUG] [LOCAL ] AX: Loaded 27940 existing records from primary storage. [2025-10-22T17:23:22.296103] [INFO ] [MAIN ] AX: Loaded 27940 existing records. [2025-10-22T17:23:22.500474] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-22T17:23:22.505755] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-22T17:23:22.543252] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-22T17:23:22.524353] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-22T17:23:22.565415] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:22.566678] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-22T17:23:22.566735] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-22T17:23:22.567004] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-22T17:23:22.567058] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-22T17:23:22.565504] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-22T17:23:22.647724] [DEBUG] [LOCAL ] AWP: Trimmed 31708 records to 21587 (keeping 200 days of data) [2025-10-22T17:23:23.040411] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:23.075016] [DEBUG] [LOCAL ] AWP: Primary data saved (21587 records). [2025-10-22T17:23:23.074316] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T17:23:23.075196] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-22T17:23:23.080087] [INFO ] [MAIN ] Update Progress: 192/2367 symbols completed. AWP took 22.7s. Estimated remaining: 4h 24m 2s. Rate: 8.2 symbols/min [2025-10-22T17:23:23.243180] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:23.243349] [DEBUG] [LOCAL ] AXL: No existing data file found in primary storage. [2025-10-22T17:23:23.243438] [WARN ] [MAIN ] AXL: No existing data found, performing full refresh instead. [2025-10-22T17:23:23.243519] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-22T17:23:23.243554] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-22T17:23:23.243594] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-10-22T17:23:23.243626] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-22T17:23:23.322740] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-22T17:23:23.599351] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:24.117762] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-22T17:23:24.596592] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-22T17:23:24.624963] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T17:23:24.917739] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-22T17:23:25.449539] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T17:23:25.717628] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-22T17:23:25.861518] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T17:23:26.517700] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-22T17:23:27.220354] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T17:23:27.317610] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-22T17:23:27.648105] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T17:23:28.117730] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-22T17:23:28.820076] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T17:23:28.917706] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-22T17:23:29.207265] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T17:23:29.717707] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-22T17:23:30.532754] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-22T17:23:30.535864] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T17:23:30.926248] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T17:23:31.317685] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-22T17:23:31.779047] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T17:23:32.117771] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-22T17:23:32.917708] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-22T17:23:33.015515] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:23:33.222083] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T17:23:33.717717] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-22T17:23:34.517629] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-22T17:23:34.607356] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T17:23:34.767758] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T17:23:35.317764] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-22T17:23:36.117683] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-22T17:23:36.145756] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:23:36.917623] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-22T17:23:37.107322] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T17:23:37.718100] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-22T17:23:37.719755] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T17:23:37.723990] [INFO ] [REMOTE ] AWR: Full fetch complete (32482 records). [2025-10-22T17:23:37.724062] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-22T17:23:38.099500] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-22T17:23:38.099596] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-22T17:23:38.100044] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-22T17:23:38.100102] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-22T17:23:38.100855] [DEBUG] [LOCAL ] AWR: Trimmed 32482 records to 22661 (keeping 200 days of data) [2025-10-22T17:23:38.232184] [DEBUG] [LOCAL ] AWR: Primary data saved (22661 records). [2025-10-22T17:23:38.232300] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-22T17:23:38.232373] [INFO ] [MAIN ] Update Progress: 193/2367 symbols completed. AWR took 28.3s. Estimated remaining: 4h 25m 23s. Rate: 8.2 symbols/min [2025-10-22T17:23:38.400440] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:38.452245] [DEBUG] [LOCAL ] AXP: Loaded 53161 existing records from primary storage. [2025-10-22T17:23:38.452572] [INFO ] [MAIN ] AXP: Loaded 53161 existing records. [2025-10-22T17:23:38.522781] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-22T17:23:38.636772] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:38.637026] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-22T17:23:38.637088] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-22T17:23:38.637288] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-22T17:23:38.637324] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-22T17:23:38.937074] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T17:23:39.003036] [INFO ] [REMOTE ] AWK: Full fetch complete (70926 records). [2025-10-22T17:23:39.023168] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:39.023791] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-22T17:23:39.324573] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-22T17:23:39.456977] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-22T17:23:39.457167] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-22T17:23:39.458130] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-22T17:23:39.458274] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-22T17:23:39.484549] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:23:39.494278] [DEBUG] [LOCAL ] AWK: Trimmed 70926 records to 48388 (keeping 200 days of data) [2025-10-22T17:23:39.736584] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T17:23:39.815561] [DEBUG] [LOCAL ] AWK: Primary data saved (48388 records). [2025-10-22T17:23:39.815718] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-22T17:23:39.816495] [INFO ] [MAIN ] Update Progress: 194/2367 symbols completed. AWK took 41.0s. Estimated remaining: 4h 24m 12s. Rate: 8.2 symbols/min [2025-10-22T17:23:39.989082] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:39.994731] [DEBUG] [LOCAL ] AXR: Loaded 2916 existing records from primary storage. [2025-10-22T17:23:39.994913] [INFO ] [MAIN ] AXR: Loaded 2916 existing records. [2025-10-22T17:23:40.122793] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-22T17:23:40.178947] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:40.179112] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-22T17:23:40.179159] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-22T17:23:40.179312] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-22T17:23:40.179368] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-22T17:23:40.527556] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:40.917733] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-22T17:23:41.344540] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T17:23:41.717730] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-22T17:23:41.925720] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T17:23:42.164271] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T17:23:42.430042] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-22T17:23:42.517702] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-22T17:23:43.015557] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T17:23:43.317703] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-22T17:23:44.117689] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-22T17:23:44.643216] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-22T17:23:44.917735] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-22T17:23:45.388927] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T17:23:45.717780] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-22T17:23:46.334384] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T17:23:46.517931] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-22T17:23:46.698963] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T17:23:47.317697] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-22T17:23:47.787094] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T17:23:48.117714] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-22T17:23:48.601969] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T17:23:48.672320] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T17:23:48.917774] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-22T17:23:49.528062] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T17:23:49.717744] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-22T17:23:50.517726] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-22T17:23:51.106167] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-22T17:23:51.317691] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-22T17:23:51.919549] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T17:23:52.000464] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-22T17:23:52.117633] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-22T17:23:52.762065] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T17:23:52.762930] [INFO ] [REMOTE ] AXR: Full fetch complete (4393 records). [2025-10-22T17:23:52.762998] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-22T17:23:52.922770] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-22T17:23:53.145450] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-22T17:23:53.145530] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-22T17:23:53.145680] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-22T17:23:53.145741] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-22T17:23:53.146112] [DEBUG] [LOCAL ] AXR: Trimmed 4393 records to 2907 (keeping 200 days of data) [2025-10-22T17:23:53.163393] [DEBUG] [LOCAL ] AXR: Primary data saved (2907 records). [2025-10-22T17:23:53.163472] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-22T17:23:53.163545] [INFO ] [MAIN ] Update Progress: 195/2367 symbols completed. AXR took 13.3s. Estimated remaining: 4h 25m 12s. Rate: 8.2 symbols/min [2025-10-22T17:23:53.328296] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:53.363875] [DEBUG] [LOCAL ] AXS: Loaded 38784 existing records from primary storage. [2025-10-22T17:23:53.364157] [INFO ] [MAIN ] AXS: Loaded 38784 existing records. [2025-10-22T17:23:53.539441] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:53.539686] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-22T17:23:53.539743] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-22T17:23:53.539978] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-22T17:23:53.540015] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-22T17:23:53.724714] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-22T17:23:53.896244] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:54.517629] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-22T17:23:54.845420] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T17:23:55.317717] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-22T17:23:55.774212] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T17:23:55.878010] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T17:23:56.117772] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-22T17:23:56.423182] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T17:23:56.917632] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-22T17:23:57.241135] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T17:23:57.717742] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-22T17:23:58.354917] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:23:58.517696] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-22T17:23:59.317616] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-22T17:23:59.485722] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T17:23:59.494403] [INFO ] [REMOTE ] AXL: Full fetch complete (73118 records). [2025-10-22T17:23:59.494555] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-22T17:23:59.890158] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-22T17:23:59.890279] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-22T17:23:59.891128] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-22T17:23:59.891272] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-22T17:23:59.914303] [DEBUG] [LOCAL ] AXL: Trimmed 73118 records to 50533 (keeping 200 days of data) [2025-10-22T17:23:59.915613] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T17:24:00.121692] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-22T17:24:00.204894] [DEBUG] [LOCAL ] AXL: Primary data saved (50533 records). [2025-10-22T17:24:00.205033] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-22T17:24:00.205106] [INFO ] [MAIN ] Update Progress: 196/2367 symbols completed. AXL took 37.1s. Estimated remaining: 4h 25m 1s. Rate: 8.2 symbols/min [2025-10-22T17:24:00.375978] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:00.421491] [DEBUG] [LOCAL ] AXTA: Loaded 52287 existing records from primary storage. [2025-10-22T17:24:00.421838] [INFO ] [MAIN ] AXTA: Loaded 52287 existing records. [2025-10-22T17:24:00.616288] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:00.616515] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-22T17:24:00.616565] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-22T17:24:00.617213] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-22T17:24:00.617286] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-22T17:24:00.919057] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-22T17:24:00.996456] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:24:01.006963] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:01.007516] [INFO ] [REMOTE ] AX: Full fetch complete (42209 records). [2025-10-22T17:24:01.007944] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-22T17:24:01.398688] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-22T17:24:01.398834] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-22T17:24:01.399367] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-22T17:24:01.399411] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-22T17:24:01.400449] [DEBUG] [LOCAL ] AX: Trimmed 42209 records to 27804 (keeping 200 days of data) [2025-10-22T17:24:01.565283] [DEBUG] [LOCAL ] AX: Primary data saved (27804 records). [2025-10-22T17:24:01.565422] [INFO ] [MAIN ] AX: Full history saved. [2025-10-22T17:24:01.565504] [INFO ] [MAIN ] Update Progress: 197/2367 symbols completed. AX took 39.8s. Estimated remaining: 4h 23m 48s. Rate: 8.2 symbols/min [2025-10-22T17:24:01.600082] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T17:24:01.717717] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-22T17:24:02.517738] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-22T17:24:03.016411] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-22T17:24:03.107108] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T17:24:03.317723] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-22T17:24:03.909955] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T17:24:04.117734] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-22T17:24:04.917692] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-22T17:24:05.566637] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-22T17:24:05.717694] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-22T17:24:05.785350] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:24:06.342528] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T17:24:06.517724] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-22T17:24:07.317757] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-22T17:24:07.831931] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T17:24:08.117708] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-22T17:24:08.156312] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T17:24:08.917916] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-22T17:24:08.922749] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T17:24:09.717687] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-22T17:24:09.967518] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T17:24:10.517755] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-22T17:24:10.602333] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:24:10.756064] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T17:24:11.317807] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-22T17:24:12.117750] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-22T17:24:13.075595] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T17:24:13.084499] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-22T17:24:13.291586] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-22T17:24:13.300395] [INFO ] [REMOTE ] AXP: Full fetch complete (77120 records). [2025-10-22T17:24:13.300536] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-22T17:24:13.701591] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-22T17:24:13.701718] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-22T17:24:13.702824] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-22T17:24:13.702990] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-22T17:24:13.731038] [DEBUG] [LOCAL ] AXP: Trimmed 77120 records to 53162 (keeping 200 days of data) [2025-10-22T17:24:13.733058] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T17:24:13.744921] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-22T17:24:14.079142] [DEBUG] [LOCAL ] AXP: Primary data saved (53162 records). [2025-10-22T17:24:14.079284] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-22T17:24:14.080285] [INFO ] [MAIN ] Update Progress: 198/2367 symbols completed. AXP took 35.8s. Estimated remaining: 4h 24m 38s. Rate: 8.2 symbols/min [2025-10-22T17:24:14.570870] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T17:24:14.577448] [INFO ] [REMOTE ] AXS: Full fetch complete (55899 records). [2025-10-22T17:24:14.577586] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-22T17:24:14.578341] [FATAL] [VALIDATOR ] AXS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:24:14.578467] [FATAL] [MAIN ] AXS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:24:14.578542] [WARN ] [MAIN ] AXS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:24:14.578627] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-22T17:24:14.578765] [DEBUG] [LOCAL ] AXS: No primary data file found to delete. [2025-10-22T17:24:14.578812] [INFO ] [LOCAL ] AXS: Starting deletion of derivative data. [2025-10-22T17:24:14.578968] [DEBUG] [LOCAL ] AXS: Deleted derivative data file. [2025-10-22T17:24:14.579555] [INFO ] [MAIN ] Update Progress: 199/2367 symbols completed. AXS took 21.4s. Estimated remaining: 4h 23m 16s. Rate: 8.2 symbols/min [2025-10-22T17:24:15.541948] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:24:15.552352] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-22T17:24:17.522766] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T17:24:17.539361] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-22T17:24:19.243751] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:24:19.254762] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-22T17:24:21.073131] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:24:21.084485] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-22T17:24:22.943633] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T17:24:22.952476] [INFO ] [REMOTE ] AXTA: Full fetch complete (75466 records). [2025-10-22T17:24:22.952610] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-22T17:24:23.356964] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-22T17:24:23.357057] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-22T17:24:23.357897] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-22T17:24:23.357971] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-22T17:24:23.359467] [DEBUG] [LOCAL ] AXTA: Trimmed 75466 records to 52290 (keeping 200 days of data) [2025-10-22T17:24:23.660628] [DEBUG] [LOCAL ] AXTA: Primary data saved (52290 records). [2025-10-22T17:24:23.660793] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-22T17:24:23.660875] [INFO ] [MAIN ] Update Progress: 200/2367 symbols completed. AXTA took 23.5s. Estimated remaining: 4h 23m 29s. Rate: 8.2 symbols/min [2025-10-22T17:24:24.258239] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:24.343452] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-22T17:24:24.361983] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:24.370364] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:24.370599] [DEBUG] [LOCAL ] AZO: No existing data file found in primary storage. [2025-10-22T17:24:24.372474] [WARN ] [MAIN ] AZO: No existing data found, performing full refresh instead. [2025-10-22T17:24:24.372373] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-22T17:24:24.374072] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-22T17:24:24.374333] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-22T17:24:24.374278] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-22T17:24:24.374444] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-22T17:24:24.389461] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-22T17:24:24.394064] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:24.394296] [DEBUG] [LOCAL ] AZO: No primary data file found to delete. [2025-10-22T17:24:24.394940] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-22T17:24:24.395011] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-22T17:24:24.720466] [DEBUG] [LOCAL ] AZZ: Loaded 22911 existing records from primary storage. [2025-10-22T17:24:24.731508] [INFO ] [MAIN ] AZZ: Loaded 22911 existing records. [2025-10-22T17:24:24.726077] [DEBUG] [LOCAL ] AYI: Loaded 24331 existing records from primary storage. [2025-10-22T17:24:24.833334] [INFO ] [MAIN ] AYI: Loaded 24331 existing records. [2025-10-22T17:24:25.410679] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:25.506916] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-22T17:24:25.563865] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:25.571544] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:25.571920] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-22T17:24:25.544234] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-22T17:24:25.572168] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-22T17:24:25.575160] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:25.576349] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-22T17:24:25.577116] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-22T17:24:25.577540] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-22T17:24:25.577727] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-22T17:24:25.577578] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-22T17:24:25.602314] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-22T17:24:26.258313] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:26.287338] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-22T17:24:26.331251] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:26.331935] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-22T17:24:26.340530] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T17:24:26.343407] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-22T17:24:26.830585] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:24:26.836597] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-22T17:24:27.035115] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:24:27.035418] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-22T17:24:27.035504] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:24:27.035575] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-22T17:24:27.035613] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:24:27.035700] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-22T17:24:27.035766] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-22T17:24:27.035805] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-22T17:24:27.035862] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-22T17:24:27.035918] [INFO ] [MAIN ] Update Progress: 201/2367 symbols completed. B took 3.4s. Estimated remaining: 4h 22m 39s. Rate: 8.2 symbols/min [2025-10-22T17:24:27.150296] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T17:24:27.170434] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-22T17:24:27.247716] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:27.301177] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-22T17:24:27.301518] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-22T17:24:27.510380] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:27.510798] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-22T17:24:27.510874] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-22T17:24:27.511113] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-22T17:24:27.511181] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-22T17:24:27.701336] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:24:27.780928] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-22T17:24:27.945665] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T17:24:27.953909] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:27.960724] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-22T17:24:27.961482] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-22T17:24:28.078510] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T17:24:28.082091] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-22T17:24:28.932968] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T17:24:28.937609] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-22T17:24:29.051579] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T17:24:29.056387] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-22T17:24:29.269398] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T17:24:29.272773] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-22T17:24:30.022461] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T17:24:30.027362] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-22T17:24:30.303777] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-22T17:24:30.314808] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-22T17:24:30.341809] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:24:30.362627] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T17:24:30.517637] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-22T17:24:30.861543] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T17:24:31.317625] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-22T17:24:31.399064] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T17:24:32.117699] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-22T17:24:32.195233] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T17:24:32.219327] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T17:24:32.917639] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-22T17:24:32.984725] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:24:33.717763] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-22T17:24:33.945457] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T17:24:34.517764] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-22T17:24:35.317625] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-22T17:24:35.758220] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T17:24:36.117734] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-22T17:24:36.179422] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-22T17:24:36.504742] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T17:24:36.917626] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-22T17:24:36.981543] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T17:24:37.717747] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-22T17:24:38.517733] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-22T17:24:38.705592] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T17:24:39.317639] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-22T17:24:39.436532] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-22T17:24:39.837622] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T17:24:40.117748] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-22T17:24:40.296230] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T17:24:40.917700] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-22T17:24:41.717638] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-22T17:24:42.025209] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T17:24:42.476700] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-22T17:24:42.517614] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-22T17:24:42.654976] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:24:42.657003] [INFO ] [REMOTE ] AZO: Full fetch complete (15896 records). [2025-10-22T17:24:42.657077] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-22T17:24:43.025119] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-22T17:24:43.025202] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-22T17:24:43.025530] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-22T17:24:43.025572] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-22T17:24:43.026167] [DEBUG] [LOCAL ] AZO: Trimmed 15896 records to 10731 (keeping 200 days of data) [2025-10-22T17:24:43.092322] [DEBUG] [LOCAL ] AZO: Primary data saved (10731 records). [2025-10-22T17:24:43.092453] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-22T17:24:43.092524] [INFO ] [MAIN ] Update Progress: 202/2367 symbols completed. AZO took 19.4s. Estimated remaining: 4h 24m 6s. Rate: 8.2 symbols/min [2025-10-22T17:24:43.262418] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:43.318248] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-22T17:24:43.318414] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-22T17:24:43.319574] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-22T17:24:43.493564] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:43.493802] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-22T17:24:43.493849] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-22T17:24:43.494063] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-22T17:24:43.494103] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-22T17:24:43.840901] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:43.979102] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T17:24:43.984079] [INFO ] [REMOTE ] AZZ: Full fetch complete (32235 records). [2025-10-22T17:24:43.984172] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-22T17:24:44.122742] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-22T17:24:44.361812] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-22T17:24:44.361890] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-22T17:24:44.362393] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-22T17:24:44.362454] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-22T17:24:44.363320] [DEBUG] [LOCAL ] AZZ: Trimmed 32235 records to 22928 (keeping 200 days of data) [2025-10-22T17:24:44.497581] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T17:24:44.527143] [DEBUG] [LOCAL ] AZZ: Primary data saved (22928 records). [2025-10-22T17:24:44.527258] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-22T17:24:44.527330] [INFO ] [MAIN ] Update Progress: 203/2367 symbols completed. AZZ took 20.9s. Estimated remaining: 4h 22m 56s. Rate: 8.2 symbols/min [2025-10-22T17:24:44.689873] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:44.739539] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-22T17:24:44.739891] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-22T17:24:44.914675] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:44.914865] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-22T17:24:44.914913] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-22T17:24:44.915150] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-22T17:24:44.915200] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-22T17:24:44.926555] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-22T17:24:45.274389] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:45.717721] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-22T17:24:46.193409] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T17:24:46.463324] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-22T17:24:46.517627] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-22T17:24:47.317726] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-22T17:24:48.117634] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-22T17:24:48.324637] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-22T17:24:48.823528] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T17:24:48.917619] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-22T17:24:48.998988] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T17:24:49.717636] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-22T17:24:49.832485] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-22T17:24:50.517707] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-22T17:24:51.317769] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-22T17:24:51.508792] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-22T17:24:51.561707] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:24:51.922948] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T17:24:52.117724] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-22T17:24:52.917683] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-22T17:24:53.437468] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-22T17:24:53.717746] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-22T17:24:54.517736] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-22T17:24:54.674280] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-22T17:24:54.865871] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T17:24:54.869748] [INFO ] [REMOTE ] AYI: Full fetch complete (36737 records). [2025-10-22T17:24:54.869828] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-22T17:24:54.870367] [FATAL] [VALIDATOR ] AYI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:24:54.870471] [FATAL] [MAIN ] AYI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:24:54.870514] [WARN ] [MAIN ] AYI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:24:54.870553] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-22T17:24:54.870609] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-10-22T17:24:54.870669] [INFO ] [LOCAL ] AYI: Starting deletion of derivative data. [2025-10-22T17:24:54.870873] [DEBUG] [LOCAL ] AYI: Deleted derivative data file. [2025-10-22T17:24:54.870961] [INFO ] [MAIN ] Update Progress: 204/2367 symbols completed. AYI took 31.2s. Estimated remaining: 4h 23m 21s. Rate: 8.2 symbols/min [2025-10-22T17:24:55.042037] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:55.092612] [DEBUG] [LOCAL ] BAH: Loaded 51653 existing records from primary storage. [2025-10-22T17:24:55.092967] [INFO ] [MAIN ] BAH: Loaded 51653 existing records. [2025-10-22T17:24:55.266463] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:55.266690] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-22T17:24:55.266747] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-22T17:24:55.267018] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-22T17:24:55.267073] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-22T17:24:55.328211] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-22T17:24:55.625915] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:55.659098] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-22T17:24:56.117731] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-22T17:24:56.239986] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T17:24:56.248844] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-22T17:24:56.248969] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-22T17:24:56.634846] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-22T17:24:56.634986] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-22T17:24:56.635802] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-22T17:24:56.635874] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-22T17:24:56.637275] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-22T17:24:56.894195] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-22T17:24:56.917617] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-22T17:24:57.000574] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-22T17:24:57.000728] [INFO ] [MAIN ] BA: Full history saved. [2025-10-22T17:24:57.000851] [INFO ] [MAIN ] Update Progress: 205/2367 symbols completed. BA took 30.0s. Estimated remaining: 4h 22m 19s. Rate: 8.2 symbols/min [2025-10-22T17:24:57.171574] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:57.207024] [DEBUG] [LOCAL ] BAK: Loaded 39479 existing records from primary storage. [2025-10-22T17:24:57.207307] [INFO ] [MAIN ] BAK: Loaded 39479 existing records. [2025-10-22T17:24:57.381853] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:57.382087] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-22T17:24:57.382155] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-22T17:24:57.382481] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-22T17:24:57.382547] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-22T17:24:57.730937] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-22T17:24:57.736240] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:57.884695] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T17:24:58.517762] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-22T17:24:59.252277] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-22T17:24:59.317700] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-22T17:25:00.117715] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-22T17:25:00.355269] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T17:25:00.474626] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-22T17:25:00.917735] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-22T17:25:01.717727] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-22T17:25:01.876265] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-22T17:25:01.913958] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:25:02.517703] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-22T17:25:02.832478] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T17:25:03.317784] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-22T17:25:04.117725] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-22T17:25:04.435071] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-22T17:25:04.791531] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-22T17:25:04.917630] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-22T17:25:05.239028] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T17:25:05.310333] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T17:25:05.717735] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-22T17:25:06.517743] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-22T17:25:07.317636] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-22T17:25:07.472585] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-22T17:25:08.117739] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-22T17:25:08.343926] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-22T17:25:08.419870] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T17:25:08.457626] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T17:25:08.917687] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-22T17:25:09.717721] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-22T17:25:10.188080] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T17:25:10.517689] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-22T17:25:10.673531] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T17:25:11.317712] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-22T17:25:12.117625] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-22T17:25:12.618905] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-22T17:25:12.757897] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-22T17:25:12.858615] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T17:25:12.917606] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-22T17:25:13.717705] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-22T17:25:13.848865] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T17:25:14.370682] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T17:25:14.517716] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-22T17:25:15.317743] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-22T17:25:15.991263] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T17:25:16.117683] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-22T17:25:16.379637] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-22T17:25:16.387980] [INFO ] [REMOTE ] BAC: Full fetch complete (77598 records). [2025-10-22T17:25:16.388104] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-22T17:25:16.388884] [FATAL] [VALIDATOR ] BAC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:25:16.388972] [FATAL] [MAIN ] BAC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:25:16.389015] [WARN ] [MAIN ] BAC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:25:16.389083] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-22T17:25:16.389147] [DEBUG] [LOCAL ] BAC: No primary data file found to delete. [2025-10-22T17:25:16.389182] [INFO ] [LOCAL ] BAC: Starting deletion of derivative data. [2025-10-22T17:25:16.389341] [DEBUG] [LOCAL ] BAC: Deleted derivative data file. [2025-10-22T17:25:16.390060] [INFO ] [MAIN ] Update Progress: 206/2367 symbols completed. BAC took 31.9s. Estimated remaining: 4h 24m 19s. Rate: 8.2 symbols/min [2025-10-22T17:25:16.559851] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:16.610862] [DEBUG] [LOCAL ] BALL: Loaded 51939 existing records from primary storage. [2025-10-22T17:25:16.611180] [INFO ] [MAIN ] BALL: Loaded 51939 existing records. [2025-10-22T17:25:16.808811] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:16.809001] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-22T17:25:16.809047] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-22T17:25:16.809410] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-22T17:25:16.809475] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-22T17:25:16.922788] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-22T17:25:17.188820] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:17.216200] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T17:25:17.677542] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T17:25:17.717694] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-22T17:25:18.517729] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-22T17:25:19.198177] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T17:25:19.281788] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-22T17:25:19.317626] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-22T17:25:20.123426] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-22T17:25:20.143616] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:25:20.788383] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T17:25:20.917751] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-22T17:25:21.717630] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-22T17:25:22.015973] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T17:25:22.517717] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-22T17:25:22.915593] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T17:25:22.923709] [INFO ] [REMOTE ] BAH: Full fetch complete (74823 records). [2025-10-22T17:25:22.923851] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-22T17:25:22.924517] [FATAL] [VALIDATOR ] BAH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:25:22.924606] [FATAL] [MAIN ] BAH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:25:22.924683] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:25:22.924756] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-22T17:25:22.924821] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-22T17:25:22.924860] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-10-22T17:25:22.924989] [DEBUG] [LOCAL ] BAH: Deleted derivative data file. [2025-10-22T17:25:22.925057] [INFO ] [MAIN ] Update Progress: 207/2367 symbols completed. BAH took 28.1s. Estimated remaining: 4h 24m 3s. Rate: 8.2 symbols/min [2025-10-22T17:25:23.096289] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:23.096470] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-22T17:25:23.096506] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-22T17:25:23.096638] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-22T17:25:23.096734] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-22T17:25:23.096787] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-22T17:25:23.096838] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-22T17:25:23.341701] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-22T17:25:23.462328] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:24.032445] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T17:25:24.039573] [INFO ] [REMOTE ] BAK: Full fetch complete (56803 records). [2025-10-22T17:25:24.039721] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-22T17:25:24.132092] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-22T17:25:24.446926] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-22T17:25:24.447086] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-22T17:25:24.447775] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-22T17:25:24.447851] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-22T17:25:24.449370] [DEBUG] [LOCAL ] BAK: Trimmed 56803 records to 39419 (keeping 200 days of data) [2025-10-22T17:25:24.670438] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-10-22T17:25:24.711447] [DEBUG] [LOCAL ] BAK: Primary data saved (39419 records). [2025-10-22T17:25:24.711585] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-22T17:25:24.711692] [INFO ] [MAIN ] Update Progress: 208/2367 symbols completed. BAK took 27.7s. Estimated remaining: 4h 22m 58s. Rate: 8.2 symbols/min [2025-10-22T17:25:24.880852] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:24.925253] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-22T17:25:24.928013] [DEBUG] [LOCAL ] BAM: Loaded 52090 existing records from primary storage. [2025-10-22T17:25:24.928401] [INFO ] [MAIN ] BAM: Loaded 52090 existing records. [2025-10-22T17:25:25.112087] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:25.112405] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-22T17:25:25.112620] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-22T17:25:25.122219] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-22T17:25:25.122398] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-22T17:25:25.195164] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-22T17:25:25.445472] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T17:25:25.530863] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:25.717720] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-22T17:25:26.171924] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T17:25:26.517725] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-22T17:25:27.317728] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-22T17:25:27.864575] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T17:25:27.899846] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-22T17:25:27.908886] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-22T17:25:27.909062] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-22T17:25:28.127138] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-22T17:25:28.332614] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-22T17:25:28.332777] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-22T17:25:28.333676] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-22T17:25:28.333861] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-22T17:25:28.362996] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-22T17:25:28.364097] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:25:28.704691] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-22T17:25:28.704846] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-22T17:25:28.704943] [INFO ] [MAIN ] Update Progress: 209/2367 symbols completed. BABA took 45.6s. Estimated remaining: 4h 22m 17s. Rate: 8.2 symbols/min [2025-10-22T17:25:28.869123] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:28.919355] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-22T17:25:28.922184] [DEBUG] [LOCAL ] BANC: Loaded 51384 existing records from primary storage. [2025-10-22T17:25:28.922632] [INFO ] [MAIN ] BANC: Loaded 51384 existing records. [2025-10-22T17:25:29.097445] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:29.097727] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-22T17:25:29.097783] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-22T17:25:29.098155] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-22T17:25:29.098209] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-22T17:25:29.469762] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:29.598682] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-22T17:25:29.717731] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-22T17:25:29.857860] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T17:25:30.386997] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T17:25:30.517738] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-22T17:25:31.317738] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-22T17:25:32.117738] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-22T17:25:32.166913] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:25:32.207006] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:25:32.917736] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-22T17:25:33.654416] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:25:33.717705] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-22T17:25:34.517630] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-22T17:25:34.687156] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:25:35.285430] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T17:25:35.313376] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T17:25:35.322535] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-22T17:25:35.982056] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T17:25:36.117717] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-22T17:25:36.917719] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-22T17:25:37.659712] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T17:25:37.717626] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-22T17:25:37.930613] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T17:25:38.517617] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-22T17:25:38.736387] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T17:25:38.739415] [INFO ] [REMOTE ] BALY: Full fetch complete (16206 records). [2025-10-22T17:25:38.739499] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-22T17:25:38.937835] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T17:25:38.938145] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:25:38.938212] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:25:38.938284] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-22T17:25:38.938349] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-22T17:25:38.938385] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-22T17:25:38.938424] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-22T17:25:38.938481] [INFO ] [MAIN ] Update Progress: 210/2367 symbols completed. BALY took 16.0s. Estimated remaining: 4h 22m 40s. Rate: 8.2 symbols/min [2025-10-22T17:25:39.122711] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:39.150989] [DEBUG] [LOCAL ] BAP: Loaded 25766 existing records from primary storage. [2025-10-22T17:25:39.151280] [INFO ] [MAIN ] BAP: Loaded 25766 existing records. [2025-10-22T17:25:39.336489] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-22T17:25:39.342428] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:39.343693] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-22T17:25:39.343758] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-22T17:25:39.343973] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-22T17:25:39.344030] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-22T17:25:39.698739] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:40.117750] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-22T17:25:40.431184] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T17:25:40.917727] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-22T17:25:41.152391] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:25:41.194820] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T17:25:41.717718] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-22T17:25:42.485299] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T17:25:42.517610] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-22T17:25:42.924756] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:25:43.317692] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-22T17:25:44.117704] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-22T17:25:44.249858] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T17:25:44.917688] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-22T17:25:44.973153] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T17:25:45.717684] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-22T17:25:45.937019] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T17:25:46.517690] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-22T17:25:46.801920] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T17:25:47.317785] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-22T17:25:47.471061] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T17:25:48.117635] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-22T17:25:48.239906] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T17:25:48.432604] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T17:25:48.917731] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-22T17:25:49.717734] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-22T17:25:49.811872] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T17:25:50.168111] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T17:25:50.517698] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-22T17:25:50.986002] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T17:25:51.317720] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-22T17:25:52.117761] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-22T17:25:52.258415] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T17:25:52.917710] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-22T17:25:52.975510] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T17:25:53.717729] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-22T17:25:53.784701] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T17:25:54.404169] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T17:25:54.517712] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-22T17:25:55.317719] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-22T17:25:55.585615] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T17:25:56.117724] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-22T17:25:56.569669] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T17:25:56.578958] [INFO ] [REMOTE ] BAM: Full fetch complete (75228 records). [2025-10-22T17:25:56.579087] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-22T17:25:56.871939] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:25:56.922866] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-22T17:25:57.002440] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-22T17:25:57.002546] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-22T17:25:57.003378] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-22T17:25:57.003450] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-22T17:25:57.004965] [DEBUG] [LOCAL ] BAM: Trimmed 75228 records to 52081 (keeping 200 days of data) [2025-10-22T17:25:57.314302] [DEBUG] [LOCAL ] BAM: Primary data saved (52081 records). [2025-10-22T17:25:57.314456] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-22T17:25:57.314534] [INFO ] [MAIN ] Update Progress: 211/2367 symbols completed. BAM took 32.6s. Estimated remaining: 4h 24m 25s. Rate: 8.2 symbols/min [2025-10-22T17:25:57.479464] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:57.517893] [DEBUG] [LOCAL ] BARK: Loaded 38230 existing records from primary storage. [2025-10-22T17:25:57.518217] [INFO ] [MAIN ] BARK: Loaded 38230 existing records. [2025-10-22T17:25:57.691278] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:57.691568] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-22T17:25:57.691625] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-22T17:25:57.691851] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-22T17:25:57.691906] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-22T17:25:57.722785] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-22T17:25:58.052100] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:58.188389] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T17:25:58.197417] [INFO ] [REMOTE ] BALL: Full fetch complete (75627 records). [2025-10-22T17:25:58.197589] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-22T17:25:58.530799] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-22T17:25:58.590498] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-22T17:25:58.590606] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-22T17:25:58.591591] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-22T17:25:58.591703] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-22T17:25:58.593126] [DEBUG] [LOCAL ] BALL: Trimmed 75627 records to 51932 (keeping 200 days of data) [2025-10-22T17:25:58.745168] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T17:25:58.949977] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T17:25:58.976470] [DEBUG] [LOCAL ] BALL: Primary data saved (51932 records). [2025-10-22T17:25:58.976599] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-22T17:25:58.977387] [INFO ] [MAIN ] Update Progress: 212/2367 symbols completed. BALL took 42.6s. Estimated remaining: 4h 23m 20s. Rate: 8.2 symbols/min [2025-10-22T17:25:59.151189] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:59.204855] [DEBUG] [LOCAL ] BAX: Loaded 53537 existing records from primary storage. [2025-10-22T17:25:59.205157] [INFO ] [MAIN ] BAX: Loaded 53537 existing records. [2025-10-22T17:25:59.322788] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-22T17:25:59.383773] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:59.384188] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-22T17:25:59.384272] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-22T17:25:59.384466] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-22T17:25:59.384506] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-22T17:25:59.745459] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:00.007910] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T17:26:00.117690] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-22T17:26:00.917712] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-22T17:26:01.200502] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T17:26:01.717737] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-22T17:26:01.874235] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T17:26:02.352153] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T17:26:02.517707] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-22T17:26:03.326605] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-22T17:26:03.332779] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T17:26:03.682396] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T17:26:04.117711] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-22T17:26:04.663153] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T17:26:04.917720] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-22T17:26:05.671056] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T17:26:05.717637] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-22T17:26:06.401434] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T17:26:06.517737] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-22T17:26:07.279524] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T17:26:07.288431] [INFO ] [REMOTE ] BANC: Full fetch complete (74632 records). [2025-10-22T17:26:07.288558] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-22T17:26:07.322735] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-22T17:26:07.698666] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-22T17:26:07.698778] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-22T17:26:07.699617] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-22T17:26:07.699707] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-22T17:26:07.701186] [DEBUG] [LOCAL ] BANC: Trimmed 74632 records to 51385 (keeping 200 days of data) [2025-10-22T17:26:07.907968] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T17:26:08.045172] [DEBUG] [LOCAL ] BANC: Primary data saved (51385 records). [2025-10-22T17:26:08.045293] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-22T17:26:08.045371] [INFO ] [MAIN ] Update Progress: 213/2367 symbols completed. BANC took 39.3s. Estimated remaining: 4h 23m 30s. Rate: 8.2 symbols/min [2025-10-22T17:26:08.122746] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-22T17:26:08.211760] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:08.259671] [DEBUG] [LOCAL ] BB: Loaded 52882 existing records from primary storage. [2025-10-22T17:26:08.260011] [INFO ] [MAIN ] BB: Loaded 52882 existing records. [2025-10-22T17:26:08.430474] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:08.430697] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-22T17:26:08.430753] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-22T17:26:08.430961] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-22T17:26:08.431017] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-22T17:26:08.774877] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:08.917620] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-22T17:26:09.269859] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T17:26:09.299213] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T17:26:09.717733] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-22T17:26:10.517740] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-22T17:26:10.566298] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T17:26:10.656758] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:26:10.661030] [INFO ] [REMOTE ] BAP: Full fetch complete (37348 records). [2025-10-22T17:26:10.661129] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-22T17:26:11.061599] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-22T17:26:11.061703] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-22T17:26:11.062225] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-22T17:26:11.062292] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-22T17:26:11.063157] [DEBUG] [LOCAL ] BAP: Trimmed 37348 records to 25563 (keeping 200 days of data) [2025-10-22T17:26:11.218476] [DEBUG] [LOCAL ] BAP: Primary data saved (25563 records). [2025-10-22T17:26:11.218601] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-22T17:26:11.218697] [INFO ] [MAIN ] Update Progress: 214/2367 symbols completed. BAP took 32.3s. Estimated remaining: 4h 22m 41s. Rate: 8.2 symbols/min [2025-10-22T17:26:11.322812] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-22T17:26:11.389858] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:11.439953] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-22T17:26:11.440269] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-22T17:26:11.617052] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:11.617274] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-22T17:26:11.617321] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-22T17:26:11.617508] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-22T17:26:11.617546] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-22T17:26:11.984190] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:12.117747] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-22T17:26:12.421176] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T17:26:12.917703] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-22T17:26:13.350690] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T17:26:13.717739] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-22T17:26:13.838419] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T17:26:14.517692] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-22T17:26:14.806202] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T17:26:15.317744] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-22T17:26:16.117740] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-22T17:26:16.370688] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:26:16.475729] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-22T17:26:16.917631] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-22T17:26:16.945173] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:26:17.698911] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T17:26:17.717615] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-22T17:26:18.517708] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-22T17:26:19.056506] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T17:26:19.166130] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-22T17:26:19.317718] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-22T17:26:20.117743] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-22T17:26:20.409368] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T17:26:20.917679] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-22T17:26:21.115472] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T17:26:21.189462] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T17:26:21.717729] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-22T17:26:22.517713] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-22T17:26:22.843733] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T17:26:23.269522] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T17:26:23.275901] [INFO ] [REMOTE ] BARK: Full fetch complete (56281 records). [2025-10-22T17:26:23.276022] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-22T17:26:23.322916] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-22T17:26:23.657080] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-22T17:26:23.657165] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-22T17:26:23.657799] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-22T17:26:23.657862] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-22T17:26:23.659023] [DEBUG] [LOCAL ] BARK: Trimmed 56281 records to 38227 (keeping 200 days of data) [2025-10-22T17:26:23.871017] [DEBUG] [LOCAL ] BARK: Primary data saved (38227 records). [2025-10-22T17:26:23.871187] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-22T17:26:23.871296] [INFO ] [MAIN ] Update Progress: 215/2367 symbols completed. BARK took 26.6s. Estimated remaining: 4h 23m 27s. Rate: 8.2 symbols/min [2025-10-22T17:26:24.035198] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:24.073764] [DEBUG] [LOCAL ] BBAR: Loaded 42660 existing records from primary storage. [2025-10-22T17:26:24.074046] [INFO ] [MAIN ] BBAR: Loaded 42660 existing records. [2025-10-22T17:26:24.137205] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-22T17:26:24.251060] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:24.251271] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-22T17:26:24.251317] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-22T17:26:24.251523] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-22T17:26:24.251577] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-22T17:26:24.610133] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:24.917696] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-22T17:26:25.139014] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-22T17:26:25.495712] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T17:26:25.717781] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-22T17:26:26.072626] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T17:26:26.517721] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-22T17:26:26.700293] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T17:26:27.317803] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-22T17:26:28.098798] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T17:26:28.117623] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-22T17:26:28.375942] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-22T17:26:28.762870] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T17:26:28.917636] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-22T17:26:29.717696] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-22T17:26:29.959404] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T17:26:30.215284] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T17:26:30.517686] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-22T17:26:31.317616] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-22T17:26:31.622192] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T17:26:31.631081] [INFO ] [REMOTE ] BAX: Full fetch complete (77620 records). [2025-10-22T17:26:31.631209] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-22T17:26:32.019804] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-22T17:26:32.019884] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-22T17:26:32.020631] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-22T17:26:32.020708] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-22T17:26:32.022154] [DEBUG] [LOCAL ] BAX: Trimmed 77620 records to 53537 (keeping 200 days of data) [2025-10-22T17:26:32.118695] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-22T17:26:32.344918] [DEBUG] [LOCAL ] BAX: Primary data saved (53537 records). [2025-10-22T17:26:32.345056] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-22T17:26:32.345818] [INFO ] [MAIN ] Update Progress: 216/2367 symbols completed. BAX took 33.4s. Estimated remaining: 4h 23m 31s. Rate: 8.2 symbols/min [2025-10-22T17:26:32.513915] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:32.564924] [DEBUG] [LOCAL ] BBD: Loaded 53271 existing records from primary storage. [2025-10-22T17:26:32.565235] [INFO ] [MAIN ] BBD: Loaded 53271 existing records. [2025-10-22T17:26:32.743507] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:32.743764] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-22T17:26:32.743844] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-22T17:26:32.744214] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-22T17:26:32.744271] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-22T17:26:33.141116] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:33.135586] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T17:26:33.141526] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-22T17:26:33.183350] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-22T17:26:33.717743] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-22T17:26:34.046204] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T17:26:34.517619] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-22T17:26:34.965211] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:26:35.008700] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T17:26:35.317710] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-22T17:26:36.117714] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-22T17:26:36.566791] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:26:36.815112] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-22T17:26:36.917689] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-22T17:26:37.717684] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-22T17:26:37.852248] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:26:38.436123] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T17:26:38.517620] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-22T17:26:39.317729] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-22T17:26:39.438793] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T17:26:40.117732] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-22T17:26:40.704073] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T17:26:40.713354] [INFO ] [REMOTE ] BB: Full fetch complete (76979 records). [2025-10-22T17:26:40.713526] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-22T17:26:40.927154] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-22T17:26:41.072793] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T17:26:41.154895] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-22T17:26:41.154977] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-22T17:26:41.155799] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-22T17:26:41.155862] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-22T17:26:41.157299] [DEBUG] [LOCAL ] BB: Trimmed 76979 records to 52882 (keeping 200 days of data) [2025-10-22T17:26:41.445222] [DEBUG] [LOCAL ] BB: Primary data saved (52882 records). [2025-10-22T17:26:41.445347] [INFO ] [MAIN ] BB: Full history saved. [2025-10-22T17:26:41.445424] [INFO ] [MAIN ] Update Progress: 217/2367 symbols completed. BB took 33.4s. Estimated remaining: 4h 23m 41s. Rate: 8.2 symbols/min [2025-10-22T17:26:41.611533] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:41.641380] [DEBUG] [LOCAL ] BBDC: Loaded 32985 existing records from primary storage. [2025-10-22T17:26:41.641667] [INFO ] [MAIN ] BBDC: Loaded 32985 existing records. [2025-10-22T17:26:41.719735] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-22T17:26:41.821426] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:41.821698] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-22T17:26:41.821756] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-22T17:26:41.821938] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-22T17:26:41.821975] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-22T17:26:42.224775] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:42.229329] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-22T17:26:42.517726] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-22T17:26:43.317704] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-22T17:26:43.424266] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T17:26:44.125679] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-22T17:26:44.176850] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T17:26:44.204117] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.28 seconds). [2025-10-22T17:26:44.640413] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T17:26:44.917695] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-22T17:26:45.717624] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-22T17:26:45.784908] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:26:45.792514] [INFO ] [REMOTE ] BBAR: Full fetch complete (61264 records). [2025-10-22T17:26:45.792723] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-22T17:26:46.173411] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-22T17:26:46.173514] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-22T17:26:46.174245] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-22T17:26:46.174316] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-22T17:26:46.175719] [DEBUG] [LOCAL ] BBAR: Trimmed 61264 records to 42605 (keeping 200 days of data) [2025-10-22T17:26:46.429590] [DEBUG] [LOCAL ] BBAR: Primary data saved (42605 records). [2025-10-22T17:26:46.429742] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-22T17:26:46.429825] [INFO ] [MAIN ] Update Progress: 218/2367 symbols completed. BBAR took 22.6s. Estimated remaining: 4h 23m 10s. Rate: 8.2 symbols/min [2025-10-22T17:26:46.526755] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-22T17:26:46.597844] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:46.604280] [DEBUG] [LOCAL ] BBDO: Loaded 4986 existing records from primary storage. [2025-10-22T17:26:46.604458] [INFO ] [MAIN ] BBDO: Loaded 4986 existing records. [2025-10-22T17:26:46.777541] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:46.777845] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-22T17:26:46.777896] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-22T17:26:46.778078] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-22T17:26:46.778134] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-22T17:26:47.157412] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:47.158469] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:26:47.317701] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-22T17:26:47.492771] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-22T17:26:48.117764] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-22T17:26:48.413028] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T17:26:48.758229] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T17:26:48.917713] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-22T17:26:49.717768] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-22T17:26:50.431493] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T17:26:50.517708] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-22T17:26:50.821286] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-22T17:26:51.126806] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T17:26:51.317761] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-22T17:26:51.412294] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T17:26:52.117782] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-22T17:26:52.297605] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T17:26:52.639184] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T17:26:52.917685] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-22T17:26:53.489124] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-22T17:26:53.717690] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-22T17:26:54.517753] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-22T17:26:55.317743] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-22T17:26:55.325433] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T17:26:56.117768] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-22T17:26:56.735499] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T17:26:56.871546] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (3.15 seconds). [2025-10-22T17:26:56.880248] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-22T17:26:56.880369] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-22T17:26:56.922792] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-22T17:26:57.189436] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T17:26:57.318351] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-22T17:26:57.318437] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-22T17:26:57.319271] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-22T17:26:57.319337] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-22T17:26:57.320900] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-22T17:26:57.629447] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-22T17:26:57.629595] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-22T17:26:57.630462] [INFO ] [MAIN ] Update Progress: 219/2367 symbols completed. BBAI took 46.4s. Estimated remaining: 4h 23m 41s. Rate: 8.1 symbols/min [2025-10-22T17:26:57.723630] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-22T17:26:57.809893] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:57.829029] [DEBUG] [LOCAL ] BBN: Loaded 17941 existing records from primary storage. [2025-10-22T17:26:57.829320] [INFO ] [MAIN ] BBN: Loaded 17941 existing records. [2025-10-22T17:26:58.017105] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:58.018071] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-22T17:26:58.018123] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-22T17:26:58.018326] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-22T17:26:58.018382] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-22T17:26:58.403880] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:58.501192] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T17:26:58.517615] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-22T17:26:59.318183] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-22T17:26:59.560033] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T17:26:59.788698] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T17:26:59.940332] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T17:27:00.117749] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-22T17:27:00.917758] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-22T17:27:01.661990] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T17:27:01.717634] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-22T17:27:02.517638] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-22T17:27:02.753888] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T17:27:02.785424] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T17:27:03.317727] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-22T17:27:03.594204] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T17:27:03.825621] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T17:27:04.117614] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-22T17:27:04.735704] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T17:27:04.917637] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-22T17:27:05.717692] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-22T17:27:06.338398] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-22T17:27:06.517726] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-22T17:27:06.886721] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T17:27:06.895248] [INFO ] [REMOTE ] BBD: Full fetch complete (76881 records). [2025-10-22T17:27:06.895414] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-22T17:27:06.896270] [FATAL] [VALIDATOR ] BBD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:27:06.896365] [FATAL] [MAIN ] BBD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:27:06.896407] [WARN ] [MAIN ] BBD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:27:06.896470] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-22T17:27:06.896537] [DEBUG] [LOCAL ] BBD: No primary data file found to delete. [2025-10-22T17:27:06.896580] [INFO ] [LOCAL ] BBD: Starting deletion of derivative data. [2025-10-22T17:27:06.896905] [DEBUG] [LOCAL ] BBD: Deleted derivative data file. [2025-10-22T17:27:06.897618] [INFO ] [MAIN ] Update Progress: 220/2367 symbols completed. BBD took 34.6s. Estimated remaining: 4h 23m 52s. Rate: 8.1 symbols/min [2025-10-22T17:27:07.077931] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:07.078115] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-22T17:27:07.078153] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-22T17:27:07.078282] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-22T17:27:07.078334] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-22T17:27:07.078410] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-22T17:27:07.078445] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-22T17:27:07.322973] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-22T17:27:07.434125] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:08.034824] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T17:27:08.040775] [INFO ] [REMOTE ] BBDC: Full fetch complete (48899 records). [2025-10-22T17:27:08.040872] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-22T17:27:08.122934] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-22T17:27:08.335613] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T17:27:08.345459] [INFO ] [REMOTE ] BBDO: Full fetch complete (7423 records). [2025-10-22T17:27:08.350813] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-22T17:27:08.528603] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-22T17:27:08.534373] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-22T17:27:08.535043] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-22T17:27:08.545382] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-22T17:27:08.681250] [DEBUG] [LOCAL ] BBDC: Trimmed 48899 records to 32835 (keeping 200 days of data) [2025-10-22T17:27:08.881569] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-22T17:27:08.886335] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-22T17:27:08.892898] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-22T17:27:08.893519] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-22T17:27:08.901478] [DEBUG] [LOCAL ] BBDO: Trimmed 7423 records to 4953 (keeping 200 days of data) [2025-10-22T17:27:08.919676] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-22T17:27:08.970726] [DEBUG] [LOCAL ] BBDO: Primary data saved (4953 records). [2025-10-22T17:27:08.976841] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-22T17:27:08.977478] [INFO ] [MAIN ] Update Progress: 221/2367 symbols completed. BBDO took 22.5s. Estimated remaining: 4h 22m 53s. Rate: 8.2 symbols/min [2025-10-22T17:27:09.168670] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:27:09.173053] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-22T17:27:09.172947] [DEBUG] [LOCAL ] BBDC: Primary data saved (32835 records). [2025-10-22T17:27:09.192977] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:27:09.193929] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:09.193044] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-22T17:27:09.194250] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-22T17:27:09.194638] [INFO ] [MAIN ] Update Progress: 222/2367 symbols completed. BBDC took 27.7s. Estimated remaining: 4h 21m 37s. Rate: 8.2 symbols/min [2025-10-22T17:27:09.203825] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:27:09.204864] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T17:27:09.203963] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-22T17:27:09.213815] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-22T17:27:09.230464] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-22T17:27:09.263980] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-22T17:27:09.272460] [INFO ] [MAIN ] Update Progress: 223/2367 symbols completed. BBT took 2.4s. Estimated remaining: 4h 20m 20s. Rate: 8.2 symbols/min [2025-10-22T17:27:09.317143] [DEBUG] [LOCAL ] BBU: Loaded 5757 existing records from primary storage. [2025-10-22T17:27:09.339686] [INFO ] [MAIN ] BBU: Loaded 5757 existing records. [2025-10-22T17:27:09.591375] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:09.661824] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:09.722400] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-22T17:27:09.740380] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:09.747343] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-22T17:27:09.747432] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-22T17:27:09.747038] [DEBUG] [LOCAL ] BBUC: Loaded 13958 existing records from primary storage. [2025-10-22T17:27:09.747776] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-22T17:27:09.747847] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-22T17:27:09.747741] [INFO ] [MAIN ] BBUC: Loaded 13958 existing records. [2025-10-22T17:27:10.064913] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:10.137791] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-22T17:27:10.160247] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-22T17:27:10.191659] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-22T17:27:10.196854] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-22T17:27:10.309894] [DEBUG] [LOCAL ] BBVA: Loaded 49122 existing records from primary storage. [2025-10-22T17:27:10.412312] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:10.409369] [INFO ] [MAIN ] BBVA: Loaded 49122 existing records. [2025-10-22T17:27:10.532348] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-22T17:27:10.761062] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:10.768461] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-22T17:27:10.773782] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-22T17:27:10.804900] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T17:27:10.805282] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-22T17:27:10.829758] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-22T17:27:10.935208] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:11.246758] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:11.317715] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-22T17:27:11.385128] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T17:27:12.117622] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-22T17:27:12.676193] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T17:27:12.919587] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-22T17:27:12.924843] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T17:27:13.717728] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-22T17:27:14.057729] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T17:27:14.517753] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-22T17:27:14.684826] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T17:27:14.926853] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-22T17:27:15.317694] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-22T17:27:15.837073] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T17:27:16.117772] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-22T17:27:16.601820] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-22T17:27:16.917687] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-22T17:27:17.392206] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T17:27:17.717724] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-22T17:27:18.517682] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-22T17:27:18.530970] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T17:27:19.180237] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-22T17:27:19.317634] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-22T17:27:20.117634] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-22T17:27:20.240216] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T17:27:20.511550] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-22T17:27:20.917701] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-22T17:27:21.717633] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-22T17:27:21.942758] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T17:27:22.517635] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-22T17:27:22.636571] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T17:27:23.302576] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T17:27:23.317604] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-22T17:27:24.117622] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-22T17:27:24.481832] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T17:27:24.917725] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-22T17:27:24.965054] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T17:27:24.967527] [INFO ] [REMOTE ] BBU: Full fetch complete (7513 records). [2025-10-22T17:27:24.967597] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-22T17:27:25.329584] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-22T17:27:25.329683] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-22T17:27:25.329898] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-22T17:27:25.329938] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-22T17:27:25.330315] [DEBUG] [LOCAL ] BBU: Trimmed 7513 records to 5773 (keeping 200 days of data) [2025-10-22T17:27:25.363375] [DEBUG] [LOCAL ] BBU: Primary data saved (5773 records). [2025-10-22T17:27:25.363451] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-22T17:27:25.363522] [INFO ] [MAIN ] Update Progress: 224/2367 symbols completed. BBU took 16.4s. Estimated remaining: 4h 21m 37s. Rate: 8.2 symbols/min [2025-10-22T17:27:25.527134] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:25.555902] [DEBUG] [LOCAL ] BBW: Loaded 27246 existing records from primary storage. [2025-10-22T17:27:25.556211] [INFO ] [MAIN ] BBW: Loaded 27246 existing records. [2025-10-22T17:27:25.730228] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-22T17:27:25.736433] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:25.736719] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-22T17:27:25.737476] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-22T17:27:25.737752] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-22T17:27:25.737809] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-22T17:27:26.024804] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T17:27:26.044766] [INFO ] [REMOTE ] BBN: Full fetch complete (25124 records). [2025-10-22T17:27:26.044874] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-22T17:27:26.221479] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:26.475999] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-22T17:27:26.476075] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-22T17:27:26.476440] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-22T17:27:26.476479] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-22T17:27:26.477117] [DEBUG] [LOCAL ] BBN: Trimmed 25124 records to 17840 (keeping 200 days of data) [2025-10-22T17:27:26.523222] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-22T17:27:26.585674] [DEBUG] [LOCAL ] BBN: Primary data saved (17840 records). [2025-10-22T17:27:26.585797] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-22T17:27:26.585874] [INFO ] [MAIN ] Update Progress: 225/2367 symbols completed. BBN took 29.0s. Estimated remaining: 4h 20m 31s. Rate: 8.2 symbols/min [2025-10-22T17:27:26.753145] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:26.801964] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-22T17:27:26.802272] [INFO ] [MAIN ] BBWI: Loaded 53591 existing records. [2025-10-22T17:27:26.971559] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:26.971805] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-22T17:27:26.971853] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-22T17:27:26.972044] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-22T17:27:26.972081] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-22T17:27:27.322865] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:27.319215] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-22T17:27:27.332835] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T17:27:27.518041] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T17:27:28.117761] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-22T17:27:28.716680] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T17:27:28.917692] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-22T17:27:29.717687] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-22T17:27:29.891815] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:27:30.476155] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:27:30.517617] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-22T17:27:30.898946] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T17:27:31.317761] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-22T17:27:32.117795] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-22T17:27:32.255392] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T17:27:32.922013] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-22T17:27:32.923686] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T17:27:33.122296] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T17:27:33.717732] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-22T17:27:34.517631] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-22T17:27:34.744043] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:27:35.317735] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-22T17:27:35.421181] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T17:27:35.843933] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T17:27:36.117873] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-22T17:27:36.285814] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T17:27:36.917639] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-22T17:27:37.671812] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T17:27:37.717725] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-22T17:27:37.981800] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T17:27:38.517725] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-22T17:27:39.317634] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-22T17:27:39.609227] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T17:27:39.958997] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T17:27:40.117704] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-22T17:27:40.917693] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-22T17:27:40.977353] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T17:27:41.070826] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T17:27:41.717714] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-22T17:27:42.517627] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-22T17:27:42.857762] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T17:27:42.886356] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:27:43.317639] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-22T17:27:43.435062] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T17:27:44.117620] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-22T17:27:44.917694] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-22T17:27:45.010131] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T17:27:45.109544] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:27:45.717593] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-22T17:27:46.272749] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T17:27:46.517733] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-22T17:27:46.646130] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T17:27:47.317623] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-22T17:27:47.621882] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T17:27:48.117722] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-22T17:27:48.917845] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-22T17:27:49.087971] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:27:49.717742] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-22T17:27:49.935952] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T17:27:50.127425] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T17:27:50.131070] [INFO ] [REMOTE ] BBUC: Full fetch complete (19315 records). [2025-10-22T17:27:50.131145] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-22T17:27:50.492914] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-22T17:27:50.493013] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-22T17:27:50.493350] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-22T17:27:50.493408] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-22T17:27:50.494011] [DEBUG] [LOCAL ] BBUC: Trimmed 19315 records to 13946 (keeping 200 days of data) [2025-10-22T17:27:50.528381] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-22T17:27:50.578625] [DEBUG] [LOCAL ] BBUC: Primary data saved (13946 records). [2025-10-22T17:27:50.578753] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-22T17:27:50.578840] [INFO ] [MAIN ] Update Progress: 226/2367 symbols completed. BBUC took 41.4s. Estimated remaining: 4h 23m 2s. Rate: 8.1 symbols/min [2025-10-22T17:27:50.743448] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:50.743613] [DEBUG] [LOCAL ] BBY: No existing data file found in primary storage. [2025-10-22T17:27:50.743676] [WARN ] [MAIN ] BBY: No existing data found, performing full refresh instead. [2025-10-22T17:27:50.743791] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-22T17:27:50.743831] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-22T17:27:50.743871] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-10-22T17:27:50.743902] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-22T17:27:51.114673] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:51.130278] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T17:27:51.317637] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-22T17:27:52.117681] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-22T17:27:52.374662] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T17:27:52.678313] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T17:27:52.917725] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-22T17:27:53.717720] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-22T17:27:54.069471] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T17:27:54.276138] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T17:27:54.284159] [INFO ] [REMOTE ] BBW: Full fetch complete (39633 records). [2025-10-22T17:27:54.284347] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-22T17:27:54.525153] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-22T17:27:54.667704] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-22T17:27:54.667795] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-22T17:27:54.668295] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-22T17:27:54.668336] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-22T17:27:54.669149] [DEBUG] [LOCAL ] BBW: Trimmed 39633 records to 27233 (keeping 200 days of data) [2025-10-22T17:27:54.825928] [DEBUG] [LOCAL ] BBW: Primary data saved (27233 records). [2025-10-22T17:27:54.826050] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-22T17:27:54.826127] [INFO ] [MAIN ] Update Progress: 227/2367 symbols completed. BBW took 29.5s. Estimated remaining: 4h 22m 25s. Rate: 8.2 symbols/min [2025-10-22T17:27:54.991750] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:55.029470] [DEBUG] [LOCAL ] BC: Loaded 43912 existing records from primary storage. [2025-10-22T17:27:55.029810] [INFO ] [MAIN ] BC: Loaded 43912 existing records. [2025-10-22T17:27:55.201941] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:55.202114] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-22T17:27:55.202160] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-22T17:27:55.202332] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-22T17:27:55.202369] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-22T17:27:55.322669] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-22T17:27:55.564443] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:55.594527] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:27:56.117743] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-22T17:27:56.273823] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T17:27:56.917736] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-22T17:27:57.485571] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-22T17:27:57.494717] [INFO ] [REMOTE ] BBWI: Full fetch complete (77631 records). [2025-10-22T17:27:57.494895] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-22T17:27:57.727090] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-22T17:27:57.900781] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-22T17:27:57.901043] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-22T17:27:57.901909] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-22T17:27:57.901992] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-22T17:27:57.929765] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T17:27:57.940046] [DEBUG] [LOCAL ] BBWI: Trimmed 77631 records to 53591 (keeping 200 days of data) [2025-10-22T17:27:58.257010] [DEBUG] [LOCAL ] BBWI: Primary data saved (53591 records). [2025-10-22T17:27:58.257136] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-22T17:27:58.260859] [INFO ] [MAIN ] Update Progress: 228/2367 symbols completed. BBWI took 31.7s. Estimated remaining: 4h 21m 41s. Rate: 8.2 symbols/min [2025-10-22T17:27:58.435102] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:58.495807] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T17:27:58.506204] [DEBUG] [LOCAL ] BCAT: Loaded 34272 existing records from primary storage. [2025-10-22T17:27:58.506927] [INFO ] [MAIN ] BCAT: Loaded 34272 existing records. [2025-10-22T17:27:58.527804] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-22T17:27:58.689467] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:58.689705] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-22T17:27:58.689763] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-22T17:27:58.689953] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-22T17:27:58.689992] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-22T17:27:59.043695] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:59.317766] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-22T17:27:59.452360] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T17:27:59.460741] [INFO ] [REMOTE ] BBVA: Full fetch complete (71926 records). [2025-10-22T17:27:59.460872] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-22T17:27:59.849556] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-22T17:27:59.849680] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-22T17:27:59.850498] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-22T17:27:59.850543] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-22T17:27:59.852024] [DEBUG] [LOCAL ] BBVA: Trimmed 71926 records to 49107 (keeping 200 days of data) [2025-10-22T17:28:00.129144] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-22T17:28:00.169038] [DEBUG] [LOCAL ] BBVA: Primary data saved (49107 records). [2025-10-22T17:28:00.169434] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-22T17:28:00.171312] [INFO ] [MAIN ] Update Progress: 229/2367 symbols completed. BBVA took 50.9s. Estimated remaining: 4h 20m 43s. Rate: 8.2 symbols/min [2025-10-22T17:28:00.171196] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:28:00.345691] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:00.372974] [DEBUG] [LOCAL ] BCC: Loaded 28741 existing records from primary storage. [2025-10-22T17:28:00.373236] [INFO ] [MAIN ] BCC: Loaded 28741 existing records. [2025-10-22T17:28:00.548415] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:00.548606] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-22T17:28:00.548680] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-22T17:28:00.548887] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-22T17:28:00.548943] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-22T17:28:00.904078] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:00.921311] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-22T17:28:00.923606] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T17:28:01.717771] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-22T17:28:02.235862] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-22T17:28:02.261842] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T17:28:02.517734] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-22T17:28:03.120085] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T17:28:03.317696] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-22T17:28:03.825937] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:28:04.117742] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-22T17:28:04.778867] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T17:28:04.917702] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-22T17:28:05.560897] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T17:28:05.717737] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-22T17:28:06.337038] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:28:06.517618] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-22T17:28:07.040628] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T17:28:07.317702] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-22T17:28:07.996974] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T17:28:08.105901] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T17:28:08.117622] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-22T17:28:08.917753] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-22T17:28:09.573261] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T17:28:09.717715] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-22T17:28:10.517719] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-22T17:28:11.043586] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T17:28:11.295615] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T17:28:11.317637] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-22T17:28:11.600508] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T17:28:12.117718] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-22T17:28:12.917682] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-22T17:28:13.229147] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T17:28:13.411170] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T17:28:13.717708] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-22T17:28:14.517739] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-22T17:28:14.640244] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:28:15.317696] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-22T17:28:15.416135] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:28:16.117726] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-22T17:28:16.186440] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:28:16.381876] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T17:28:16.917725] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-22T17:28:17.448268] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T17:28:17.717718] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-22T17:28:18.517708] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-22T17:28:18.805756] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T17:28:19.122006] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T17:28:19.317703] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-22T17:28:20.006602] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T17:28:20.117638] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-22T17:28:20.490893] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T17:28:20.917685] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-22T17:28:21.717694] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-22T17:28:21.856721] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:28:22.407630] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T17:28:22.413311] [INFO ] [REMOTE ] BCC: Full fetch complete (41624 records). [2025-10-22T17:28:22.413429] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-22T17:28:22.522729] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-22T17:28:22.798028] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-22T17:28:22.798107] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-22T17:28:22.798595] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-22T17:28:22.798635] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-22T17:28:22.799474] [DEBUG] [LOCAL ] BCC: Trimmed 41624 records to 28624 (keeping 200 days of data) [2025-10-22T17:28:22.966555] [DEBUG] [LOCAL ] BCC: Primary data saved (28624 records). [2025-10-22T17:28:22.966704] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-22T17:28:22.967395] [INFO ] [MAIN ] Update Progress: 230/2367 symbols completed. BCC took 22.8s. Estimated remaining: 4h 22m 60s. Rate: 8.1 symbols/min [2025-10-22T17:28:23.132809] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:23.182591] [DEBUG] [LOCAL ] BCE: Loaded 52267 existing records from primary storage. [2025-10-22T17:28:23.182959] [INFO ] [MAIN ] BCE: Loaded 52267 existing records. [2025-10-22T17:28:23.326881] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-22T17:28:23.373535] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:23.374152] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-22T17:28:23.374204] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-22T17:28:23.374379] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-22T17:28:23.374432] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-22T17:28:23.823131] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T17:28:23.959924] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:24.117773] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-22T17:28:24.242506] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T17:28:24.250194] [INFO ] [REMOTE ] BCAT: Full fetch complete (50104 records). [2025-10-22T17:28:24.250402] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-22T17:28:24.707163] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-22T17:28:24.707251] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-22T17:28:24.707883] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-22T17:28:24.707946] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-22T17:28:24.709018] [DEBUG] [LOCAL ] BCAT: Trimmed 50104 records to 34203 (keeping 200 days of data) [2025-10-22T17:28:24.917496] [DEBUG] [LOCAL ] BCAT: Primary data saved (34203 records). [2025-10-22T17:28:24.917691] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-22T17:28:24.918676] [INFO ] [MAIN ] Update Progress: 231/2367 symbols completed. BCAT took 26.7s. Estimated remaining: 4h 22m 2s. Rate: 8.2 symbols/min [2025-10-22T17:28:24.918774] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-22T17:28:25.106029] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:25.134234] [DEBUG] [LOCAL ] BCH: Loaded 30256 existing records from primary storage. [2025-10-22T17:28:25.134491] [INFO ] [MAIN ] BCH: Loaded 30256 existing records. [2025-10-22T17:28:25.321235] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:25.321567] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-22T17:28:25.321729] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-22T17:28:25.322091] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-22T17:28:25.322170] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-22T17:28:25.529821] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-22T17:28:25.731462] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-22T17:28:25.737462] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:26.153634] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:28:26.517622] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-22T17:28:26.627632] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T17:28:27.060570] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T17:28:27.317782] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-22T17:28:27.752281] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T17:28:28.117748] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-22T17:28:28.892695] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T17:28:28.917625] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-22T17:28:29.717701] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-22T17:28:29.789345] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:28:30.517702] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-22T17:28:30.699623] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T17:28:30.706267] [INFO ] [REMOTE ] BC: Full fetch complete (63766 records). [2025-10-22T17:28:30.706369] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-22T17:28:31.127978] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-22T17:28:31.128516] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-22T17:28:31.128978] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T17:28:31.129715] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-22T17:28:31.134847] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-22T17:28:31.136185] [DEBUG] [LOCAL ] BC: Trimmed 63766 records to 43892 (keeping 200 days of data) [2025-10-22T17:28:31.337315] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-22T17:28:31.393122] [DEBUG] [LOCAL ] BC: Primary data saved (43892 records). [2025-10-22T17:28:31.393237] [INFO ] [MAIN ] BC: Full history saved. [2025-10-22T17:28:31.393312] [INFO ] [MAIN ] Update Progress: 232/2367 symbols completed. BC took 36.6s. Estimated remaining: 4h 21m 47s. Rate: 8.2 symbols/min [2025-10-22T17:28:31.556321] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:31.578954] [DEBUG] [LOCAL ] BCO: Loaded 25135 existing records from primary storage. [2025-10-22T17:28:31.579189] [INFO ] [MAIN ] BCO: Loaded 25135 existing records. [2025-10-22T17:28:31.774270] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:31.774479] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-22T17:28:31.774526] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-22T17:28:31.774731] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-22T17:28:31.774786] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-22T17:28:32.118692] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:32.118804] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-22T17:28:32.736073] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-22T17:28:32.744816] [INFO ] [REMOTE ] BBY: Full fetch complete (77403 records). [2025-10-22T17:28:32.744928] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-22T17:28:32.919304] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-22T17:28:33.138088] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-22T17:28:33.138215] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-22T17:28:33.139218] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-22T17:28:33.139403] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-22T17:28:33.141051] [DEBUG] [LOCAL ] BBY: Trimmed 77403 records to 53437 (keeping 200 days of data) [2025-10-22T17:28:33.250573] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T17:28:33.425126] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-22T17:28:33.557336] [DEBUG] [LOCAL ] BBY: Primary data saved (53437 records). [2025-10-22T17:28:33.557457] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-22T17:28:33.557523] [INFO ] [MAIN ] Update Progress: 233/2367 symbols completed. BBY took 43.0s. Estimated remaining: 4h 20m 52s. Rate: 8.2 symbols/min [2025-10-22T17:28:33.723931] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-22T17:28:33.723867] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:33.776831] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-22T17:28:33.777138] [INFO ] [MAIN ] BCS: Loaded 53441 existing records. [2025-10-22T17:28:33.949379] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:33.949571] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-22T17:28:33.949617] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-22T17:28:33.949888] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-22T17:28:33.949938] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-22T17:28:34.301556] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:34.315175] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T17:28:34.517714] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-22T17:28:35.317688] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-22T17:28:35.445053] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:28:35.932787] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:28:36.117694] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-22T17:28:36.917634] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-22T17:28:37.240537] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T17:28:37.303815] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T17:28:37.717712] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-22T17:28:38.245785] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T17:28:38.517699] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-22T17:28:39.317737] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-22T17:28:39.588452] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T17:28:39.651151] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T17:28:40.117692] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-22T17:28:40.314719] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T17:28:40.921658] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-22T17:28:41.507952] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T17:28:41.717705] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-22T17:28:42.288967] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T17:28:42.517712] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-22T17:28:43.009585] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T17:28:43.317687] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-22T17:28:43.619348] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T17:28:44.117710] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-22T17:28:44.589529] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T17:28:44.917745] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-22T17:28:45.717715] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-22T17:28:45.906234] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T17:28:46.517693] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-22T17:28:46.628911] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T17:28:46.777540] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T17:28:47.317703] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-22T17:28:47.682826] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T17:28:48.117733] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-22T17:28:48.917693] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-22T17:28:49.101970] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T17:28:49.640834] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T17:28:49.646495] [INFO ] [REMOTE ] BCH: Full fetch complete (41931 records). [2025-10-22T17:28:49.646587] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-22T17:28:49.722758] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-22T17:28:50.011093] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-22T17:28:50.011170] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-22T17:28:50.011696] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-22T17:28:50.011756] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-22T17:28:50.012617] [DEBUG] [LOCAL ] BCH: Trimmed 41931 records to 30088 (keeping 200 days of data) [2025-10-22T17:28:50.181122] [DEBUG] [LOCAL ] BCH: Primary data saved (30088 records). [2025-10-22T17:28:50.181252] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-22T17:28:50.181328] [INFO ] [MAIN ] Update Progress: 234/2367 symbols completed. BCH took 25.3s. Estimated remaining: 4h 22m 9s. Rate: 8.1 symbols/min [2025-10-22T17:28:50.354752] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:50.383817] [DEBUG] [LOCAL ] BCSF: Loaded 28246 existing records from primary storage. [2025-10-22T17:28:50.384076] [INFO ] [MAIN ] BCSF: Loaded 28246 existing records. [2025-10-22T17:28:50.521292] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-22T17:28:50.564044] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:50.564257] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-22T17:28:50.564305] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-22T17:28:50.564537] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-22T17:28:50.564594] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-22T17:28:50.927262] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:50.993740] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T17:28:51.032311] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:28:51.317716] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-22T17:28:52.117737] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-22T17:28:52.207125] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T17:28:52.401526] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T17:28:52.917752] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-22T17:28:53.717725] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-22T17:28:54.140816] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T17:28:54.489253] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T17:28:54.517615] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-22T17:28:54.909024] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-22T17:28:55.317772] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-22T17:28:56.117776] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-22T17:28:56.196186] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:28:56.204761] [INFO ] [REMOTE ] BCE: Full fetch complete (76119 records). [2025-10-22T17:28:56.204892] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-22T17:28:56.599323] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-22T17:28:56.599425] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-22T17:28:56.600231] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-22T17:28:56.600306] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-22T17:28:56.601942] [DEBUG] [LOCAL ] BCE: Trimmed 76119 records to 52266 (keeping 200 days of data) [2025-10-22T17:28:56.916238] [DEBUG] [LOCAL ] BCE: Primary data saved (52266 records). [2025-10-22T17:28:56.916366] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-22T17:28:56.917065] [INFO ] [MAIN ] Update Progress: 235/2367 symbols completed. BCE took 33.9s. Estimated remaining: 4h 21m 56s. Rate: 8.1 symbols/min [2025-10-22T17:28:56.928579] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-22T17:28:57.089033] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:57.112185] [DEBUG] [LOCAL ] BCX: Loaded 22127 existing records from primary storage. [2025-10-22T17:28:57.112432] [INFO ] [MAIN ] BCX: Loaded 22127 existing records. [2025-10-22T17:28:57.294413] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:57.294720] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-22T17:28:57.294799] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-22T17:28:57.295070] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-22T17:28:57.295139] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-22T17:28:57.484411] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T17:28:57.531666] [INFO ] [REMOTE ] BCO: Full fetch complete (36158 records). [2025-10-22T17:28:57.564513] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-22T17:28:57.587572] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-22T17:28:57.729798] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-22T17:28:57.840792] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:58.108081] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T17:28:58.107508] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-22T17:28:58.112503] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-22T17:28:58.113295] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-22T17:28:58.113349] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-22T17:28:58.114128] [DEBUG] [LOCAL ] BCO: Trimmed 36158 records to 24959 (keeping 200 days of data) [2025-10-22T17:28:58.259148] [DEBUG] [LOCAL ] BCO: Primary data saved (24959 records). [2025-10-22T17:28:58.259269] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-22T17:28:58.259345] [INFO ] [MAIN ] Update Progress: 236/2367 symbols completed. BCO took 26.9s. Estimated remaining: 4h 20m 54s. Rate: 8.2 symbols/min [2025-10-22T17:28:58.428907] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:58.453690] [DEBUG] [LOCAL ] BDC: Loaded 24193 existing records from primary storage. [2025-10-22T17:28:58.453990] [INFO ] [MAIN ] BDC: Loaded 24193 existing records. [2025-10-22T17:28:58.526720] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-22T17:28:58.630147] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:58.630362] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-22T17:28:58.630408] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-22T17:28:58.630735] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-22T17:28:58.630790] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-22T17:28:58.978077] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:59.317719] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-22T17:28:59.675426] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T17:28:59.892457] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:29:00.117712] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-22T17:29:00.545051] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T17:29:00.917733] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-22T17:29:01.453707] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:29:01.668081] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T17:29:01.717745] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-22T17:29:02.517746] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-22T17:29:02.996545] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T17:29:03.317703] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-22T17:29:04.117728] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-22T17:29:04.572885] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T17:29:04.656604] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T17:29:04.917726] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-22T17:29:05.176958] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T17:29:05.717686] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-22T17:29:06.015259] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T17:29:06.517722] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-22T17:29:06.943161] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:29:07.317702] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-22T17:29:08.117742] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-22T17:29:08.282207] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T17:29:08.404026] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T17:29:08.917627] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-22T17:29:09.228010] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T17:29:09.717695] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-22T17:29:10.111880] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T17:29:10.517693] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-22T17:29:10.871822] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T17:29:11.317701] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-22T17:29:11.931331] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T17:29:12.117630] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-22T17:29:12.507453] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T17:29:12.782562] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T17:29:12.917635] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-22T17:29:13.717814] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-22T17:29:14.052271] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T17:29:14.517715] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-22T17:29:14.674803] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T17:29:15.317692] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-22T17:29:16.117725] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-22T17:29:16.602542] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T17:29:16.628297] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T17:29:16.917711] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-22T17:29:17.262581] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T17:29:17.717685] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-22T17:29:17.958031] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T17:29:18.517695] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-22T17:29:18.972229] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T17:29:18.978146] [INFO ] [REMOTE ] BCSF: Full fetch complete (39762 records). [2025-10-22T17:29:18.978242] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-22T17:29:19.339872] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-22T17:29:19.356524] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-22T17:29:19.356608] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-22T17:29:19.357145] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-22T17:29:19.357205] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-22T17:29:19.358109] [DEBUG] [LOCAL ] BCSF: Trimmed 39762 records to 28115 (keeping 200 days of data) [2025-10-22T17:29:19.524770] [DEBUG] [LOCAL ] BCSF: Primary data saved (28115 records). [2025-10-22T17:29:19.524907] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-22T17:29:19.524986] [INFO ] [MAIN ] Update Progress: 237/2367 symbols completed. BCSF took 29.3s. Estimated remaining: 4h 22m 52s. Rate: 8.1 symbols/min [2025-10-22T17:29:19.547811] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:29:20.117736] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-22T17:29:20.917686] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-22T17:29:21.428293] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:29:21.444869] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-22T17:29:21.458337] [INFO ] [REMOTE ] BCS: Full fetch complete (77523 records). [2025-10-22T17:29:21.458464] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-22T17:29:21.724413] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-22T17:29:21.846009] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-22T17:29:21.846091] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-22T17:29:21.846887] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-22T17:29:21.846950] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-22T17:29:21.848356] [DEBUG] [LOCAL ] BCS: Trimmed 77523 records to 53441 (keeping 200 days of data) [2025-10-22T17:29:22.104097] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T17:29:22.164684] [INFO ] [REMOTE ] BCX: Full fetch complete (33688 records). [2025-10-22T17:29:22.182464] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-22T17:29:22.309829] [DEBUG] [LOCAL ] BCS: Primary data saved (53441 records). [2025-10-22T17:29:22.320581] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-22T17:29:22.331739] [INFO ] [MAIN ] Update Progress: 238/2367 symbols completed. BCS took 48.8s. Estimated remaining: 4h 22m 3s. Rate: 8.1 symbols/min [2025-10-22T17:29:22.622140] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-22T17:29:22.622226] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-22T17:29:22.622840] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-22T17:29:22.622904] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-22T17:29:22.623702] [DEBUG] [LOCAL ] BCX: Trimmed 33688 records to 22044 (keeping 200 days of data) [2025-10-22T17:29:22.765284] [DEBUG] [LOCAL ] BCX: Primary data saved (22044 records). [2025-10-22T17:29:22.765524] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-22T17:29:22.765795] [INFO ] [MAIN ] Update Progress: 239/2367 symbols completed. BCX took 25.8s. Estimated remaining: 4h 20m 54s. Rate: 8.2 symbols/min [2025-10-22T17:29:22.780773] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T17:29:22.786337] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-22T17:29:23.830283] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:29:23.835444] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-22T17:29:25.266966] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T17:29:25.270927] [INFO ] [REMOTE ] BDC: Full fetch complete (35786 records). [2025-10-22T17:29:25.271012] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-22T17:29:25.631817] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-22T17:29:25.631897] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-22T17:29:25.632357] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-22T17:29:25.632397] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-22T17:29:25.633237] [DEBUG] [LOCAL ] BDC: Trimmed 35786 records to 24000 (keeping 200 days of data) [2025-10-22T17:29:25.777060] [DEBUG] [LOCAL ] BDC: Primary data saved (24000 records). [2025-10-22T17:29:25.777192] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-22T17:29:25.777274] [INFO ] [MAIN ] Update Progress: 240/2367 symbols completed. BDC took 27.5s. Estimated remaining: 4h 20m 8s. Rate: 8.2 symbols/min [2025-10-22T17:29:26.429780] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:26.469477] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:26.463106] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:26.472771] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-10-22T17:29:26.494436] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:26.494529] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-10-22T17:29:26.495082] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-22T17:29:26.495131] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-22T17:29:26.495265] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-22T17:29:26.495311] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-22T17:29:26.676440] [DEBUG] [LOCAL ] BDJ: Loaded 29386 existing records from primary storage. [2025-10-22T17:29:26.748892] [INFO ] [MAIN ] BDJ: Loaded 29386 existing records. [2025-10-22T17:29:26.918412] [DEBUG] [LOCAL ] BDN: Loaded 47633 existing records from primary storage. [2025-10-22T17:29:26.939353] [INFO ] [MAIN ] BDN: Loaded 47633 existing records. [2025-10-22T17:29:27.036939] [DEBUG] [LOCAL ] BDX: Loaded 52157 existing records from primary storage. [2025-10-22T17:29:27.088524] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:27.114701] [INFO ] [MAIN ] BDX: Loaded 52157 existing records. [2025-10-22T17:29:27.128225] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-22T17:29:27.268006] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:29:27.308778] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-22T17:29:27.314128] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-22T17:29:27.420799] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:29:27.421218] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-22T17:29:27.432195] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-22T17:29:27.437581] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-22T17:29:27.437727] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-22T17:29:27.448492] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-22T17:29:27.462180] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-22T17:29:27.517172] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:29:27.589958] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-22T17:29:27.607351] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-22T17:29:27.681252] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-22T17:29:27.704496] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-22T17:29:28.485277] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:28.582420] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-22T17:29:28.628063] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:28.641544] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-22T17:29:28.739164] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:28.739596] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-22T17:29:29.405780] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-22T17:29:29.416787] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-22T17:29:30.105602] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T17:29:30.112054] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-22T17:29:30.429876] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T17:29:30.439358] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-22T17:29:30.569709] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T17:29:30.579943] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-22T17:29:30.987403] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:29:30.998217] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-22T17:29:31.323342] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:29:31.332280] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-22T17:29:31.917754] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T17:29:32.028180] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T17:29:32.117734] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-22T17:29:32.365639] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T17:29:32.618253] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T17:29:32.917723] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-22T17:29:33.717716] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-22T17:29:33.824573] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:29:34.367582] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:29:34.517732] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-22T17:29:35.317721] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-22T17:29:35.761257] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T17:29:36.130209] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-22T17:29:36.132828] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T17:29:36.917620] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-22T17:29:37.120877] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T17:29:37.309288] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T17:29:37.717718] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-22T17:29:38.517779] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-22T17:29:39.015488] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T17:29:39.317680] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-22T17:29:39.623126] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T17:29:40.115888] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T17:29:40.121083] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-22T17:29:40.917731] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-22T17:29:41.196782] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T17:29:41.717755] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-22T17:29:41.965434] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T17:29:42.517695] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-22T17:29:42.794291] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T17:29:43.317618] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-22T17:29:43.581729] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T17:29:44.008779] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T17:29:44.117704] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-22T17:29:44.917632] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-22T17:29:45.231622] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T17:29:45.717815] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-22T17:29:45.854122] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T17:29:45.913496] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T17:29:46.517706] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-22T17:29:47.322851] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-22T17:29:47.338725] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T17:29:48.117717] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-22T17:29:48.557161] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T17:29:48.733088] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-22T17:29:48.917698] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-22T17:29:49.717732] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-22T17:29:49.850124] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:29:50.328176] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T17:29:50.333282] [INFO ] [REMOTE ] BDJ: Full fetch complete (42899 records). [2025-10-22T17:29:50.333364] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-22T17:29:50.528526] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-22T17:29:50.701262] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-22T17:29:50.701333] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-22T17:29:50.701862] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-22T17:29:50.701924] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-22T17:29:50.702755] [DEBUG] [LOCAL ] BDJ: Trimmed 42899 records to 29333 (keeping 200 days of data) [2025-10-22T17:29:50.866505] [DEBUG] [LOCAL ] BDJ: Primary data saved (29333 records). [2025-10-22T17:29:50.866626] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-22T17:29:50.866736] [INFO ] [MAIN ] Update Progress: 241/2367 symbols completed. BDJ took 25.1s. Estimated remaining: 4h 22m 37s. Rate: 8.1 symbols/min [2025-10-22T17:29:51.035590] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:51.035766] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-22T17:29:51.035812] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-22T17:29:51.035924] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-22T17:29:51.035966] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-22T17:29:51.036008] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-22T17:29:51.036041] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-22T17:29:51.322821] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-22T17:29:51.383933] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:52.117753] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-22T17:29:52.203963] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:29:52.339620] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-22T17:29:52.689471] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T17:29:52.917724] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-22T17:29:53.417752] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-22T17:29:53.425766] [INFO ] [REMOTE ] BDX: Full fetch complete (75481 records). [2025-10-22T17:29:53.425895] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-22T17:29:53.718310] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-22T17:29:53.814263] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-22T17:29:53.814346] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-22T17:29:53.815123] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-22T17:29:53.815187] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-22T17:29:53.816570] [DEBUG] [LOCAL ] BDX: Trimmed 75481 records to 52141 (keeping 200 days of data) [2025-10-22T17:29:54.133777] [DEBUG] [LOCAL ] BDX: Primary data saved (52141 records). [2025-10-22T17:29:54.133911] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-22T17:29:54.134912] [INFO ] [MAIN ] Update Progress: 242/2367 symbols completed. BDX took 28.3s. Estimated remaining: 4h 21m 54s. Rate: 8.1 symbols/min [2025-10-22T17:29:54.300404] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:54.352257] [DEBUG] [LOCAL ] BEKE: Loaded 53198 existing records from primary storage. [2025-10-22T17:29:54.352549] [INFO ] [MAIN ] BEKE: Loaded 53198 existing records. [2025-10-22T17:29:54.524546] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:29:54.521066] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-22T17:29:54.525477] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-22T17:29:54.525534] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-22T17:29:54.525769] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-22T17:29:54.525824] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-22T17:29:54.867722] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:54.923621] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T17:29:55.317636] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-22T17:29:55.414525] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T17:29:55.654467] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-22T17:29:55.663255] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-22T17:29:55.663391] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-22T17:29:56.044523] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-22T17:29:56.044596] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-22T17:29:56.045425] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-22T17:29:56.045487] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-22T17:29:56.046890] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 53661 (keeping 200 days of data) [2025-10-22T17:29:56.131167] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-22T17:29:56.357561] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-22T17:29:56.357748] [INFO ] [MAIN ] BE: Full history saved. [2025-10-22T17:29:56.357833] [INFO ] [MAIN ] Update Progress: 243/2367 symbols completed. BE took 30.6s. Estimated remaining: 4h 21m 1s. Rate: 8.1 symbols/min [2025-10-22T17:29:56.522810] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:56.568837] [DEBUG] [LOCAL ] BEN: Loaded 53118 existing records from primary storage. [2025-10-22T17:29:56.569135] [INFO ] [MAIN ] BEN: Loaded 53118 existing records. [2025-10-22T17:29:56.747032] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:29:56.747340] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-22T17:29:56.747399] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-22T17:29:56.747686] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-22T17:29:56.747742] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-22T17:29:56.926725] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-22T17:29:57.114425] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:57.143328] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T17:29:57.330546] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T17:29:57.420747] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T17:29:57.717695] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-22T17:29:58.517686] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-22T17:29:59.317628] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-22T17:29:59.653739] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T17:30:00.117696] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-22T17:30:00.318910] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T17:30:00.640591] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T17:30:00.917621] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-22T17:30:01.398462] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T17:30:01.717759] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-22T17:30:02.517741] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-22T17:30:03.317738] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-22T17:30:03.539277] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T17:30:03.542706] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-22T17:30:03.550339] [INFO ] [REMOTE ] BDN: Full fetch complete (69070 records). [2025-10-22T17:30:03.550440] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-22T17:30:03.551107] [FATAL] [VALIDATOR ] BDN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:30:03.551191] [FATAL] [MAIN ] BDN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:30:03.551234] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:30:03.551302] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-22T17:30:03.551368] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-10-22T17:30:03.551403] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-10-22T17:30:03.551553] [DEBUG] [LOCAL ] BDN: Deleted derivative data file. [2025-10-22T17:30:03.551674] [INFO ] [MAIN ] Update Progress: 244/2367 symbols completed. BDN took 37.8s. Estimated remaining: 4h 20m 52s. Rate: 8.1 symbols/min [2025-10-22T17:30:03.716592] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:03.754171] [DEBUG] [LOCAL ] BEP: Loaded 38965 existing records from primary storage. [2025-10-22T17:30:03.754508] [INFO ] [MAIN ] BEP: Loaded 38965 existing records. [2025-10-22T17:30:03.944273] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:03.944618] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-22T17:30:03.944802] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-22T17:30:03.945101] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-22T17:30:03.945162] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-22T17:30:04.117720] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-22T17:30:04.283583] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-22T17:30:04.367876] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:04.705973] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T17:30:04.917694] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-22T17:30:05.729921] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-22T17:30:05.739307] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-22T17:30:06.517743] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-22T17:30:06.844914] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-22T17:30:07.317732] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-22T17:30:07.620886] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-22T17:30:08.117612] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-22T17:30:08.386469] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (3.47 seconds). [2025-10-22T17:30:08.459193] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-22T17:30:08.487630] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-22T17:30:08.917683] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-22T17:30:09.554216] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T17:30:09.555079] [INFO ] [REMOTE ] BEDU: Full fetch complete (1330 records). [2025-10-22T17:30:09.555146] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-22T17:30:09.717952] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-22T17:30:09.730948] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-22T17:30:09.731869] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:30:09.731946] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:30:09.732020] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-22T17:30:09.732078] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-22T17:30:09.732113] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-22T17:30:09.732152] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-22T17:30:09.732205] [INFO ] [MAIN ] Update Progress: 245/2367 symbols completed. BEDU took 18.9s. Estimated remaining: 4h 20m 34s. Rate: 8.1 symbols/min [2025-10-22T17:30:09.902225] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:09.941872] [DEBUG] [LOCAL ] BEPC: Loaded 46391 existing records from primary storage. [2025-10-22T17:30:09.942257] [INFO ] [MAIN ] BEPC: Loaded 46391 existing records. [2025-10-22T17:30:10.141169] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:10.141388] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-22T17:30:10.141434] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-22T17:30:10.141795] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-22T17:30:10.142068] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-22T17:30:10.492967] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:10.517626] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-22T17:30:11.317787] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-22T17:30:11.887226] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T17:30:11.948754] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-22T17:30:12.117716] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-22T17:30:12.884161] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:30:12.917729] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-22T17:30:13.717742] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-22T17:30:13.891815] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T17:30:14.517726] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-22T17:30:14.721347] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T17:30:15.317628] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-22T17:30:15.371891] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:30:15.869889] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T17:30:16.117793] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-22T17:30:16.917634] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-22T17:30:17.087052] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:30:17.625041] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T17:30:17.717700] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-22T17:30:18.501525] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T17:30:18.517612] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-22T17:30:19.261039] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T17:30:19.317607] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-22T17:30:20.117754] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-22T17:30:20.190950] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:30:20.847776] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T17:30:20.917711] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-22T17:30:21.573630] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T17:30:21.717736] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-22T17:30:22.517735] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-22T17:30:22.848793] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T17:30:23.317700] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-22T17:30:23.778607] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T17:30:23.826887] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:30:24.117861] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-22T17:30:24.917741] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-22T17:30:25.047251] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:30:25.717627] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-22T17:30:25.859327] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:30:26.442050] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T17:30:26.517747] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-22T17:30:27.317728] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-22T17:30:27.537194] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:30:28.007243] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T17:30:28.117620] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-22T17:30:28.917627] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-22T17:30:29.231823] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T17:30:29.717692] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-22T17:30:29.956384] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T17:30:29.964029] [INFO ] [REMOTE ] BEP: Full fetch complete (59342 records). [2025-10-22T17:30:29.964162] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-22T17:30:30.347786] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-22T17:30:30.347879] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-22T17:30:30.348548] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-22T17:30:30.348591] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-22T17:30:30.349775] [DEBUG] [LOCAL ] BEP: Trimmed 59342 records to 38937 (keeping 200 days of data) [2025-10-22T17:30:30.519101] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-22T17:30:30.593225] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:30:30.611677] [INFO ] [REMOTE ] BEN: Full fetch complete (77068 records). [2025-10-22T17:30:30.612335] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-22T17:30:30.720771] [DEBUG] [LOCAL ] BEP: Primary data saved (38937 records). [2025-10-22T17:30:30.720936] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-22T17:30:30.721631] [INFO ] [MAIN ] Update Progress: 246/2367 symbols completed. BEP took 27.2s. Estimated remaining: 4h 22m 25s. Rate: 8.1 symbols/min [2025-10-22T17:30:31.100816] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:31.201314] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-22T17:30:31.182581] [DEBUG] [LOCAL ] BEPH: Loaded 4924 existing records from primary storage. [2025-10-22T17:30:31.201551] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-22T17:30:31.201770] [INFO ] [MAIN ] BEPH: Loaded 4924 existing records. [2025-10-22T17:30:31.202576] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-22T17:30:31.235268] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-22T17:30:31.335207] [DEBUG] [LOCAL ] BEN: Trimmed 77068 records to 53114 (keeping 200 days of data) [2025-10-22T17:30:31.390799] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:31.391534] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-22T17:30:31.391618] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-22T17:30:31.391920] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-22T17:30:31.391977] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-22T17:30:31.902991] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T17:30:32.023232] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-22T17:30:32.101554] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:32.127201] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-22T17:30:32.180566] [DEBUG] [LOCAL ] BEN: Primary data saved (53114 records). [2025-10-22T17:30:32.181380] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-22T17:30:32.182453] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T17:30:32.182576] [INFO ] [MAIN ] Update Progress: 247/2367 symbols completed. BEN took 35.8s. Estimated remaining: 4h 21m 26s. Rate: 8.1 symbols/min [2025-10-22T17:30:32.371041] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:32.377007] [DEBUG] [LOCAL ] BEPI: Loaded 3587 existing records from primary storage. [2025-10-22T17:30:32.377161] [INFO ] [MAIN ] BEPI: Loaded 3587 existing records. [2025-10-22T17:30:32.554323] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:32.554569] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-22T17:30:32.554670] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-22T17:30:32.554853] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-22T17:30:32.554907] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-22T17:30:32.922167] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-22T17:30:32.923057] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T17:30:32.922031] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:33.717738] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-22T17:30:34.283592] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-22T17:30:34.300826] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T17:30:34.304849] [INFO ] [REMOTE ] BEKE: Full fetch complete (77338 records). [2025-10-22T17:30:34.305102] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-22T17:30:34.532331] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-22T17:30:34.741499] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-22T17:30:34.741927] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-22T17:30:34.743341] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-22T17:30:34.745672] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-22T17:30:34.745551] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T17:30:34.756749] [DEBUG] [LOCAL ] BEKE: Trimmed 77338 records to 53197 (keeping 200 days of data) [2025-10-22T17:30:35.066317] [DEBUG] [LOCAL ] BEKE: Primary data saved (53197 records). [2025-10-22T17:30:35.066470] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-22T17:30:35.067194] [INFO ] [MAIN ] Update Progress: 248/2367 symbols completed. BEKE took 40.9s. Estimated remaining: 4h 20m 40s. Rate: 8.1 symbols/min [2025-10-22T17:30:35.241030] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:35.246178] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T17:30:35.252417] [DEBUG] [LOCAL ] BEPJ: Loaded 3070 existing records from primary storage. [2025-10-22T17:30:35.252669] [INFO ] [MAIN ] BEPJ: Loaded 3070 existing records. [2025-10-22T17:30:35.322877] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-22T17:30:35.462539] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:35.462773] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-22T17:30:35.462825] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-22T17:30:35.462988] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-22T17:30:35.463044] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-22T17:30:35.897756] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:35.988239] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-22T17:30:36.117750] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-22T17:30:36.766712] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T17:30:36.917748] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-22T17:30:37.570301] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T17:30:37.717631] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-22T17:30:38.335018] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T17:30:38.517700] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-22T17:30:39.317716] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-22T17:30:39.777717] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T17:30:40.102953] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T17:30:40.117617] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-22T17:30:40.917731] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-22T17:30:41.529270] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T17:30:41.637211] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T17:30:41.717703] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-22T17:30:42.264638] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T17:30:42.517715] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-22T17:30:43.171966] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-22T17:30:43.317730] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-22T17:30:43.749146] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T17:30:44.117719] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-22T17:30:44.714535] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T17:30:44.917757] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-22T17:30:45.717702] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-22T17:30:46.298295] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T17:30:46.509082] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T17:30:46.518810] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-22T17:30:47.144380] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T17:30:47.317753] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-22T17:30:48.117726] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-22T17:30:48.874474] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T17:30:48.917719] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-22T17:30:49.393781] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T17:30:49.403434] [INFO ] [REMOTE ] BEPC: Full fetch complete (68886 records). [2025-10-22T17:30:49.403616] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-22T17:30:49.674019] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T17:30:49.707960] [INFO ] [REMOTE ] BEPH: Full fetch complete (7503 records). [2025-10-22T17:30:49.708159] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-22T17:30:49.719792] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-22T17:30:49.714448] [FATAL] [VALIDATOR ] BEPH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:30:49.735959] [FATAL] [MAIN ] BEPH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:30:49.737314] [WARN ] [MAIN ] BEPH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:30:49.766888] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-22T17:30:49.767088] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-22T17:30:49.767997] [INFO ] [LOCAL ] BEPH: Starting deletion of derivative data. [2025-10-22T17:30:49.772364] [DEBUG] [LOCAL ] BEPH: Deleted derivative data file. [2025-10-22T17:30:49.789687] [INFO ] [MAIN ] Update Progress: 249/2367 symbols completed. BEPH took 19.1s. Estimated remaining: 4h 21m 35s. Rate: 8.1 symbols/min [2025-10-22T17:30:49.857084] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-22T17:30:49.884087] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-22T17:30:49.916484] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-22T17:30:49.919553] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-22T17:30:49.991233] [DEBUG] [LOCAL ] BEPC: Trimmed 68886 records to 46357 (keeping 200 days of data) [2025-10-22T17:30:49.992879] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:50.226268] [DEBUG] [LOCAL ] BFAM: Loaded 33837 existing records from primary storage. [2025-10-22T17:30:50.230175] [INFO ] [MAIN ] BFAM: Loaded 33837 existing records. [2025-10-22T17:30:50.429284] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T17:30:50.423058] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:50.433236] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-22T17:30:50.434262] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-22T17:30:50.435830] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-22T17:30:50.436752] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-22T17:30:50.519479] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-22T17:30:50.869028] [DEBUG] [LOCAL ] BEPC: Primary data saved (46357 records). [2025-10-22T17:30:50.867840] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:50.869196] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-22T17:30:50.870311] [INFO ] [MAIN ] Update Progress: 250/2367 symbols completed. BEPC took 41.1s. Estimated remaining: 4h 20m 34s. Rate: 8.1 symbols/min [2025-10-22T17:30:50.980779] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T17:30:51.054265] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:51.093961] [DEBUG] [LOCAL ] BFH: Loaded 41425 existing records from primary storage. [2025-10-22T17:30:51.094294] [INFO ] [MAIN ] BFH: Loaded 41425 existing records. [2025-10-22T17:30:51.269689] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:51.269956] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-22T17:30:51.270016] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-22T17:30:51.270389] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-22T17:30:51.270444] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-22T17:30:51.322930] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-22T17:30:51.621938] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:51.821937] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-22T17:30:52.117732] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-22T17:30:52.917722] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-22T17:30:53.350807] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T17:30:53.505482] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T17:30:53.506740] [INFO ] [REMOTE ] BEPI: Full fetch complete (4687 records). [2025-10-22T17:30:53.506827] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-22T17:30:53.723680] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-22T17:30:53.898508] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-22T17:30:53.898592] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-22T17:30:53.898759] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-22T17:30:53.898822] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-22T17:30:53.899264] [DEBUG] [LOCAL ] BEPI: Trimmed 4687 records to 3563 (keeping 200 days of data) [2025-10-22T17:30:53.922429] [DEBUG] [LOCAL ] BEPI: Primary data saved (3563 records). [2025-10-22T17:30:53.922589] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-22T17:30:53.922701] [INFO ] [MAIN ] Update Progress: 251/2367 symbols completed. BEPI took 21.7s. Estimated remaining: 4h 19m 50s. Rate: 8.1 symbols/min [2025-10-22T17:30:54.101151] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:54.116855] [DEBUG] [LOCAL ] BFK: Loaded 13822 existing records from primary storage. [2025-10-22T17:30:54.117099] [INFO ] [MAIN ] BFK: Loaded 13822 existing records. [2025-10-22T17:30:54.305994] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:54.306305] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-22T17:30:54.306364] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-22T17:30:54.306861] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-22T17:30:54.306918] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-22T17:30:54.527607] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-22T17:30:54.664521] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:55.145724] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T17:30:55.317749] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-22T17:30:55.997370] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T17:30:56.117705] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-22T17:30:56.484725] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T17:30:56.917695] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-22T17:30:57.717700] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-22T17:30:57.727588] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T17:30:57.769718] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:30:58.517740] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-22T17:30:59.094942] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T17:30:59.204730] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-22T17:30:59.317702] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-22T17:30:59.790025] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T17:31:00.117703] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-22T17:31:00.917725] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-22T17:31:01.534203] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:31:01.717733] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-22T17:31:02.517788] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-22T17:31:03.317712] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-22T17:31:03.401433] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:31:04.117773] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-22T17:31:04.485790] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-22T17:31:04.917617] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-22T17:31:05.011255] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:31:05.166595] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T17:31:05.423192] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (4.51 seconds). [2025-10-22T17:31:05.717737] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-22T17:31:06.491572] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T17:31:06.517622] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-22T17:31:07.238691] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T17:31:07.317679] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-22T17:31:07.408743] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:31:08.081592] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T17:31:08.117624] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-22T17:31:08.917718] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-22T17:31:09.530730] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T17:31:09.717707] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-22T17:31:10.304611] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T17:31:10.517698] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-22T17:31:10.666594] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T17:31:11.317714] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-22T17:31:11.430368] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T17:31:12.117701] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-22T17:31:12.443183] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T17:31:12.917674] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-22T17:31:12.929366] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T17:31:13.392489] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T17:31:13.717693] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-22T17:31:14.517709] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-22T17:31:15.313634] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T17:31:15.322294] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-22T17:31:15.333105] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-22T17:31:15.941101] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T17:31:16.117766] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-22T17:31:16.917703] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-22T17:31:17.717684] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-22T17:31:17.804315] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T17:31:17.922089] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:31:18.517733] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-22T17:31:19.118602] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T17:31:19.317704] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-22T17:31:19.396774] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:31:19.403152] [INFO ] [REMOTE ] BFAM: Full fetch complete (47393 records). [2025-10-22T17:31:19.403323] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-22T17:31:19.809419] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-22T17:31:19.809533] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-22T17:31:19.810220] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-22T17:31:19.810284] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-22T17:31:19.811455] [DEBUG] [LOCAL ] BFAM: Trimmed 47393 records to 33784 (keeping 200 days of data) [2025-10-22T17:31:20.017732] [DEBUG] [LOCAL ] BFAM: Primary data saved (33784 records). [2025-10-22T17:31:20.017864] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-22T17:31:20.017945] [INFO ] [MAIN ] Update Progress: 252/2367 symbols completed. BFAM took 30.2s. Estimated remaining: 4h 22m 20s. Rate: 8.1 symbols/min [2025-10-22T17:31:20.119700] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-22T17:31:20.216850] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:20.261849] [DEBUG] [LOCAL ] BFLY: Loaded 51859 existing records from primary storage. [2025-10-22T17:31:20.262143] [INFO ] [MAIN ] BFLY: Loaded 51859 existing records. [2025-10-22T17:31:20.439029] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:31:20.439902] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-22T17:31:20.439966] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-22T17:31:20.440219] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-22T17:31:20.440262] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-22T17:31:20.596365] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T17:31:20.817688] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:20.853721] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T17:31:20.917626] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-22T17:31:21.717779] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-22T17:31:22.517690] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-22T17:31:22.576207] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:31:22.582568] [INFO ] [REMOTE ] BFH: Full fetch complete (59837 records). [2025-10-22T17:31:22.582692] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-22T17:31:22.583310] [FATAL] [VALIDATOR ] BFH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:31:22.583396] [FATAL] [MAIN ] BFH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:31:22.583439] [WARN ] [MAIN ] BFH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:31:22.583479] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-22T17:31:22.583535] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-10-22T17:31:22.583570] [INFO ] [LOCAL ] BFH: Starting deletion of derivative data. [2025-10-22T17:31:22.583723] [DEBUG] [LOCAL ] BFH: Deleted derivative data file. [2025-10-22T17:31:22.583807] [INFO ] [MAIN ] Update Progress: 253/2367 symbols completed. BFH took 31.7s. Estimated remaining: 4h 21m 32s. Rate: 8.1 symbols/min [2025-10-22T17:31:22.767282] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:22.778596] [DEBUG] [LOCAL ] BFS: Loaded 9585 existing records from primary storage. [2025-10-22T17:31:22.778845] [INFO ] [MAIN ] BFS: Loaded 9585 existing records. [2025-10-22T17:31:22.952534] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:31:22.952762] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-22T17:31:22.952813] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-22T17:31:22.952971] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-22T17:31:22.953016] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-22T17:31:23.317914] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-22T17:31:23.323451] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:23.450484] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T17:31:23.592915] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T17:31:23.741639] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-22T17:31:23.742487] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4346 records). [2025-10-22T17:31:23.742558] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-22T17:31:24.116563] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-22T17:31:24.116671] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-22T17:31:24.116843] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-22T17:31:24.116885] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-22T17:31:24.117285] [DEBUG] [LOCAL ] BEPJ: Trimmed 4346 records to 3041 (keeping 200 days of data) [2025-10-22T17:31:24.117624] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-22T17:31:24.138609] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3041 records). [2025-10-22T17:31:24.138800] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-22T17:31:24.138889] [INFO ] [MAIN ] Update Progress: 254/2367 symbols completed. BEPJ took 49.1s. Estimated remaining: 4h 20m 35s. Rate: 8.1 symbols/min [2025-10-22T17:31:24.323371] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:24.323562] [DEBUG] [LOCAL ] BFZ: No existing data file found in primary storage. [2025-10-22T17:31:24.323614] [WARN ] [MAIN ] BFZ: No existing data found, performing full refresh instead. [2025-10-22T17:31:24.323746] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-22T17:31:24.323786] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-22T17:31:24.323826] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-10-22T17:31:24.323857] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-22T17:31:24.688528] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:24.848257] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T17:31:24.917621] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-22T17:31:25.685027] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T17:31:25.717682] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-22T17:31:26.517709] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-22T17:31:26.733542] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T17:31:26.736403] [INFO ] [REMOTE ] BFK: Full fetch complete (19225 records). [2025-10-22T17:31:26.736475] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-22T17:31:27.090276] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-22T17:31:27.090351] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-22T17:31:27.090712] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-22T17:31:27.090774] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-22T17:31:27.091297] [DEBUG] [LOCAL ] BFK: Trimmed 19225 records to 13872 (keeping 200 days of data) [2025-10-22T17:31:27.172665] [DEBUG] [LOCAL ] BFK: Primary data saved (13872 records). [2025-10-22T17:31:27.172810] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-22T17:31:27.172890] [INFO ] [MAIN ] Update Progress: 255/2367 symbols completed. BFK took 33.3s. Estimated remaining: 4h 19m 52s. Rate: 8.1 symbols/min [2025-10-22T17:31:27.326422] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-22T17:31:27.346062] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:27.390910] [DEBUG] [LOCAL ] BG: Loaded 50586 existing records from primary storage. [2025-10-22T17:31:27.391271] [INFO ] [MAIN ] BG: Loaded 50586 existing records. [2025-10-22T17:31:27.565610] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:31:27.565821] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-22T17:31:27.565865] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-22T17:31:27.566144] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-22T17:31:27.566201] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-22T17:31:27.920831] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:28.117699] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-22T17:31:28.167429] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-22T17:31:28.236326] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T17:31:28.761585] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T17:31:28.917716] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-22T17:31:29.717631] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-22T17:31:29.729146] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T17:31:30.517756] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-22T17:31:31.165110] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T17:31:31.317729] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-22T17:31:31.488990] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:31:32.074298] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T17:31:32.117614] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-22T17:31:32.739369] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T17:31:32.917704] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-22T17:31:33.720561] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-22T17:31:33.723711] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T17:31:34.517735] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-22T17:31:35.288960] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T17:31:35.317705] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-22T17:31:35.587101] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T17:31:36.117698] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-22T17:31:36.715914] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T17:31:36.917718] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-22T17:31:36.991346] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:31:37.717759] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-22T17:31:37.821524] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T17:31:38.517711] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-22T17:31:39.317685] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-22T17:31:39.386328] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T17:31:39.632477] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T17:31:40.117724] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-22T17:31:40.907361] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T17:31:40.917685] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-22T17:31:41.001605] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:31:41.723326] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-22T17:31:41.726533] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T17:31:42.517716] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-22T17:31:43.130742] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T17:31:43.317720] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-22T17:31:43.378786] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T17:31:44.117697] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-22T17:31:44.917752] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-22T17:31:45.133760] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T17:31:45.714915] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T17:31:45.718043] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-22T17:31:45.804533] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T17:31:46.517737] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-22T17:31:46.727448] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T17:31:47.317736] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-22T17:31:48.117630] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-22T17:31:48.177338] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T17:31:48.179715] [INFO ] [REMOTE ] BFZ: Full fetch complete (17638 records). [2025-10-22T17:31:48.179785] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-22T17:31:48.570537] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-22T17:31:48.570858] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-22T17:31:48.571678] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-22T17:31:48.573454] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T17:31:48.573678] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-22T17:31:48.584912] [DEBUG] [LOCAL ] BFZ: Trimmed 17638 records to 12049 (keeping 200 days of data) [2025-10-22T17:31:48.655740] [DEBUG] [LOCAL ] BFZ: Primary data saved (12049 records). [2025-10-22T17:31:48.655867] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-22T17:31:48.655934] [INFO ] [MAIN ] Update Progress: 256/2367 symbols completed. BFZ took 24.5s. Estimated remaining: 4h 21m 41s. Rate: 8.1 symbols/min [2025-10-22T17:31:48.823414] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:48.841832] [DEBUG] [LOCAL ] BGB: Loaded 17799 existing records from primary storage. [2025-10-22T17:31:48.842062] [INFO ] [MAIN ] BGB: Loaded 17799 existing records. [2025-10-22T17:31:48.922883] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-22T17:31:49.019116] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:31:49.019339] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-22T17:31:49.019385] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-22T17:31:49.019543] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-22T17:31:49.019580] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-22T17:31:49.298468] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T17:31:49.306863] [INFO ] [REMOTE ] BFS: Full fetch complete (13093 records). [2025-10-22T17:31:49.312088] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-22T17:31:49.462631] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:49.725583] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-22T17:31:49.768334] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-22T17:31:49.768507] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-22T17:31:49.768879] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-22T17:31:49.768939] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-22T17:31:49.769422] [DEBUG] [LOCAL ] BFS: Trimmed 13093 records to 9560 (keeping 200 days of data) [2025-10-22T17:31:49.827729] [DEBUG] [LOCAL ] BFS: Primary data saved (9560 records). [2025-10-22T17:31:49.827884] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-22T17:31:49.827965] [INFO ] [MAIN ] Update Progress: 257/2367 symbols completed. BFS took 27.2s. Estimated remaining: 4h 20m 42s. Rate: 8.1 symbols/min [2025-10-22T17:31:49.996125] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:50.014461] [DEBUG] [LOCAL ] BGH: Loaded 17232 existing records from primary storage. [2025-10-22T17:31:50.014749] [INFO ] [MAIN ] BGH: Loaded 17232 existing records. [2025-10-22T17:31:50.185707] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:31:50.185900] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-22T17:31:50.185945] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-22T17:31:50.186100] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-22T17:31:50.186137] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-22T17:31:50.540765] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:50.535359] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-22T17:31:50.851843] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T17:31:51.317723] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-22T17:31:51.559198] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T17:31:51.605072] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T17:31:52.117724] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-22T17:31:52.917786] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-22T17:31:53.123676] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T17:31:53.249950] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T17:31:53.717732] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-22T17:31:53.798934] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T17:31:54.517709] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-22T17:31:55.317788] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-22T17:31:55.502749] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:31:56.117742] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-22T17:31:56.250334] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T17:31:56.461501] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T17:31:56.917701] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-22T17:31:57.720103] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-22T17:31:57.723318] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T17:31:58.139500] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T17:31:58.263333] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-22T17:31:58.517709] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-22T17:31:59.317694] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-22T17:32:00.117718] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-22T17:32:00.269948] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T17:32:00.380486] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T17:32:00.917719] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-22T17:32:01.717711] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-22T17:32:02.517627] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-22T17:32:02.842073] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T17:32:03.041453] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.92 seconds). [2025-10-22T17:32:03.050856] [INFO ] [REMOTE ] BFLY: Full fetch complete (75515 records). [2025-10-22T17:32:03.051054] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-22T17:32:03.337987] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-22T17:32:03.457398] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-22T17:32:03.492744] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-22T17:32:03.514683] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-22T17:32:03.516519] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-22T17:32:03.516680] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-22T17:32:03.519215] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-22T17:32:03.528214] [INFO ] [REMOTE ] BG: Full fetch complete (73094 records). [2025-10-22T17:32:03.528352] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-22T17:32:03.528419] [DEBUG] [LOCAL ] BFLY: Trimmed 75515 records to 51865 (keeping 200 days of data) [2025-10-22T17:32:04.099710] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-22T17:32:04.126176] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-22T17:32:04.128082] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-22T17:32:04.130314] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-22T17:32:04.130783] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-22T17:32:04.149242] [DEBUG] [LOCAL ] BG: Trimmed 73094 records to 50547 (keeping 200 days of data) [2025-10-22T17:32:04.325026] [DEBUG] [LOCAL ] BFLY: Primary data saved (51865 records). [2025-10-22T17:32:04.327059] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-22T17:32:04.328466] [INFO ] [MAIN ] Update Progress: 258/2367 symbols completed. BFLY took 44.3s. Estimated remaining: 4h 21m 32s. Rate: 8.1 symbols/min [2025-10-22T17:32:04.387295] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T17:32:04.533807] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:04.622920] [DEBUG] [LOCAL ] BGR: Loaded 13494 existing records from primary storage. [2025-10-22T17:32:04.648306] [INFO ] [MAIN ] BGR: Loaded 13494 existing records. [2025-10-22T17:32:04.840170] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:04.844298] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-22T17:32:04.845285] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-22T17:32:04.846922] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-22T17:32:04.847266] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-22T17:32:04.918628] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-22T17:32:05.283354] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:05.303428] [DEBUG] [LOCAL ] BG: Primary data saved (50547 records). [2025-10-22T17:32:05.303670] [INFO ] [MAIN ] BG: Full history saved. [2025-10-22T17:32:05.303790] [INFO ] [MAIN ] Update Progress: 259/2367 symbols completed. BG took 38.1s. Estimated remaining: 4h 20m 32s. Rate: 8.1 symbols/min [2025-10-22T17:32:05.393054] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T17:32:05.494320] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:05.545431] [DEBUG] [LOCAL ] BGS: Loaded 50552 existing records from primary storage. [2025-10-22T17:32:05.545767] [INFO ] [MAIN ] BGS: Loaded 50552 existing records. [2025-10-22T17:32:05.721577] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-22T17:32:05.721489] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:05.722718] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-22T17:32:05.722772] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-22T17:32:05.723160] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-22T17:32:05.723198] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-22T17:32:06.022718] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T17:32:06.092893] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:06.517620] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-22T17:32:06.607799] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:32:07.317724] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-22T17:32:07.569248] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T17:32:08.117775] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-22T17:32:08.360478] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T17:32:08.917748] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-22T17:32:09.606720] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T17:32:09.717733] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-22T17:32:09.779638] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T17:32:10.517716] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-22T17:32:10.769892] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T17:32:11.317725] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-22T17:32:11.571452] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T17:32:12.117719] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-22T17:32:12.855288] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T17:32:12.917719] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-22T17:32:13.016537] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T17:32:13.566585] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-22T17:32:13.717707] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-22T17:32:14.517683] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-22T17:32:14.825169] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T17:32:14.828701] [INFO ] [REMOTE ] BGB: Full fetch complete (26646 records). [2025-10-22T17:32:14.828784] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-22T17:32:15.203711] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-22T17:32:15.203828] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-22T17:32:15.204299] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-22T17:32:15.204361] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-22T17:32:15.205125] [DEBUG] [LOCAL ] BGB: Trimmed 26646 records to 17618 (keeping 200 days of data) [2025-10-22T17:32:15.308165] [DEBUG] [LOCAL ] BGB: Primary data saved (17618 records). [2025-10-22T17:32:15.308311] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-22T17:32:15.308412] [INFO ] [MAIN ] Update Progress: 260/2367 symbols completed. BGB took 26.7s. Estimated remaining: 4h 20m 46s. Rate: 8.1 symbols/min [2025-10-22T17:32:15.322776] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-22T17:32:15.483100] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:15.483289] [DEBUG] [LOCAL ] BGSF: No existing data file found in primary storage. [2025-10-22T17:32:15.483327] [WARN ] [MAIN ] BGSF: No existing data found, performing full refresh instead. [2025-10-22T17:32:15.483434] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-22T17:32:15.483473] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-22T17:32:15.483512] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-10-22T17:32:15.483543] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-22T17:32:15.863704] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:15.865138] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T17:32:15.869420] [INFO ] [REMOTE ] BGH: Full fetch complete (22998 records). [2025-10-22T17:32:15.869505] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-22T17:32:16.125699] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-22T17:32:16.315844] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-22T17:32:16.320521] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-22T17:32:16.324355] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-22T17:32:16.324698] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-22T17:32:16.325332] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T17:32:16.329535] [DEBUG] [LOCAL ] BGH: Trimmed 22998 records to 17133 (keeping 200 days of data) [2025-10-22T17:32:16.430321] [DEBUG] [LOCAL ] BGH: Primary data saved (17133 records). [2025-10-22T17:32:16.430447] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-22T17:32:16.430522] [INFO ] [MAIN ] Update Progress: 261/2367 symbols completed. BGH took 26.6s. Estimated remaining: 4h 19m 48s. Rate: 8.1 symbols/min [2025-10-22T17:32:16.616179] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:16.633480] [DEBUG] [LOCAL ] BGT: Loaded 16274 existing records from primary storage. [2025-10-22T17:32:16.633757] [INFO ] [MAIN ] BGT: Loaded 16274 existing records. [2025-10-22T17:32:16.807524] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:16.807755] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-22T17:32:16.807806] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-22T17:32:16.807987] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-22T17:32:16.808043] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-22T17:32:16.920364] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-22T17:32:16.929998] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T17:32:17.165954] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:17.717698] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-22T17:32:18.100350] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T17:32:18.360876] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T17:32:18.517710] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-22T17:32:19.317698] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-22T17:32:19.544918] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T17:32:20.117680] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-22T17:32:20.856306] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T17:32:20.917708] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-22T17:32:21.098874] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-22T17:32:21.717706] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-22T17:32:22.520554] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-22T17:32:22.523727] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T17:32:22.671682] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T17:32:23.317705] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-22T17:32:23.773354] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T17:32:23.916404] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T17:32:24.117920] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-22T17:32:24.632152] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T17:32:24.917713] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-22T17:32:25.717701] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-22T17:32:25.832749] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T17:32:26.517624] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-22T17:32:26.738361] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T17:32:27.317686] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-22T17:32:27.352592] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T17:32:28.117711] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-22T17:32:28.888845] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T17:32:28.917694] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-22T17:32:29.257338] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T17:32:29.617289] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T17:32:29.717690] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-22T17:32:30.402229] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T17:32:30.404747] [INFO ] [REMOTE ] BGR: Full fetch complete (19944 records). [2025-10-22T17:32:30.404854] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-22T17:32:30.522868] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-22T17:32:30.780047] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-22T17:32:30.780128] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-22T17:32:30.780478] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-22T17:32:30.780516] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-22T17:32:30.781157] [DEBUG] [LOCAL ] BGR: Trimmed 19944 records to 13405 (keeping 200 days of data) [2025-10-22T17:32:30.861294] [DEBUG] [LOCAL ] BGR: Primary data saved (13405 records). [2025-10-22T17:32:30.861420] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-22T17:32:30.861495] [INFO ] [MAIN ] Update Progress: 262/2367 symbols completed. BGR took 26.5s. Estimated remaining: 4h 20m 37s. Rate: 8.1 symbols/min [2025-10-22T17:32:31.030400] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:31.042551] [DEBUG] [LOCAL ] BGX: Loaded 11249 existing records from primary storage. [2025-10-22T17:32:31.042762] [INFO ] [MAIN ] BGX: Loaded 11249 existing records. [2025-10-22T17:32:31.229959] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:31.230180] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-22T17:32:31.230227] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-22T17:32:31.230376] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-22T17:32:31.230415] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-22T17:32:31.327825] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-22T17:32:31.586753] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:31.878513] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T17:32:32.117697] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-22T17:32:32.455938] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T17:32:32.797120] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T17:32:32.917709] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-22T17:32:33.716067] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T17:32:33.719009] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-22T17:32:34.517700] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-22T17:32:34.553224] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T17:32:35.248809] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T17:32:35.317732] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-22T17:32:36.117721] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-22T17:32:36.917686] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-22T17:32:37.065579] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T17:32:37.066410] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T17:32:37.471704] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-22T17:32:37.717695] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-22T17:32:38.517715] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-22T17:32:39.239582] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T17:32:39.250952] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T17:32:39.317696] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-22T17:32:40.092838] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T17:32:40.117615] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-22T17:32:40.761961] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T17:32:40.917696] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-22T17:32:41.723579] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-22T17:32:41.725446] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T17:32:42.386207] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T17:32:42.517690] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-22T17:32:42.952972] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T17:32:43.317753] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-22T17:32:44.076444] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T17:32:44.117612] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-22T17:32:44.917724] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-22T17:32:45.028041] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T17:32:45.717721] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-22T17:32:45.981575] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T17:32:46.517738] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-22T17:32:46.721840] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T17:32:47.317719] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-22T17:32:47.642378] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T17:32:47.645218] [INFO ] [REMOTE ] BGSF: Full fetch complete (9654 records). [2025-10-22T17:32:47.645297] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-22T17:32:48.013586] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-22T17:32:48.013680] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-22T17:32:48.013898] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-22T17:32:48.013937] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-22T17:32:48.014364] [DEBUG] [LOCAL ] BGSF: Trimmed 9654 records to 8227 (keeping 200 days of data) [2025-10-22T17:32:48.060852] [DEBUG] [LOCAL ] BGSF: Primary data saved (8227 records). [2025-10-22T17:32:48.060950] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-22T17:32:48.061017] [INFO ] [MAIN ] Update Progress: 263/2367 symbols completed. BGSF took 32.8s. Estimated remaining: 4h 21m 47s. Rate: 8.0 symbols/min [2025-10-22T17:32:48.125512] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-22T17:32:48.238940] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:48.258471] [DEBUG] [LOCAL ] BGY: Loaded 21500 existing records from primary storage. [2025-10-22T17:32:48.258716] [INFO ] [MAIN ] BGY: Loaded 21500 existing records. [2025-10-22T17:32:48.393382] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:32:48.422720] [INFO ] [REMOTE ] BGX: Full fetch complete (16462 records). [2025-10-22T17:32:48.432202] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-22T17:32:48.451794] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:48.525594] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-22T17:32:48.530886] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-22T17:32:48.550887] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-22T17:32:48.550990] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-22T17:32:48.927386] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-22T17:32:49.176738] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-22T17:32:49.176545] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:49.181058] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-22T17:32:49.182119] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T17:32:49.181801] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-22T17:32:49.185741] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-22T17:32:49.186463] [DEBUG] [LOCAL ] BGX: Trimmed 16462 records to 11188 (keeping 200 days of data) [2025-10-22T17:32:49.250394] [DEBUG] [LOCAL ] BGX: Primary data saved (11188 records). [2025-10-22T17:32:49.250509] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-22T17:32:49.250583] [INFO ] [MAIN ] Update Progress: 264/2367 symbols completed. BGX took 18.4s. Estimated remaining: 4h 20m 50s. Rate: 8.1 symbols/min [2025-10-22T17:32:49.414207] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:49.414402] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-10-22T17:32:49.414439] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-10-22T17:32:49.414551] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-22T17:32:49.414591] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-22T17:32:49.414631] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-22T17:32:49.414701] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-22T17:32:49.722823] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-22T17:32:49.756955] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:50.523498] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T17:32:50.521063] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-22T17:32:50.801193] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T17:32:51.317707] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-22T17:32:51.369258] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T17:32:52.117713] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-22T17:32:52.528863] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T17:32:52.752044] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T17:32:52.917744] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-22T17:32:53.717688] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-22T17:32:53.756269] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-22T17:32:54.517750] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-22T17:32:55.317725] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-22T17:32:55.523095] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:32:55.531391] [INFO ] [REMOTE ] BGS: Full fetch complete (72664 records). [2025-10-22T17:32:55.531525] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-22T17:32:55.674224] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T17:32:55.937714] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-22T17:32:55.937808] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-22T17:32:55.938624] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-22T17:32:55.938711] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-22T17:32:55.940092] [DEBUG] [LOCAL ] BGS: Trimmed 72664 records to 50530 (keeping 200 days of data) [2025-10-22T17:32:56.137683] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-22T17:32:56.235821] [DEBUG] [LOCAL ] BGS: Primary data saved (50530 records). [2025-10-22T17:32:56.235965] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-22T17:32:56.236058] [INFO ] [MAIN ] Update Progress: 265/2367 symbols completed. BGS took 50.9s. Estimated remaining: 4h 20m 39s. Rate: 8.1 symbols/min [2025-10-22T17:32:56.421493] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T17:32:56.423740] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:56.428514] [INFO ] [REMOTE ] BGT: Full fetch complete (24243 records). [2025-10-22T17:32:56.428665] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-22T17:32:56.754462] [DEBUG] [LOCAL ] BHC: Loaded 46640 existing records from primary storage. [2025-10-22T17:32:56.808073] [INFO ] [MAIN ] BHC: Loaded 46640 existing records. [2025-10-22T17:32:56.855509] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-22T17:32:56.840138] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T17:32:56.872062] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-22T17:32:56.884685] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-22T17:32:56.918056] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-22T17:32:56.923385] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-22T17:32:56.967843] [DEBUG] [LOCAL ] BGT: Trimmed 24243 records to 16184 (keeping 200 days of data) [2025-10-22T17:32:57.138129] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:57.146993] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-22T17:32:57.152103] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-22T17:32:57.156791] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-22T17:32:57.159235] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-22T17:32:57.159305] [DEBUG] [LOCAL ] BGT: Primary data saved (16184 records). [2025-10-22T17:32:57.164550] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-22T17:32:57.190986] [INFO ] [MAIN ] Update Progress: 266/2367 symbols completed. BGT took 40.8s. Estimated remaining: 4h 19m 40s. Rate: 8.1 symbols/min [2025-10-22T17:32:57.512391] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:57.701404] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:57.710820] [DEBUG] [LOCAL ] BHE: Loaded 23786 existing records from primary storage. [2025-10-22T17:32:57.711027] [INFO ] [MAIN ] BHE: Loaded 23786 existing records. [2025-10-22T17:32:57.722904] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-22T17:32:57.821467] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T17:32:57.903961] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:57.904222] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-22T17:32:57.904277] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-22T17:32:57.904487] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-22T17:32:57.904543] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-22T17:32:58.252431] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:58.517716] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-22T17:32:59.020853] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T17:32:59.317721] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-22T17:33:00.117704] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-22T17:33:00.356064] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T17:33:00.395045] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T17:33:00.917683] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-22T17:33:01.639813] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T17:33:01.717704] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-22T17:33:01.851179] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T17:33:02.517740] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-22T17:33:03.059703] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T17:33:03.317769] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-22T17:33:03.669518] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T17:33:04.117744] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-22T17:33:04.463041] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T17:33:04.917687] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-22T17:33:05.576560] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:33:05.717687] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-22T17:33:05.800749] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T17:33:06.517693] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-22T17:33:07.146932] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T17:33:07.317688] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-22T17:33:07.800192] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T17:33:08.034768] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T17:33:08.117691] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-22T17:33:08.917685] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-22T17:33:09.717722] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-22T17:33:09.732593] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T17:33:10.036886] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T17:33:10.517721] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-22T17:33:10.778084] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T17:33:10.780985] [INFO ] [REMOTE ] BH: Full fetch complete (19431 records). [2025-10-22T17:33:10.781065] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-22T17:33:10.781687] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:33:10.781795] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:33:10.781839] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:33:10.781880] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-22T17:33:10.781956] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-22T17:33:10.782013] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-10-22T17:33:10.782065] [DEBUG] [LOCAL ] BH: No derivative data file found to delete. [2025-10-22T17:33:10.782130] [INFO ] [MAIN ] Update Progress: 267/2367 symbols completed. BH took 21.5s. Estimated remaining: 4h 20m 21s. Rate: 8.1 symbols/min [2025-10-22T17:33:10.962820] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:10.984108] [DEBUG] [LOCAL ] BHK: Loaded 23875 existing records from primary storage. [2025-10-22T17:33:10.984361] [INFO ] [MAIN ] BHK: Loaded 23875 existing records. [2025-10-22T17:33:11.165616] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:33:11.165869] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-22T17:33:11.165918] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-22T17:33:11.166243] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-22T17:33:11.166302] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-22T17:33:11.322915] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-22T17:33:11.543923] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:12.117676] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-22T17:33:12.197502] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T17:33:12.542739] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T17:33:12.917629] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-22T17:33:12.959914] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T17:33:13.717710] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-22T17:33:14.517677] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-22T17:33:14.566100] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T17:33:14.849226] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T17:33:15.297186] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T17:33:15.317695] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-22T17:33:16.117754] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-22T17:33:16.845130] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T17:33:16.917707] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-22T17:33:17.167996] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T17:33:17.717754] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-22T17:33:18.322368] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-22T17:33:18.353814] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T17:33:18.517707] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-22T17:33:19.317710] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-22T17:33:20.117737] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-22T17:33:20.232803] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T17:33:20.424268] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T17:33:20.905458] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T17:33:20.917607] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-22T17:33:21.717766] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-22T17:33:22.517691] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-22T17:33:22.868316] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T17:33:22.876265] [INFO ] [REMOTE ] BHC: Full fetch complete (67536 records). [2025-10-22T17:33:22.876411] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-22T17:33:23.072521] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T17:33:23.291970] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-22T17:33:23.292051] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-22T17:33:23.292801] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-22T17:33:23.292869] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-22T17:33:23.294173] [DEBUG] [LOCAL ] BHC: Trimmed 67536 records to 46589 (keeping 200 days of data) [2025-10-22T17:33:23.338484] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-22T17:33:23.569522] [DEBUG] [LOCAL ] BHC: Primary data saved (46589 records). [2025-10-22T17:33:23.569954] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-22T17:33:23.570063] [INFO ] [MAIN ] Update Progress: 268/2367 symbols completed. BHC took 27.3s. Estimated remaining: 4h 20m 56s. Rate: 8.0 symbols/min [2025-10-22T17:33:23.777382] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:23.795031] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T17:33:23.854127] [DEBUG] [LOCAL ] BHP: Loaded 53368 existing records from primary storage. [2025-10-22T17:33:23.854473] [INFO ] [MAIN ] BHP: Loaded 53368 existing records. [2025-10-22T17:33:24.076251] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:33:24.076560] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-22T17:33:24.076611] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-22T17:33:24.077120] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-22T17:33:24.077179] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-22T17:33:24.122866] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-22T17:33:24.460584] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:24.622725] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T17:33:24.917729] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-22T17:33:25.717619] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-22T17:33:25.822679] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T17:33:25.953867] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:33:26.517706] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-22T17:33:27.317746] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-22T17:33:27.625144] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T17:33:27.687622] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T17:33:28.117698] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-22T17:33:28.264396] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T17:33:28.917693] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-22T17:33:29.631378] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T17:33:29.717723] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-22T17:33:30.100256] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T17:33:30.517712] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-22T17:33:31.317620] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-22T17:33:31.468320] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T17:33:31.496951] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T17:33:31.500678] [INFO ] [REMOTE ] BGY: Full fetch complete (33037 records). [2025-10-22T17:33:31.500763] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-22T17:33:31.863121] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-22T17:33:31.863194] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-22T17:33:31.863629] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-22T17:33:31.863703] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-22T17:33:31.864416] [DEBUG] [LOCAL ] BGY: Trimmed 33037 records to 21389 (keeping 200 days of data) [2025-10-22T17:33:31.982136] [DEBUG] [LOCAL ] BGY: Primary data saved (21389 records). [2025-10-22T17:33:31.982255] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-22T17:33:31.982327] [INFO ] [MAIN ] Update Progress: 269/2367 symbols completed. BGY took 43.9s. Estimated remaining: 4h 20m 56s. Rate: 8.0 symbols/min [2025-10-22T17:33:32.119689] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-22T17:33:32.150723] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:32.150869] [DEBUG] [LOCAL ] BHR: No existing data file found in primary storage. [2025-10-22T17:33:32.150910] [WARN ] [MAIN ] BHR: No existing data found, performing full refresh instead. [2025-10-22T17:33:32.151014] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-22T17:33:32.151054] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-22T17:33:32.151095] [DEBUG] [LOCAL ] BHR: No primary data file found to delete. [2025-10-22T17:33:32.151355] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-22T17:33:32.516958] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T17:33:32.516476] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:32.917700] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-22T17:33:33.717726] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-22T17:33:34.021156] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T17:33:34.097576] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T17:33:34.517690] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-22T17:33:34.796376] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:33:34.800221] [INFO ] [REMOTE ] BHE: Full fetch complete (36459 records). [2025-10-22T17:33:34.800296] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-22T17:33:35.161592] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-22T17:33:35.161708] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-22T17:33:35.162207] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-22T17:33:35.162268] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-22T17:33:35.163055] [DEBUG] [LOCAL ] BHE: Trimmed 36459 records to 23698 (keeping 200 days of data) [2025-10-22T17:33:35.306534] [DEBUG] [LOCAL ] BHE: Primary data saved (23698 records). [2025-10-22T17:33:35.306676] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-22T17:33:35.306773] [INFO ] [MAIN ] Update Progress: 270/2367 symbols completed. BHE took 38.1s. Estimated remaining: 4h 20m 16s. Rate: 8.1 symbols/min [2025-10-22T17:33:35.322780] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-22T17:33:35.491394] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:35.489936] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:33:35.494840] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-22T17:33:35.495492] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-22T17:33:35.495607] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-22T17:33:35.495681] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-22T17:33:35.495745] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-22T17:33:35.495779] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-22T17:33:35.854456] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:36.117699] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-22T17:33:36.917693] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-22T17:33:37.568340] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T17:33:37.645703] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-22T17:33:37.717619] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-22T17:33:37.990031] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T17:33:38.517711] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-22T17:33:38.986206] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-22T17:33:39.317673] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-22T17:33:39.626245] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-22T17:33:39.735458] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T17:33:40.117700] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-22T17:33:40.917629] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-22T17:33:41.281336] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-22T17:33:41.298779] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T17:33:41.717721] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-22T17:33:42.517824] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-22T17:33:42.893048] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-22T17:33:43.317700] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-22T17:33:43.810662] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-22T17:33:44.117697] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-22T17:33:44.356485] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T17:33:44.360452] [INFO ] [REMOTE ] BHK: Full fetch complete (30624 records). [2025-10-22T17:33:44.360524] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-22T17:33:44.716520] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-22T17:33:44.716593] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-22T17:33:44.716996] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-22T17:33:44.717058] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-22T17:33:44.717761] [DEBUG] [LOCAL ] BHK: Trimmed 30624 records to 23957 (keeping 200 days of data) [2025-10-22T17:33:44.857250] [DEBUG] [LOCAL ] BHK: Primary data saved (23957 records). [2025-10-22T17:33:44.857412] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-22T17:33:44.857512] [INFO ] [MAIN ] Update Progress: 271/2367 symbols completed. BHK took 34.1s. Estimated remaining: 4h 20m 25s. Rate: 8.0 symbols/min [2025-10-22T17:33:44.922957] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-22T17:33:45.026330] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:45.072414] [DEBUG] [LOCAL ] BHVN: Loaded 50631 existing records from primary storage. [2025-10-22T17:33:45.072749] [INFO ] [MAIN ] BHVN: Loaded 50631 existing records. [2025-10-22T17:33:45.233388] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T17:33:45.266818] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:33:45.267019] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-22T17:33:45.267065] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-22T17:33:45.267275] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-22T17:33:45.267331] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-22T17:33:45.616174] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:45.717610] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-22T17:33:46.517732] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-22T17:33:46.992076] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T17:33:47.317690] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-22T17:33:47.576869] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T17:33:47.631155] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T17:33:47.757959] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-22T17:33:48.117693] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-22T17:33:48.469028] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T17:33:48.917704] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-22T17:33:49.717736] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-22T17:33:50.517706] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-22T17:33:50.683043] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T17:33:50.870841] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T17:33:51.317678] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-22T17:33:52.117739] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-22T17:33:52.552041] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T17:33:52.562000] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T17:33:52.917712] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-22T17:33:53.127291] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:33:53.135613] [INFO ] [REMOTE ] BHP: Full fetch complete (77047 records). [2025-10-22T17:33:53.135792] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-22T17:33:53.136687] [FATAL] [VALIDATOR ] BHP: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:33:53.136788] [FATAL] [MAIN ] BHP: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:33:53.136833] [WARN ] [MAIN ] BHP: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:33:53.136909] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-22T17:33:53.136994] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-22T17:33:53.137042] [INFO ] [LOCAL ] BHP: Starting deletion of derivative data. [2025-10-22T17:33:53.137234] [DEBUG] [LOCAL ] BHP: Deleted derivative data file. [2025-10-22T17:33:53.137340] [INFO ] [MAIN ] Update Progress: 272/2367 symbols completed. BHP took 29.6s. Estimated remaining: 4h 20m 24s. Rate: 8.0 symbols/min [2025-10-22T17:33:53.306594] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:53.353008] [DEBUG] [LOCAL ] BILL: Loaded 52510 existing records from primary storage. [2025-10-22T17:33:53.353315] [INFO ] [MAIN ] BILL: Loaded 52510 existing records. [2025-10-22T17:33:53.533194] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:33:53.533420] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-22T17:33:53.533479] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-22T17:33:53.533704] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-22T17:33:53.533761] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-22T17:33:53.725439] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-22T17:33:53.902529] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:54.186009] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T17:33:54.524115] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-22T17:33:54.526993] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T17:33:55.317708] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-22T17:33:55.607750] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T17:33:56.117703] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-22T17:33:56.750753] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T17:33:56.917782] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-22T17:33:57.717705] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-22T17:33:57.949749] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T17:33:58.098286] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T17:33:58.517737] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-22T17:33:59.317723] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-22T17:33:59.357008] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:33:59.826385] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:33:59.830796] [INFO ] [REMOTE ] BHR: Full fetch complete (31164 records). [2025-10-22T17:33:59.830892] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-22T17:34:00.122930] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-22T17:34:00.201798] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-22T17:34:00.201883] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-22T17:34:00.202332] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-22T17:34:00.202371] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-22T17:34:00.203086] [DEBUG] [LOCAL ] BHR: Trimmed 31164 records to 21979 (keeping 200 days of data) [2025-10-22T17:34:00.334535] [DEBUG] [LOCAL ] BHR: Primary data saved (21979 records). [2025-10-22T17:34:00.334680] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-22T17:34:00.334766] [INFO ] [MAIN ] Update Progress: 273/2367 symbols completed. BHR took 28.4s. Estimated remaining: 4h 20m 15s. Rate: 8.0 symbols/min [2025-10-22T17:34:00.502833] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:00.525810] [DEBUG] [LOCAL ] BIO: Loaded 23888 existing records from primary storage. [2025-10-22T17:34:00.526059] [INFO ] [MAIN ] BIO: Loaded 23888 existing records. [2025-10-22T17:34:00.698803] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:00.698998] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-22T17:34:00.699044] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-22T17:34:00.699208] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-22T17:34:00.699244] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-22T17:34:00.925271] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-22T17:34:01.068451] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:01.097418] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T17:34:01.472845] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T17:34:01.717736] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-22T17:34:01.946891] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:34:02.315364] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T17:34:02.316572] [INFO ] [REMOTE ] BHV: Full fetch complete (1413 records). [2025-10-22T17:34:02.316689] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-22T17:34:02.317183] [FATAL] [VALIDATOR ] BHV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:34:02.317284] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:34:02.317370] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:34:02.317462] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-22T17:34:02.317551] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-22T17:34:02.317602] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-22T17:34:02.317728] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-22T17:34:02.317815] [INFO ] [MAIN ] Update Progress: 274/2367 symbols completed. BHV took 27.0s. Estimated remaining: 4h 19m 25s. Rate: 8.1 symbols/min [2025-10-22T17:34:02.518834] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-22T17:34:02.519716] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:02.556807] [DEBUG] [LOCAL ] BIP: Loaded 39061 existing records from primary storage. [2025-10-22T17:34:02.557400] [INFO ] [MAIN ] BIP: Loaded 39061 existing records. [2025-10-22T17:34:02.734589] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:02.734837] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-22T17:34:02.734896] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-22T17:34:02.735169] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-22T17:34:02.735224] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-22T17:34:03.087621] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:03.317625] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-22T17:34:04.117622] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-22T17:34:04.202463] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:34:04.516354] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T17:34:04.917687] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-22T17:34:04.945904] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T17:34:05.717740] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-22T17:34:06.517620] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-22T17:34:06.854463] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T17:34:07.317687] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-22T17:34:07.629686] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T17:34:07.661172] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T17:34:08.117755] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-22T17:34:08.921759] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-22T17:34:09.258853] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T17:34:09.362088] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T17:34:09.717713] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-22T17:34:10.190198] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T17:34:10.517702] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-22T17:34:11.092619] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T17:34:11.317745] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-22T17:34:12.117709] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-22T17:34:12.318502] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:34:12.538995] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T17:34:12.917699] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-22T17:34:13.717702] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-22T17:34:14.517718] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-22T17:34:14.777885] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T17:34:15.317797] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-22T17:34:15.693679] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (3.58 seconds). [2025-10-22T17:34:16.072270] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T17:34:16.117746] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-22T17:34:16.917703] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-22T17:34:17.178516] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T17:34:17.188543] [INFO ] [REMOTE ] BHVN: Full fetch complete (70718 records). [2025-10-22T17:34:17.188819] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-22T17:34:17.624226] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-22T17:34:17.624354] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-22T17:34:17.625244] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-22T17:34:17.625341] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-22T17:34:17.626933] [DEBUG] [LOCAL ] BHVN: Trimmed 70718 records to 50633 (keeping 200 days of data) [2025-10-22T17:34:17.925431] [DEBUG] [LOCAL ] BHVN: Primary data saved (50633 records). [2025-10-22T17:34:17.925569] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-22T17:34:17.926529] [INFO ] [MAIN ] Update Progress: 275/2367 symbols completed. BHVN took 33.1s. Estimated remaining: 4h 20m 20s. Rate: 8.0 symbols/min [2025-10-22T17:34:18.094018] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:18.133936] [DEBUG] [LOCAL ] BIPC: Loaded 41184 existing records from primary storage. [2025-10-22T17:34:18.134245] [INFO ] [MAIN ] BIPC: Loaded 41184 existing records. [2025-10-22T17:34:18.318267] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:18.318852] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-22T17:34:18.318940] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-22T17:34:18.319161] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-22T17:34:18.319221] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-22T17:34:18.622745] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (4.91 seconds). [2025-10-22T17:34:18.675912] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-22T17:34:18.764332] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:18.765824] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T17:34:18.772493] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-22T17:34:19.317713] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-22T17:34:19.780855] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (3.66 seconds). [2025-10-22T17:34:20.117687] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-22T17:34:20.376091] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:34:20.589287] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T17:34:20.808135] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-22T17:34:20.917716] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-22T17:34:21.587413] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T17:34:21.717709] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-22T17:34:22.000245] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T17:34:22.517697] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-22T17:34:23.084228] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T17:34:23.317681] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-22T17:34:23.954152] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:34:24.117722] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-22T17:34:24.842520] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T17:34:24.917719] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-22T17:34:25.717748] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-22T17:34:26.034240] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T17:34:26.098586] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T17:34:26.517731] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-22T17:34:26.947713] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T17:34:27.317695] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-22T17:34:27.991978] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T17:34:28.117679] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-22T17:34:28.676223] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T17:34:28.917712] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-22T17:34:29.717684] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-22T17:34:30.085715] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T17:34:30.517720] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-22T17:34:30.725236] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T17:34:30.728797] [INFO ] [REMOTE ] BIO: Full fetch complete (34565 records). [2025-10-22T17:34:30.728907] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-22T17:34:31.013810] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T17:34:31.058364] [INFO ] [REMOTE ] BILL: Full fetch complete (76126 records). [2025-10-22T17:34:31.068830] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-22T17:34:31.237240] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-22T17:34:31.242454] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-22T17:34:31.253184] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-22T17:34:31.258383] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-22T17:34:31.289977] [DEBUG] [LOCAL ] BIO: Trimmed 34565 records to 23819 (keeping 200 days of data) [2025-10-22T17:34:31.330413] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-22T17:34:31.629534] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-22T17:34:31.633493] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-22T17:34:31.635787] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-22T17:34:31.636986] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-22T17:34:31.649410] [DEBUG] [LOCAL ] BILL: Trimmed 76126 records to 52500 (keeping 200 days of data) [2025-10-22T17:34:31.772620] [DEBUG] [LOCAL ] BIO: Primary data saved (23819 records). [2025-10-22T17:34:31.781862] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-22T17:34:31.786066] [INFO ] [MAIN ] Update Progress: 276/2367 symbols completed. BIO took 31.5s. Estimated remaining: 4h 21m 1s. Rate: 8.0 symbols/min [2025-10-22T17:34:32.130489] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:32.178519] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:34:32.187857] [DEBUG] [LOCAL ] BIPH: Loaded 2375 existing records from primary storage. [2025-10-22T17:34:32.188692] [INFO ] [MAIN ] BIPH: Loaded 2375 existing records. [2025-10-22T17:34:32.205786] [INFO ] [REMOTE ] BIP: Full fetch complete (57630 records). [2025-10-22T17:34:32.225750] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-22T17:34:32.239127] [DEBUG] [LOCAL ] BILL: Primary data saved (52500 records). [2025-10-22T17:34:32.251114] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-22T17:34:32.260457] [INFO ] [MAIN ] Update Progress: 277/2367 symbols completed. BILL took 39.1s. Estimated remaining: 4h 20m 1s. Rate: 8.0 symbols/min [2025-10-22T17:34:32.509795] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:32.520303] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-22T17:34:32.525525] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-22T17:34:32.545048] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-22T17:34:32.551070] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-22T17:34:33.111881] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-22T17:34:33.117212] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-22T17:34:33.156748] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-22T17:34:33.168101] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-22T17:34:33.188072] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:33.188591] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-22T17:34:33.190626] [DEBUG] [LOCAL ] BIP: Trimmed 57630 records to 38919 (keeping 200 days of data) [2025-10-22T17:34:33.329352] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T17:34:33.341226] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-22T17:34:33.464214] [DEBUG] [LOCAL ] BIP: Primary data saved (38919 records). [2025-10-22T17:34:33.464456] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-22T17:34:33.465180] [INFO ] [MAIN ] Update Progress: 278/2367 symbols completed. BIP took 31.1s. Estimated remaining: 4h 19m 6s. Rate: 8.1 symbols/min [2025-10-22T17:34:34.012558] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T17:34:34.014126] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-22T17:34:34.462894] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T17:34:34.517621] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-22T17:34:34.759909] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T17:34:34.840943] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-22T17:34:35.317679] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-22T17:34:36.117729] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-22T17:34:36.842723] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T17:34:36.880568] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T17:34:36.917721] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-22T17:34:37.717739] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-22T17:34:38.147379] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T17:34:38.187814] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T17:34:38.517738] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-22T17:34:38.962327] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T17:34:39.317718] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-22T17:34:39.757445] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T17:34:40.117741] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-22T17:34:40.564173] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T17:34:40.917700] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-22T17:34:41.717778] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-22T17:34:42.159368] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T17:34:42.517768] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-22T17:34:42.632996] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T17:34:42.930021] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-22T17:34:42.930929] [INFO ] [REMOTE ] BIPH: Full fetch complete (3879 records). [2025-10-22T17:34:42.930998] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-22T17:34:43.298253] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-22T17:34:43.298330] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-22T17:34:43.298469] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-22T17:34:43.298509] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-22T17:34:43.298880] [DEBUG] [LOCAL ] BIPH: Trimmed 3879 records to 2352 (keeping 200 days of data) [2025-10-22T17:34:43.312977] [DEBUG] [LOCAL ] BIPH: Primary data saved (2352 records). [2025-10-22T17:34:43.313043] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-22T17:34:43.313110] [INFO ] [MAIN ] Update Progress: 279/2367 symbols completed. BIPH took 11.5s. Estimated remaining: 4h 19m 17s. Rate: 8.1 symbols/min [2025-10-22T17:34:43.317725] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-22T17:34:45.100050] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T17:34:45.107086] [INFO ] [REMOTE ] BIPC: Full fetch complete (60289 records). [2025-10-22T17:34:45.107196] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-22T17:34:45.481215] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-22T17:34:45.481284] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-22T17:34:45.481960] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-22T17:34:45.482022] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-22T17:34:45.483160] [DEBUG] [LOCAL ] BIPC: Trimmed 60289 records to 41113 (keeping 200 days of data) [2025-10-22T17:34:45.725111] [DEBUG] [LOCAL ] BIPC: Primary data saved (41113 records). [2025-10-22T17:34:45.725235] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-22T17:34:45.725318] [INFO ] [MAIN ] Update Progress: 280/2367 symbols completed. BIPC took 27.8s. Estimated remaining: 4h 18m 32s. Rate: 8.1 symbols/min [2025-10-22T17:34:46.340083] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:46.403666] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:46.458131] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:46.461687] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:46.462396] [DEBUG] [LOCAL ] BIPI: Loaded 2845 existing records from primary storage. [2025-10-22T17:34:46.463115] [INFO ] [MAIN ] BIPI: Loaded 2845 existing records. [2025-10-22T17:34:46.539226] [DEBUG] [LOCAL ] BIPJ: Loaded 3124 existing records from primary storage. [2025-10-22T17:34:46.561934] [INFO ] [MAIN ] BIPJ: Loaded 3124 existing records. [2025-10-22T17:34:46.666897] [DEBUG] [LOCAL ] BIT: Loaded 23895 existing records from primary storage. [2025-10-22T17:34:46.732748] [INFO ] [MAIN ] BIT: Loaded 23895 existing records. [2025-10-22T17:34:46.810942] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:46.964729] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:46.921406] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-22T17:34:46.975632] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-22T17:34:46.987585] [DEBUG] [LOCAL ] BIRK: Loaded 51192 existing records from primary storage. [2025-10-22T17:34:46.993355] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-22T17:34:46.993612] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-22T17:34:46.999066] [INFO ] [MAIN ] BIRK: Loaded 51192 existing records. [2025-10-22T17:34:47.004566] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-22T17:34:47.009756] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-22T17:34:47.049416] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-22T17:34:47.072216] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-22T17:34:47.419808] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:47.440116] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-22T17:34:47.519156] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-22T17:34:47.574702] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-22T17:34:47.618209] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:47.619147] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-22T17:34:47.672964] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-22T17:34:47.689324] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-22T17:34:47.817099] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-22T17:34:47.830763] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-22T17:34:48.391683] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:48.431106] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-22T17:34:48.741613] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:48.752391] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-22T17:34:48.752054] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:48.767223] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-22T17:34:48.865071] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:48.865467] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-22T17:34:49.132884] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T17:34:49.134544] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-22T17:34:49.383571] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T17:34:49.385245] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-22T17:34:49.550134] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-22T17:34:49.551357] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-22T17:34:49.829435] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T17:34:49.830703] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-22T17:34:49.996505] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T17:34:50.030020] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:34:50.406876] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:34:50.517624] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-22T17:34:50.544069] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T17:34:51.317680] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-22T17:34:51.490070] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:34:52.117734] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-22T17:34:52.896304] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T17:34:52.917616] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-22T17:34:53.120709] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T17:34:53.717702] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-22T17:34:54.281346] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T17:34:54.517709] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-22T17:34:55.317719] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-22T17:34:55.396466] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-22T17:34:55.530808] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T17:34:55.763288] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T17:34:56.117714] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-22T17:34:56.570205] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-22T17:34:56.917802] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-22T17:34:57.318430] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-22T17:34:57.717723] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-22T17:34:58.517694] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-22T17:34:58.731584] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T17:34:59.020695] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T17:34:59.317624] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-22T17:34:59.841463] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-22T17:35:00.117711] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-22T17:35:00.761732] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T17:35:00.917819] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-22T17:35:01.612219] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T17:35:01.717701] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-22T17:35:02.216903] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-22T17:35:02.517699] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-22T17:35:03.082049] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T17:35:03.317742] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-22T17:35:04.117723] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-22T17:35:04.701004] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T17:35:04.702018] [INFO ] [REMOTE ] BIPI: Full fetch complete (4607 records). [2025-10-22T17:35:04.702088] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-22T17:35:04.922838] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-22T17:35:05.067615] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-22T17:35:05.067793] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-22T17:35:05.068076] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-22T17:35:05.068226] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-22T17:35:05.068827] [DEBUG] [LOCAL ] BIPI: Trimmed 4607 records to 2816 (keeping 200 days of data) [2025-10-22T17:35:05.114105] [DEBUG] [LOCAL ] BIPI: Primary data saved (2816 records). [2025-10-22T17:35:05.114342] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-22T17:35:05.115923] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T17:35:05.114821] [INFO ] [MAIN ] Update Progress: 281/2367 symbols completed. BIPI took 19.4s. Estimated remaining: 4h 19m 53s. Rate: 8.0 symbols/min [2025-10-22T17:35:05.313947] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:05.360667] [DEBUG] [LOCAL ] BJ: Loaded 51545 existing records from primary storage. [2025-10-22T17:35:05.360962] [INFO ] [MAIN ] BJ: Loaded 51545 existing records. [2025-10-22T17:35:05.538106] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T17:35:05.537856] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:05.539910] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-22T17:35:05.539972] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-22T17:35:05.540193] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-22T17:35:05.540231] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-22T17:35:05.723005] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-22T17:35:05.893300] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:06.517749] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-22T17:35:07.117930] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T17:35:07.317696] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-22T17:35:07.504896] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T17:35:08.117710] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-22T17:35:08.917683] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-22T17:35:09.064932] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:35:09.191126] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T17:35:09.717768] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-22T17:35:10.356013] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T17:35:10.357013] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4187 records). [2025-10-22T17:35:10.357084] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-22T17:35:10.519742] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-22T17:35:10.727708] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-22T17:35:10.727852] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-22T17:35:10.728083] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-22T17:35:10.728156] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-22T17:35:10.728724] [DEBUG] [LOCAL ] BIPJ: Trimmed 4187 records to 3106 (keeping 200 days of data) [2025-10-22T17:35:10.747860] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3106 records). [2025-10-22T17:35:10.747995] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-22T17:35:10.748235] [INFO ] [MAIN ] Update Progress: 282/2367 symbols completed. BIPJ took 25.0s. Estimated remaining: 4h 19m 32s. Rate: 8.0 symbols/min [2025-10-22T17:35:10.886958] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T17:35:10.960127] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:11.015016] [DEBUG] [LOCAL ] BK: Loaded 53546 existing records from primary storage. [2025-10-22T17:35:11.015388] [INFO ] [MAIN ] BK: Loaded 53546 existing records. [2025-10-22T17:35:11.188917] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:11.189140] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-22T17:35:11.189186] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-22T17:35:11.189368] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-22T17:35:11.189405] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-22T17:35:11.325012] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-22T17:35:11.540749] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:11.554311] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T17:35:12.117732] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-22T17:35:12.917739] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-22T17:35:13.116871] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:35:13.697417] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T17:35:13.717616] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-22T17:35:14.517670] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-22T17:35:14.628920] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T17:35:15.317718] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-22T17:35:15.432166] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:35:16.122839] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-22T17:35:16.143773] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T17:35:16.604490] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T17:35:16.917701] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-22T17:35:17.717699] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-22T17:35:17.978143] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T17:35:18.517690] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-22T17:35:18.725513] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:35:18.755608] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T17:35:19.317703] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-22T17:35:20.117719] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-22T17:35:20.256202] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T17:35:20.782255] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T17:35:20.917690] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-22T17:35:21.717731] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-22T17:35:21.974201] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T17:35:22.247921] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T17:35:22.252940] [INFO ] [REMOTE ] BIT: Full fetch complete (32317 records). [2025-10-22T17:35:22.253030] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-22T17:35:22.522738] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-22T17:35:22.629841] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-22T17:35:22.629946] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-22T17:35:22.630452] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-22T17:35:22.630515] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-22T17:35:22.631241] [DEBUG] [LOCAL ] BIT: Trimmed 32317 records to 23774 (keeping 200 days of data) [2025-10-22T17:35:22.771617] [DEBUG] [LOCAL ] BIT: Primary data saved (23774 records). [2025-10-22T17:35:22.771761] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-22T17:35:22.771838] [INFO ] [MAIN ] Update Progress: 283/2367 symbols completed. BIT took 37.0s. Estimated remaining: 4h 19m 58s. Rate: 8.0 symbols/min [2025-10-22T17:35:22.940705] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:22.982629] [DEBUG] [LOCAL ] BKD: Loaded 50448 existing records from primary storage. [2025-10-22T17:35:22.982953] [INFO ] [MAIN ] BKD: Loaded 50448 existing records. [2025-10-22T17:35:23.156147] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:23.156343] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-22T17:35:23.156388] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-22T17:35:23.156616] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-22T17:35:23.156699] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-22T17:35:23.330177] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-22T17:35:23.543006] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:23.566168] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T17:35:23.575219] [INFO ] [REMOTE ] BIRK: Full fetch complete (73449 records). [2025-10-22T17:35:23.575348] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-22T17:35:23.957804] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-22T17:35:23.957912] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-22T17:35:23.959031] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-22T17:35:23.959114] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-22T17:35:23.960696] [DEBUG] [LOCAL ] BIRK: Trimmed 73449 records to 51188 (keeping 200 days of data) [2025-10-22T17:35:24.125709] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-22T17:35:24.220493] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T17:35:24.295442] [DEBUG] [LOCAL ] BIRK: Primary data saved (51188 records). [2025-10-22T17:35:24.295561] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-22T17:35:24.295634] [INFO ] [MAIN ] Update Progress: 284/2367 symbols completed. BIRK took 38.6s. Estimated remaining: 4h 19m 7s. Rate: 8.0 symbols/min [2025-10-22T17:35:24.465296] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:24.495114] [DEBUG] [LOCAL ] BKE: Loaded 33720 existing records from primary storage. [2025-10-22T17:35:24.495402] [INFO ] [MAIN ] BKE: Loaded 33720 existing records. [2025-10-22T17:35:24.669548] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:24.669809] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-22T17:35:24.669857] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-22T17:35:24.670223] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-22T17:35:24.670281] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-22T17:35:24.923143] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-22T17:35:25.030054] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:25.344623] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T17:35:25.491421] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:35:25.717705] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-22T17:35:26.517711] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-22T17:35:26.862315] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T17:35:27.196196] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T17:35:27.317742] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-22T17:35:28.117617] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-22T17:35:28.917817] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-22T17:35:29.142711] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T17:35:29.171691] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-22T17:35:29.643799] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T17:35:29.717618] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-22T17:35:30.517737] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-22T17:35:30.572167] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:35:30.600700] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T17:35:31.317737] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-22T17:35:32.117722] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-22T17:35:32.442914] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T17:35:32.568468] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:35:32.917694] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-22T17:35:33.717707] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-22T17:35:34.455937] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-22T17:35:34.504984] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T17:35:34.517668] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-22T17:35:35.317625] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-22T17:35:35.579741] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T17:35:35.588314] [INFO ] [REMOTE ] BJ: Full fetch complete (74430 records). [2025-10-22T17:35:35.588435] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-22T17:35:36.012021] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-22T17:35:36.012117] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-22T17:35:36.012973] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-22T17:35:36.013076] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-22T17:35:36.014460] [DEBUG] [LOCAL ] BJ: Trimmed 74430 records to 51505 (keeping 200 days of data) [2025-10-22T17:35:36.123730] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-22T17:35:36.151386] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T17:35:36.352993] [DEBUG] [LOCAL ] BJ: Primary data saved (51505 records). [2025-10-22T17:35:36.353115] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-22T17:35:36.353191] [INFO ] [MAIN ] Update Progress: 285/2367 symbols completed. BJ took 31.2s. Estimated remaining: 4h 19m 33s. Rate: 8.0 symbols/min [2025-10-22T17:35:36.531951] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:36.563496] [DEBUG] [LOCAL ] BKH: Loaded 37390 existing records from primary storage. [2025-10-22T17:35:36.563818] [INFO ] [MAIN ] BKH: Loaded 37390 existing records. [2025-10-22T17:35:36.744636] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:36.744981] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-22T17:35:36.745062] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-22T17:35:36.745596] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-22T17:35:36.745752] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-22T17:35:36.895004] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:35:36.939444] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-22T17:35:37.140243] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:37.713200] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T17:35:37.723926] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-22T17:35:38.462983] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T17:35:38.517736] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-22T17:35:39.323490] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-22T17:35:39.346559] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:35:40.117727] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-22T17:35:40.378041] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T17:35:40.917617] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-22T17:35:41.099859] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T17:35:41.467288] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T17:35:41.717717] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-22T17:35:42.517729] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-22T17:35:42.640593] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T17:35:42.649359] [INFO ] [REMOTE ] BK: Full fetch complete (77678 records). [2025-10-22T17:35:42.649480] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-22T17:35:43.034307] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-22T17:35:43.034384] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-22T17:35:43.035190] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-22T17:35:43.035252] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-22T17:35:43.036751] [DEBUG] [LOCAL ] BK: Trimmed 77678 records to 53546 (keeping 200 days of data) [2025-10-22T17:35:43.273318] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:35:43.343976] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-22T17:35:43.391983] [DEBUG] [LOCAL ] BK: Primary data saved (53546 records). [2025-10-22T17:35:43.392087] [INFO ] [MAIN ] BK: Full history saved. [2025-10-22T17:35:43.392160] [INFO ] [MAIN ] Update Progress: 286/2367 symbols completed. BK took 32.6s. Estimated remaining: 4h 19m 22s. Rate: 8.0 symbols/min [2025-10-22T17:35:43.562980] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:43.598710] [DEBUG] [LOCAL ] BKKT: Loaded 37205 existing records from primary storage. [2025-10-22T17:35:43.599098] [INFO ] [MAIN ] BKKT: Loaded 37205 existing records. [2025-10-22T17:35:43.769322] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T17:35:43.801920] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:43.802854] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-22T17:35:43.802952] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-22T17:35:43.803473] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-22T17:35:43.803529] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-22T17:35:44.127904] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-22T17:35:44.159194] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:44.675296] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T17:35:44.917726] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-22T17:35:45.353893] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T17:35:45.717688] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-22T17:35:46.522766] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-22T17:35:46.543483] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:35:47.316701] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T17:35:47.323563] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-22T17:35:48.117688] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-22T17:35:48.340920] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:35:48.922747] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-22T17:35:48.938430] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T17:35:48.947542] [INFO ] [REMOTE ] BKD: Full fetch complete (72104 records). [2025-10-22T17:35:48.947735] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-22T17:35:49.347034] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-22T17:35:49.347148] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-22T17:35:49.347970] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-22T17:35:49.348050] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-22T17:35:49.367554] [DEBUG] [LOCAL ] BKD: Trimmed 72104 records to 50408 (keeping 200 days of data) [2025-10-22T17:35:49.369488] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T17:35:49.649212] [DEBUG] [LOCAL ] BKD: Primary data saved (50408 records). [2025-10-22T17:35:49.649379] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-22T17:35:49.650276] [INFO ] [MAIN ] Update Progress: 287/2367 symbols completed. BKD took 26.9s. Estimated remaining: 4h 19m 6s. Rate: 8.0 symbols/min [2025-10-22T17:35:49.724912] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-22T17:35:49.820245] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:49.830800] [DEBUG] [LOCAL ] BKN: Loaded 7286 existing records from primary storage. [2025-10-22T17:35:49.831016] [INFO ] [MAIN ] BKN: Loaded 7286 existing records. [2025-10-22T17:35:50.007722] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:50.007959] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-22T17:35:50.008036] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-22T17:35:50.008295] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-22T17:35:50.008348] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-22T17:35:50.298812] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T17:35:50.381497] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:50.517618] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-22T17:35:51.190544] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T17:35:51.317676] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-22T17:35:52.028954] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T17:35:52.117696] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-22T17:35:52.204302] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T17:35:52.917737] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-22T17:35:53.291920] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:35:53.717705] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-22T17:35:53.825307] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T17:35:54.517777] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-22T17:35:55.317742] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-22T17:35:55.451301] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:35:55.844442] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-22T17:35:55.944469] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T17:35:56.117705] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-22T17:35:56.917747] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-22T17:35:57.717720] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-22T17:35:57.816622] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T17:35:58.384837] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T17:35:58.517702] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-22T17:35:59.236478] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T17:35:59.317701] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-22T17:35:59.603130] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T17:36:00.117737] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-22T17:36:00.917713] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-22T17:36:01.605699] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T17:36:01.610992] [INFO ] [REMOTE ] BKE: Full fetch complete (50058 records). [2025-10-22T17:36:01.611120] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-22T17:36:01.611797] [FATAL] [VALIDATOR ] BKE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:36:01.611886] [FATAL] [MAIN ] BKE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:36:01.611928] [WARN ] [MAIN ] BKE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:36:01.611996] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-22T17:36:01.612061] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-10-22T17:36:01.612096] [INFO ] [LOCAL ] BKE: Starting deletion of derivative data. [2025-10-22T17:36:01.612255] [DEBUG] [LOCAL ] BKE: Deleted derivative data file. [2025-10-22T17:36:01.612986] [INFO ] [MAIN ] Update Progress: 288/2367 symbols completed. BKE took 37.3s. Estimated remaining: 4h 19m 31s. Rate: 8.0 symbols/min [2025-10-22T17:36:01.722852] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-22T17:36:01.818175] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:01.869785] [DEBUG] [LOCAL ] BKSY: Loaded 48901 existing records from primary storage. [2025-10-22T17:36:01.870132] [INFO ] [MAIN ] BKSY: Loaded 48901 existing records. [2025-10-22T17:36:02.058796] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:02.059055] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-22T17:36:02.059133] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-22T17:36:02.059587] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-22T17:36:02.059683] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-22T17:36:02.421756] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:02.496012] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-22T17:36:02.517607] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-22T17:36:03.317724] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-22T17:36:03.478231] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T17:36:03.908994] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-22T17:36:04.117691] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-22T17:36:04.804507] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-22T17:36:04.881053] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T17:36:04.917685] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-22T17:36:05.213875] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T17:36:05.717711] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-22T17:36:05.739520] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T17:36:06.517727] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-22T17:36:07.284570] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T17:36:07.317616] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-22T17:36:07.805034] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T17:36:07.939315] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T17:36:08.117706] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-22T17:36:08.917704] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-22T17:36:09.717740] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-22T17:36:10.332119] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T17:36:10.517709] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-22T17:36:10.603999] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T17:36:10.742484] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-22T17:36:10.751017] [INFO ] [REMOTE ] BKKT: Full fetch complete (51947 records). [2025-10-22T17:36:10.751126] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-22T17:36:11.131863] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-22T17:36:11.131940] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-22T17:36:11.132519] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-22T17:36:11.132560] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-22T17:36:11.133596] [DEBUG] [LOCAL ] BKKT: Trimmed 51947 records to 37391 (keeping 200 days of data) [2025-10-22T17:36:11.321004] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-22T17:36:11.350830] [DEBUG] [LOCAL ] BKKT: Primary data saved (37391 records). [2025-10-22T17:36:11.351468] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-22T17:36:11.352078] [INFO ] [MAIN ] Update Progress: 289/2367 symbols completed. BKKT took 28.0s. Estimated remaining: 4h 19m 39s. Rate: 8.0 symbols/min [2025-10-22T17:36:11.519299] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:11.534537] [DEBUG] [LOCAL ] BKT: Loaded 12824 existing records from primary storage. [2025-10-22T17:36:11.534795] [INFO ] [MAIN ] BKT: Loaded 12824 existing records. [2025-10-22T17:36:11.710225] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:11.710470] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-22T17:36:11.710546] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-22T17:36:11.710877] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-22T17:36:11.710929] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-22T17:36:12.020403] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T17:36:12.099532] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:12.117609] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-22T17:36:12.917683] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-22T17:36:13.283150] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:36:13.339893] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T17:36:13.717704] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-22T17:36:14.477601] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T17:36:14.511725] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T17:36:14.517822] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-22T17:36:14.519059] [INFO ] [REMOTE ] BKH: Full fetch complete (52918 records). [2025-10-22T17:36:14.519139] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-22T17:36:14.519873] [FATAL] [VALIDATOR ] BKH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:36:14.519958] [FATAL] [MAIN ] BKH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:36:14.520026] [WARN ] [MAIN ] BKH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:36:14.520101] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-22T17:36:14.520165] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-22T17:36:14.520204] [INFO ] [LOCAL ] BKH: Starting deletion of derivative data. [2025-10-22T17:36:14.520346] [DEBUG] [LOCAL ] BKH: Deleted derivative data file. [2025-10-22T17:36:14.520435] [INFO ] [MAIN ] Update Progress: 290/2367 symbols completed. BKH took 38.2s. Estimated remaining: 4h 19m 1s. Rate: 8.0 symbols/min [2025-10-22T17:36:14.695328] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:14.732448] [DEBUG] [LOCAL ] BKU: Loaded 42187 existing records from primary storage. [2025-10-22T17:36:14.732752] [INFO ] [MAIN ] BKU: Loaded 42187 existing records. [2025-10-22T17:36:14.920061] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:14.920280] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-22T17:36:14.920349] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-22T17:36:14.920530] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-22T17:36:14.920570] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-22T17:36:15.281058] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:15.317616] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-22T17:36:15.889180] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T17:36:16.117683] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-22T17:36:16.574329] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:36:16.917701] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-22T17:36:17.717687] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-22T17:36:17.831285] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T17:36:17.899871] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T17:36:18.456214] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T17:36:18.517747] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-22T17:36:19.304505] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T17:36:19.306418] [INFO ] [REMOTE ] BKN: Full fetch complete (11114 records). [2025-10-22T17:36:19.306495] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-22T17:36:19.327437] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-22T17:36:19.666533] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-22T17:36:19.666630] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-22T17:36:19.666921] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-22T17:36:19.666967] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-22T17:36:19.667421] [DEBUG] [LOCAL ] BKN: Trimmed 11114 records to 7279 (keeping 200 days of data) [2025-10-22T17:36:19.712495] [DEBUG] [LOCAL ] BKN: Primary data saved (7279 records). [2025-10-22T17:36:19.712720] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-22T17:36:19.712823] [INFO ] [MAIN ] Update Progress: 291/2367 symbols completed. BKN took 30.1s. Estimated remaining: 4h 18m 37s. Rate: 8.0 symbols/min [2025-10-22T17:36:19.881441] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:19.908880] [DEBUG] [LOCAL ] BKV: Loaded 29490 existing records from primary storage. [2025-10-22T17:36:19.909137] [INFO ] [MAIN ] BKV: Loaded 29490 existing records. [2025-10-22T17:36:20.084617] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:20.084840] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-22T17:36:20.084888] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-22T17:36:20.085062] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-22T17:36:20.085100] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-22T17:36:20.127122] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-22T17:36:20.469972] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:20.917702] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-22T17:36:20.951282] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T17:36:21.020547] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:36:21.717697] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-22T17:36:22.375279] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:36:22.517708] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-22T17:36:23.317721] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-22T17:36:23.481753] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T17:36:23.683093] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T17:36:24.117708] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-22T17:36:24.500204] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T17:36:24.917705] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-22T17:36:25.717685] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-22T17:36:25.753629] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T17:36:26.517749] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-22T17:36:26.652774] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T17:36:26.911753] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T17:36:27.317620] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-22T17:36:27.803015] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T17:36:28.117714] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-22T17:36:28.917677] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-22T17:36:29.427505] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T17:36:29.566896] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:36:29.717716] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-22T17:36:30.303724] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-22T17:36:30.398341] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T17:36:30.517713] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-22T17:36:31.317694] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-22T17:36:32.033402] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T17:36:32.117694] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-22T17:36:32.624108] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T17:36:32.917696] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-22T17:36:33.717700] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-22T17:36:34.225294] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T17:36:34.290356] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T17:36:34.452693] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-22T17:36:34.464388] [INFO ] [REMOTE ] BKSY: Full fetch complete (70576 records). [2025-10-22T17:36:34.464534] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-22T17:36:34.522710] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-22T17:36:34.850258] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-22T17:36:34.850336] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-22T17:36:34.851081] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-22T17:36:34.851144] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-22T17:36:34.852408] [DEBUG] [LOCAL ] BKSY: Trimmed 70576 records to 48912 (keeping 200 days of data) [2025-10-22T17:36:35.130859] [DEBUG] [LOCAL ] BKSY: Primary data saved (48912 records). [2025-10-22T17:36:35.130988] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-22T17:36:35.131616] [INFO ] [MAIN ] Update Progress: 292/2367 symbols completed. BKSY took 33.5s. Estimated remaining: 4h 19m 26s. Rate: 8.0 symbols/min [2025-10-22T17:36:35.304002] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:35.324263] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-22T17:36:35.340326] [DEBUG] [LOCAL ] BLCO: Loaded 35044 existing records from primary storage. [2025-10-22T17:36:35.340588] [INFO ] [MAIN ] BLCO: Loaded 35044 existing records. [2025-10-22T17:36:35.516085] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:35.516309] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-22T17:36:35.516358] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-22T17:36:35.516543] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-22T17:36:35.516582] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-22T17:36:35.868489] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:36.117728] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-22T17:36:36.220599] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T17:36:36.410617] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:36:36.917722] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-22T17:36:37.451585] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T17:36:37.717723] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-22T17:36:37.898954] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T17:36:37.904772] [INFO ] [REMOTE ] BKT: Full fetch complete (16717 records). [2025-10-22T17:36:37.904885] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-22T17:36:38.273793] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-22T17:36:38.273904] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-22T17:36:38.274280] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-22T17:36:38.274345] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-22T17:36:38.274931] [DEBUG] [LOCAL ] BKT: Trimmed 16717 records to 12833 (keeping 200 days of data) [2025-10-22T17:36:38.351554] [DEBUG] [LOCAL ] BKT: Primary data saved (12833 records). [2025-10-22T17:36:38.351708] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-22T17:36:38.351796] [INFO ] [MAIN ] Update Progress: 293/2367 symbols completed. BKT took 27.0s. Estimated remaining: 4h 18m 48s. Rate: 8.0 symbols/min [2025-10-22T17:36:38.517670] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:38.517749] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-22T17:36:38.543045] [DEBUG] [LOCAL ] BLD: Loaded 27198 existing records from primary storage. [2025-10-22T17:36:38.543289] [INFO ] [MAIN ] BLD: Loaded 27198 existing records. [2025-10-22T17:36:38.718977] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:38.719178] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-22T17:36:38.719227] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-22T17:36:38.719418] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-22T17:36:38.719473] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-22T17:36:39.079932] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:39.143495] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T17:36:39.317695] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-22T17:36:40.124593] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-22T17:36:40.141739] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T17:36:40.735349] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T17:36:40.917722] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-22T17:36:41.487768] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T17:36:41.717706] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-22T17:36:42.386172] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T17:36:42.517674] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-22T17:36:43.064603] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T17:36:43.317745] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-22T17:36:43.942155] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:36:44.117761] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-22T17:36:44.392114] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T17:36:44.917745] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-22T17:36:45.605058] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T17:36:45.717623] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-22T17:36:46.265102] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T17:36:46.517707] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-22T17:36:47.317735] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-22T17:36:47.516750] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T17:36:47.524580] [INFO ] [REMOTE ] BKU: Full fetch complete (61016 records). [2025-10-22T17:36:47.524723] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-22T17:36:47.914753] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-22T17:36:47.914945] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-22T17:36:47.920950] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-22T17:36:47.921024] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-22T17:36:47.943362] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T17:36:47.949484] [DEBUG] [LOCAL ] BKU: Trimmed 61016 records to 42169 (keeping 200 days of data) [2025-10-22T17:36:48.124679] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-22T17:36:48.208424] [DEBUG] [LOCAL ] BKU: Primary data saved (42169 records). [2025-10-22T17:36:48.208576] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-22T17:36:48.208699] [INFO ] [MAIN ] Update Progress: 294/2367 symbols completed. BKU took 33.7s. Estimated remaining: 4h 18m 58s. Rate: 8.0 symbols/min [2025-10-22T17:36:48.378988] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:48.428987] [DEBUG] [LOCAL ] BLDR: Loaded 51874 existing records from primary storage. [2025-10-22T17:36:48.429298] [INFO ] [MAIN ] BLDR: Loaded 51874 existing records. [2025-10-22T17:36:48.606680] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:48.606973] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-22T17:36:48.607036] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-22T17:36:48.607210] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-22T17:36:48.607249] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-22T17:36:48.899867] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:36:48.928375] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-22T17:36:48.996688] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:49.401436] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T17:36:49.717743] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-22T17:36:49.981952] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:36:50.517722] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-22T17:36:51.317702] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-22T17:36:51.790091] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-22T17:36:52.090173] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T17:36:52.117612] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-22T17:36:52.230809] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T17:36:52.917696] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-22T17:36:53.389392] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T17:36:53.717699] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-22T17:36:54.517714] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-22T17:36:54.564535] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:36:55.073015] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T17:36:55.317700] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-22T17:36:55.964044] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T17:36:55.969581] [INFO ] [REMOTE ] BKV: Full fetch complete (44760 records). [2025-10-22T17:36:55.969708] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-22T17:36:56.139633] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-22T17:36:56.346492] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-22T17:36:56.346568] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-22T17:36:56.347139] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-22T17:36:56.347201] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-22T17:36:56.348130] [DEBUG] [LOCAL ] BKV: Trimmed 44760 records to 29342 (keeping 200 days of data) [2025-10-22T17:36:56.512565] [DEBUG] [LOCAL ] BKV: Primary data saved (29342 records). [2025-10-22T17:36:56.512729] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-22T17:36:56.512817] [INFO ] [MAIN ] Update Progress: 295/2367 symbols completed. BKV took 36.8s. Estimated remaining: 4h 18m 56s. Rate: 8.0 symbols/min [2025-10-22T17:36:56.679342] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:56.692544] [DEBUG] [LOCAL ] BLE: Loaded 13755 existing records from primary storage. [2025-10-22T17:36:56.692813] [INFO ] [MAIN ] BLE: Loaded 13755 existing records. [2025-10-22T17:36:56.867200] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:56.867415] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-22T17:36:56.867461] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-22T17:36:56.867619] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-22T17:36:56.867722] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-22T17:36:56.934221] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-22T17:36:57.234571] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:57.287252] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T17:36:57.288413] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T17:36:57.717726] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-22T17:36:58.464877] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T17:36:58.517705] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-22T17:36:58.982628] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T17:36:59.317711] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-22T17:36:59.418843] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T17:37:00.117693] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-22T17:37:00.917700] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-22T17:37:01.236296] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T17:37:01.307530] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T17:37:01.717811] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-22T17:37:02.517738] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-22T17:37:02.664159] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T17:37:03.030078] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T17:37:03.317740] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-22T17:37:03.485114] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T17:37:04.117727] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-22T17:37:04.917720] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-22T17:37:04.999776] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:37:05.625158] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T17:37:05.630522] [INFO ] [REMOTE ] BLCO: Full fetch complete (52406 records). [2025-10-22T17:37:05.630618] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-22T17:37:05.726593] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-22T17:37:06.003764] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-22T17:37:06.003851] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-22T17:37:06.004454] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-22T17:37:06.004494] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-22T17:37:06.005613] [DEBUG] [LOCAL ] BLCO: Trimmed 52406 records to 34928 (keeping 200 days of data) [2025-10-22T17:37:06.205921] [DEBUG] [LOCAL ] BLCO: Primary data saved (34928 records). [2025-10-22T17:37:06.206067] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-22T17:37:06.206751] [INFO ] [MAIN ] Update Progress: 296/2367 symbols completed. BLCO took 31.1s. Estimated remaining: 4h 19m 4s. Rate: 8.0 symbols/min [2025-10-22T17:37:06.376004] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:06.411049] [DEBUG] [LOCAL ] BLK: Loaded 34328 existing records from primary storage. [2025-10-22T17:37:06.411319] [INFO ] [MAIN ] BLK: Loaded 34328 existing records. [2025-10-22T17:37:06.522913] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-22T17:37:06.590089] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:06.590394] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-22T17:37:06.590573] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-22T17:37:06.590802] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-22T17:37:06.590858] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-22T17:37:06.947956] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:06.978547] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T17:37:07.019530] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T17:37:07.023841] [INFO ] [REMOTE ] BLD: Full fetch complete (39949 records). [2025-10-22T17:37:07.023930] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-22T17:37:07.188104] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T17:37:07.325127] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-22T17:37:07.414754] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-22T17:37:07.414841] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-22T17:37:07.415447] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-22T17:37:07.415488] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-22T17:37:07.416350] [DEBUG] [LOCAL ] BLD: Trimmed 39949 records to 27046 (keeping 200 days of data) [2025-10-22T17:37:07.574969] [DEBUG] [LOCAL ] BLD: Primary data saved (27046 records). [2025-10-22T17:37:07.575114] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-22T17:37:07.575195] [INFO ] [MAIN ] Update Progress: 297/2367 symbols completed. BLD took 29.2s. Estimated remaining: 4h 18m 13s. Rate: 8.0 symbols/min [2025-10-22T17:37:07.737513] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:07.780716] [DEBUG] [LOCAL ] BLND: Loaded 49223 existing records from primary storage. [2025-10-22T17:37:07.781050] [INFO ] [MAIN ] BLND: Loaded 49223 existing records. [2025-10-22T17:37:07.972090] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:07.972322] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-22T17:37:07.972369] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-22T17:37:07.972562] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-22T17:37:07.972600] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-22T17:37:08.129053] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-22T17:37:08.324011] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:08.857753] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T17:37:08.917839] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-22T17:37:09.313104] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T17:37:09.717706] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-22T17:37:10.517676] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-22T17:37:10.657287] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:37:11.317671] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-22T17:37:11.390885] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:37:11.562386] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T17:37:12.117741] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-22T17:37:12.917683] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-22T17:37:13.024502] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T17:37:13.717619] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-22T17:37:13.894364] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T17:37:13.965875] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T17:37:14.517746] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-22T17:37:15.323165] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-22T17:37:15.324812] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T17:37:15.618348] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T17:37:16.117680] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-22T17:37:16.504536] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T17:37:16.917700] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-22T17:37:17.722875] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-22T17:37:17.737854] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T17:37:17.995455] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:37:17.998911] [INFO ] [REMOTE ] BLE: Full fetch complete (19555 records). [2025-10-22T17:37:17.999006] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-22T17:37:18.359114] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-22T17:37:18.359184] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-22T17:37:18.359539] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-22T17:37:18.359579] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-22T17:37:18.360115] [DEBUG] [LOCAL ] BLE: Trimmed 19555 records to 13616 (keeping 200 days of data) [2025-10-22T17:37:18.437758] [DEBUG] [LOCAL ] BLE: Primary data saved (13616 records). [2025-10-22T17:37:18.437891] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-22T17:37:18.437966] [INFO ] [MAIN ] Update Progress: 298/2367 symbols completed. BLE took 21.9s. Estimated remaining: 4h 18m 29s. Rate: 8.0 symbols/min [2025-10-22T17:37:18.526120] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-22T17:37:18.603994] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:18.604125] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-22T17:37:18.604161] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-22T17:37:18.604265] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-22T17:37:18.604305] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-22T17:37:18.604346] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-22T17:37:18.604377] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-22T17:37:18.947877] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:19.317619] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-22T17:37:19.494547] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:37:19.507513] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:37:19.507780] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-22T17:37:19.507866] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:37:19.507931] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-22T17:37:19.507996] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:37:19.508066] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-22T17:37:19.508127] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-22T17:37:19.508162] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-22T17:37:19.508201] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-22T17:37:19.508242] [INFO ] [MAIN ] Update Progress: 299/2367 symbols completed. BLSH took 1.1s. Estimated remaining: 4h 17m 37s. Rate: 8.0 symbols/min [2025-10-22T17:37:19.677754] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:19.692304] [DEBUG] [LOCAL ] BLW: Loaded 13120 existing records from primary storage. [2025-10-22T17:37:19.692564] [INFO ] [MAIN ] BLW: Loaded 13120 existing records. [2025-10-22T17:37:19.865882] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:19.866094] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-22T17:37:19.866140] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-22T17:37:19.866338] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-22T17:37:19.866393] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-22T17:37:20.122155] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-22T17:37:20.222171] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:20.505151] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T17:37:20.917711] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-22T17:37:21.717839] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-22T17:37:22.103168] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T17:37:22.517801] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-22T17:37:22.563148] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:37:23.317720] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-22T17:37:23.669012] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T17:37:23.677342] [INFO ] [REMOTE ] BLDR: Full fetch complete (74771 records). [2025-10-22T17:37:23.677466] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-22T17:37:24.057487] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-22T17:37:24.057623] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-22T17:37:24.058565] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-22T17:37:24.058680] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-22T17:37:24.060239] [DEBUG] [LOCAL ] BLDR: Trimmed 74771 records to 51855 (keeping 200 days of data) [2025-10-22T17:37:24.118739] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-22T17:37:24.177604] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T17:37:24.420705] [DEBUG] [LOCAL ] BLDR: Primary data saved (51855 records). [2025-10-22T17:37:24.420888] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-22T17:37:24.421023] [INFO ] [MAIN ] Update Progress: 300/2367 symbols completed. BLDR took 36.2s. Estimated remaining: 4h 17m 12s. Rate: 8.0 symbols/min [2025-10-22T17:37:24.594438] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:24.608836] [DEBUG] [LOCAL ] BLX: Loaded 15521 existing records from primary storage. [2025-10-22T17:37:24.609060] [INFO ] [MAIN ] BLX: Loaded 15521 existing records. [2025-10-22T17:37:24.788840] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:24.789332] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-22T17:37:24.789629] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-22T17:37:24.790236] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-22T17:37:24.795548] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-22T17:37:24.821695] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T17:37:24.918916] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-22T17:37:24.927305] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T17:37:25.211106] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:25.717690] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-22T17:37:25.812232] [DEBUG] [REMOTE ] BLW: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-22T17:37:25.812482] [WARN ] [REMOTE ] BLW: No data returned for month 2025-02 [2025-10-22T17:37:25.812585] [FATAL] [REMOTE ] BLW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:37:25.812726] [FATAL] [MAIN ] BLW: Failed to fetch primary data. [2025-10-22T17:37:25.812812] [WARN ] [MAIN ] BLW: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:37:25.812908] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-22T17:37:25.812990] [DEBUG] [LOCAL ] BLW: No primary data file found to delete. [2025-10-22T17:37:25.813028] [INFO ] [LOCAL ] BLW: Starting deletion of derivative data. [2025-10-22T17:37:25.813158] [DEBUG] [LOCAL ] BLW: Deleted derivative data file. [2025-10-22T17:37:25.813238] [INFO ] [MAIN ] Update Progress: 301/2367 symbols completed. BLW took 6.3s. Estimated remaining: 4h 16m 23s. Rate: 8.1 symbols/min [2025-10-22T17:37:25.981283] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:26.014691] [DEBUG] [LOCAL ] BMA: Loaded 36526 existing records from primary storage. [2025-10-22T17:37:26.014991] [INFO ] [MAIN ] BMA: Loaded 36526 existing records. [2025-10-22T17:37:26.188634] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:26.189022] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-22T17:37:26.189079] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-22T17:37:26.189634] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-22T17:37:26.189722] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-22T17:37:26.528896] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-22T17:37:26.557538] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T17:37:26.560636] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:27.317732] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-22T17:37:28.117728] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-22T17:37:28.202401] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T17:37:28.917755] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-22T17:37:29.221051] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T17:37:29.562081] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T17:37:29.717745] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-22T17:37:30.039508] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T17:37:30.517704] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-22T17:37:31.051953] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T17:37:31.317716] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-22T17:37:32.064500] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:37:32.117657] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-22T17:37:32.904180] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T17:37:32.917602] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-22T17:37:33.513529] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T17:37:33.717758] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-22T17:37:34.512261] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T17:37:34.518926] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-22T17:37:35.051070] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T17:37:35.317694] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-22T17:37:35.996822] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T17:37:36.117775] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-22T17:37:36.917751] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-22T17:37:37.143139] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T17:37:37.149556] [INFO ] [REMOTE ] BLK: Full fetch complete (53057 records). [2025-10-22T17:37:37.149719] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-22T17:37:37.621770] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-22T17:37:37.622915] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-22T17:37:37.623601] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T17:37:37.625038] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-22T17:37:37.628840] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-22T17:37:37.630158] [DEBUG] [LOCAL ] BLK: Trimmed 53057 records to 34184 (keeping 200 days of data) [2025-10-22T17:37:37.740229] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-22T17:37:37.793946] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T17:37:37.909576] [DEBUG] [LOCAL ] BLK: Primary data saved (34184 records). [2025-10-22T17:37:37.909748] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-22T17:37:37.910469] [INFO ] [MAIN ] Update Progress: 302/2367 symbols completed. BLK took 31.7s. Estimated remaining: 4h 16m 47s. Rate: 8.0 symbols/min [2025-10-22T17:37:38.075260] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:38.088634] [DEBUG] [LOCAL ] BME: Loaded 11279 existing records from primary storage. [2025-10-22T17:37:38.088900] [INFO ] [MAIN ] BME: Loaded 11279 existing records. [2025-10-22T17:37:38.263216] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:38.263472] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-22T17:37:38.263519] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-22T17:37:38.263737] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-22T17:37:38.263794] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-22T17:37:38.524426] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-22T17:37:38.612712] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:39.219922] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T17:37:39.317729] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-22T17:37:40.117709] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-22T17:37:40.314244] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T17:37:40.322987] [INFO ] [REMOTE ] BLND: Full fetch complete (72224 records). [2025-10-22T17:37:40.323138] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-22T17:37:40.751547] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-22T17:37:40.751882] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-22T17:37:40.770521] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-22T17:37:40.772184] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T17:37:40.771230] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-22T17:37:40.780834] [DEBUG] [LOCAL ] BLND: Trimmed 72224 records to 49215 (keeping 200 days of data) [2025-10-22T17:37:40.943946] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-22T17:37:41.057379] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T17:37:41.073321] [DEBUG] [LOCAL ] BLND: Primary data saved (49215 records). [2025-10-22T17:37:41.073401] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-22T17:37:41.073946] [INFO ] [MAIN ] Update Progress: 303/2367 symbols completed. BLND took 33.5s. Estimated remaining: 4h 16m 11s. Rate: 8.1 symbols/min [2025-10-22T17:37:41.236551] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:41.261232] [DEBUG] [LOCAL ] BMEZ: Loaded 25212 existing records from primary storage. [2025-10-22T17:37:41.261481] [INFO ] [MAIN ] BMEZ: Loaded 25212 existing records. [2025-10-22T17:37:41.454226] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:41.454489] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-22T17:37:41.454542] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-22T17:37:41.454755] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-22T17:37:41.454810] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-22T17:37:41.718372] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-22T17:37:41.831588] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:42.021946] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T17:37:42.517706] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-22T17:37:42.960384] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:37:43.317752] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-22T17:37:43.815032] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T17:37:44.117724] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-22T17:37:44.752262] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:37:44.918157] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-22T17:37:44.918024] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T17:37:45.717694] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-22T17:37:46.325873] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T17:37:46.517721] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-22T17:37:47.055379] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:37:47.317749] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-22T17:37:47.549865] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T17:37:48.117755] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-22T17:37:48.914545] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T17:37:48.917809] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-22T17:37:48.973089] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:37:49.717672] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-22T17:37:49.993244] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T17:37:50.517720] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-22T17:37:51.317687] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-22T17:37:51.632208] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T17:37:52.083335] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-22T17:37:52.090932] [INFO ] [REMOTE ] BMA: Full fetch complete (52378 records). [2025-10-22T17:37:52.091064] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-22T17:37:52.122991] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-22T17:37:52.411325] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T17:37:52.511747] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-22T17:37:52.511835] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-22T17:37:52.512502] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-22T17:37:52.512544] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-22T17:37:52.513623] [DEBUG] [LOCAL ] BMA: Trimmed 52378 records to 36532 (keeping 200 days of data) [2025-10-22T17:37:52.732946] [DEBUG] [LOCAL ] BMA: Primary data saved (36532 records). [2025-10-22T17:37:52.733082] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-22T17:37:52.733734] [INFO ] [MAIN ] Update Progress: 304/2367 symbols completed. BMA took 26.9s. Estimated remaining: 4h 16m 32s. Rate: 8.0 symbols/min [2025-10-22T17:37:52.904619] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:52.920182] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-22T17:37:52.932483] [DEBUG] [LOCAL ] BMI: Loaded 24889 existing records from primary storage. [2025-10-22T17:37:52.932784] [INFO ] [MAIN ] BMI: Loaded 24889 existing records. [2025-10-22T17:37:53.128190] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:53.128569] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-22T17:37:53.128719] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-22T17:37:53.129011] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-22T17:37:53.129123] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-22T17:37:53.300446] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T17:37:53.677975] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:53.717769] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-22T17:37:53.947130] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T17:37:54.218686] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T17:37:54.517691] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-22T17:37:55.317735] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-22T17:37:56.112233] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T17:37:56.117604] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-22T17:37:56.813757] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T17:37:56.917614] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-22T17:37:57.181952] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T17:37:57.646100] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T17:37:57.717606] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-22T17:37:58.517739] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-22T17:37:58.954963] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T17:37:59.317698] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-22T17:37:59.495035] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T17:38:00.113184] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T17:38:00.117617] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-22T17:38:00.917692] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-22T17:38:01.717751] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-22T17:38:02.131480] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:38:02.216635] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T17:38:02.219635] [INFO ] [REMOTE ] BLX: Full fetch complete (22543 records). [2025-10-22T17:38:02.219736] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-22T17:38:02.522810] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-22T17:38:02.585466] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-22T17:38:02.585541] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-22T17:38:02.586001] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-22T17:38:02.586065] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-22T17:38:02.586731] [DEBUG] [LOCAL ] BLX: Trimmed 22543 records to 15410 (keeping 200 days of data) [2025-10-22T17:38:02.676907] [DEBUG] [LOCAL ] BLX: Primary data saved (15410 records). [2025-10-22T17:38:02.677024] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-22T17:38:02.677098] [INFO ] [MAIN ] Update Progress: 305/2367 symbols completed. BLX took 38.3s. Estimated remaining: 4h 16m 41s. Rate: 8.0 symbols/min [2025-10-22T17:38:02.844340] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:02.849108] [DEBUG] [LOCAL ] BMN: Loaded 2581 existing records from primary storage. [2025-10-22T17:38:02.849286] [INFO ] [MAIN ] BMN: Loaded 2581 existing records. [2025-10-22T17:38:03.034957] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:03.046007] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-22T17:38:03.046941] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T17:38:03.047038] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-22T17:38:03.051417] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-22T17:38:03.051478] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-22T17:38:03.081729] [INFO ] [REMOTE ] BMEZ: Full fetch complete (39529 records). [2025-10-22T17:38:03.113944] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-22T17:38:03.321909] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-22T17:38:03.607452] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T17:38:03.737456] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:03.835417] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-22T17:38:03.835509] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-22T17:38:03.836165] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-22T17:38:03.836229] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-22T17:38:03.837152] [DEBUG] [LOCAL ] BMEZ: Trimmed 39529 records to 25062 (keeping 200 days of data) [2025-10-22T17:38:04.003039] [DEBUG] [LOCAL ] BMEZ: Primary data saved (25062 records). [2025-10-22T17:38:04.003175] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-22T17:38:04.003259] [INFO ] [MAIN ] Update Progress: 306/2367 symbols completed. BMEZ took 22.9s. Estimated remaining: 4h 15m 52s. Rate: 8.1 symbols/min [2025-10-22T17:38:04.128036] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-22T17:38:04.200219] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:04.200426] [DEBUG] [LOCAL ] BMO: No existing data file found in primary storage. [2025-10-22T17:38:04.200472] [WARN ] [MAIN ] BMO: No existing data found, performing full refresh instead. [2025-10-22T17:38:04.200583] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-22T17:38:04.200623] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-22T17:38:04.200704] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-10-22T17:38:04.200748] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-22T17:38:04.571809] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T17:38:04.571129] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:04.762542] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T17:38:04.917680] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-22T17:38:05.350695] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T17:38:05.717717] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-22T17:38:06.517745] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-22T17:38:06.745804] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T17:38:07.317730] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-22T17:38:08.117726] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-22T17:38:08.182898] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T17:38:08.491287] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-22T17:38:08.514682] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T17:38:08.917734] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-22T17:38:09.516226] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-22T17:38:09.717700] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-22T17:38:10.517687] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-22T17:38:10.604913] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T17:38:11.317769] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-22T17:38:11.966228] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T17:38:12.117712] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-22T17:38:12.460468] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:38:12.917739] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-22T17:38:13.668713] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T17:38:13.690953] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T17:38:13.717609] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-22T17:38:14.517692] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-22T17:38:14.622610] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T17:38:15.317703] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-22T17:38:15.900447] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T17:38:16.117684] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-22T17:38:16.143065] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T17:38:16.917763] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-22T17:38:17.431817] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:38:17.546763] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T17:38:17.717718] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-22T17:38:18.517716] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-22T17:38:18.577446] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T17:38:19.317728] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-22T17:38:19.681055] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T17:38:20.117737] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-22T17:38:20.262531] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:38:20.265518] [INFO ] [REMOTE ] BME: Full fetch complete (15694 records). [2025-10-22T17:38:20.265690] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-22T17:38:20.436762] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-22T17:38:20.641144] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-22T17:38:20.641240] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-22T17:38:20.641634] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-22T17:38:20.641718] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-22T17:38:20.642422] [DEBUG] [LOCAL ] BME: Trimmed 15694 records to 11221 (keeping 200 days of data) [2025-10-22T17:38:20.711524] [DEBUG] [LOCAL ] BME: Primary data saved (11221 records). [2025-10-22T17:38:20.711698] [INFO ] [MAIN ] BME: Full history saved. [2025-10-22T17:38:20.711796] [INFO ] [MAIN ] Update Progress: 307/2367 symbols completed. BME took 42.8s. Estimated remaining: 4h 16m 47s. Rate: 8.0 symbols/min [2025-10-22T17:38:20.878631] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:20.924670] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-22T17:38:20.927296] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-22T17:38:20.927539] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-22T17:38:21.105282] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:21.105505] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-22T17:38:21.105563] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-22T17:38:21.105945] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-22T17:38:21.106002] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-22T17:38:21.467003] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:21.717697] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-22T17:38:22.493456] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T17:38:22.517685] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-22T17:38:22.661462] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T17:38:23.008663] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-22T17:38:23.317738] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-22T17:38:24.117733] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-22T17:38:24.665638] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T17:38:24.917716] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-22T17:38:25.717714] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-22T17:38:26.107980] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T17:38:26.180723] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T17:38:26.449251] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T17:38:26.517610] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-22T17:38:27.317739] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-22T17:38:28.118406] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-22T17:38:28.118318] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T17:38:28.917671] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-22T17:38:29.098476] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T17:38:29.528135] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T17:38:29.533134] [INFO ] [REMOTE ] BMI: Full fetch complete (34166 records). [2025-10-22T17:38:29.533256] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-22T17:38:29.724692] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-22T17:38:29.922875] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-22T17:38:29.922951] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-22T17:38:29.923421] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-22T17:38:29.923461] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-22T17:38:29.924317] [DEBUG] [LOCAL ] BMI: Trimmed 34166 records to 24901 (keeping 200 days of data) [2025-10-22T17:38:30.074617] [DEBUG] [LOCAL ] BMI: Primary data saved (24901 records). [2025-10-22T17:38:30.074899] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-22T17:38:30.074992] [INFO ] [MAIN ] Update Progress: 308/2367 symbols completed. BMI took 37.3s. Estimated remaining: 4h 16m 52s. Rate: 8.0 symbols/min [2025-10-22T17:38:30.247666] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:30.296236] [DEBUG] [LOCAL ] BN: Loaded 52984 existing records from primary storage. [2025-10-22T17:38:30.296547] [INFO ] [MAIN ] BN: Loaded 52984 existing records. [2025-10-22T17:38:30.478962] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:30.479207] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-22T17:38:30.479370] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-22T17:38:30.479909] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-22T17:38:30.479998] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-22T17:38:30.519279] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-22T17:38:30.537340] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T17:38:30.579627] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:38:30.870010] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:31.317686] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-22T17:38:32.117684] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-22T17:38:32.647555] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-22T17:38:32.648573] [INFO ] [REMOTE ] BMN: Full fetch complete (3723 records). [2025-10-22T17:38:32.648661] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-22T17:38:32.806385] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-22T17:38:32.920281] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-22T17:38:33.077594] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T17:38:33.077754] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-22T17:38:33.083938] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-22T17:38:33.084523] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-22T17:38:33.084807] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-22T17:38:33.086080] [INFO ] [REMOTE ] BMO: Full fetch complete (60019 records). [2025-10-22T17:38:33.086194] [DEBUG] [LOCAL ] BMN: Trimmed 3723 records to 2644 (keeping 200 days of data) [2025-10-22T17:38:33.086251] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-22T17:38:33.202689] [DEBUG] [LOCAL ] BMN: Primary data saved (2644 records). [2025-10-22T17:38:33.202806] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-22T17:38:33.203169] [INFO ] [MAIN ] Update Progress: 309/2367 symbols completed. BMN took 30.5s. Estimated remaining: 4h 16m 16s. Rate: 8.0 symbols/min [2025-10-22T17:38:33.573634] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:33.678781] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-22T17:38:33.686225] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-22T17:38:33.686949] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-22T17:38:33.687073] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-22T17:38:33.688367] [DEBUG] [LOCAL ] BMO: Trimmed 60019 records to 40992 (keeping 200 days of data) [2025-10-22T17:38:33.742602] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-22T17:38:33.762548] [DEBUG] [LOCAL ] BNED: Loaded 28324 existing records from primary storage. [2025-10-22T17:38:33.795352] [INFO ] [MAIN ] BNED: Loaded 28324 existing records. [2025-10-22T17:38:34.104677] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:34.115911] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-22T17:38:34.117018] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-22T17:38:34.120757] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-22T17:38:34.122063] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-22T17:38:34.206212] [DEBUG] [LOCAL ] BMO: Primary data saved (40992 records). [2025-10-22T17:38:34.225861] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-22T17:38:34.237476] [INFO ] [MAIN ] Update Progress: 310/2367 symbols completed. BMO took 30.2s. Estimated remaining: 4h 15m 25s. Rate: 8.1 symbols/min [2025-10-22T17:38:34.589603] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:34.668249] [DEBUG] [LOCAL ] BNH: Loaded 4741 existing records from primary storage. [2025-10-22T17:38:34.689794] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:34.690437] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-22T17:38:34.690182] [INFO ] [MAIN ] BNH: Loaded 4741 existing records. [2025-10-22T17:38:34.876900] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:34.902972] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-22T17:38:34.905817] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-22T17:38:34.906044] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-22T17:38:34.906542] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-22T17:38:34.907506] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T17:38:35.290826] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:35.317612] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-22T17:38:35.484389] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:38:35.893690] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T17:38:36.117689] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-22T17:38:36.798222] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-22T17:38:36.917684] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-22T17:38:37.014415] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T17:38:37.717738] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-22T17:38:38.517681] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-22T17:38:38.885159] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T17:38:39.070053] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T17:38:39.317721] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-22T17:38:40.117730] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-22T17:38:40.370368] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:38:40.446126] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T17:38:40.917713] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-22T17:38:41.690377] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:38:41.717667] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-22T17:38:42.347728] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T17:38:42.517781] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-22T17:38:43.317686] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-22T17:38:43.696508] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T17:38:43.740192] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T17:38:44.117669] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-22T17:38:44.917696] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-22T17:38:45.001296] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:38:45.565618] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T17:38:45.575834] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T17:38:45.717846] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-22T17:38:46.308115] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T17:38:46.517719] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-22T17:38:47.317700] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-22T17:38:48.118306] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-22T17:38:48.118213] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T17:38:48.140509] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T17:38:48.917752] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-22T17:38:49.717735] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-22T17:38:50.304340] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T17:38:50.312335] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T17:38:50.517773] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-22T17:38:50.588167] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:38:51.081079] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T17:38:51.317743] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-22T17:38:52.117718] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-22T17:38:52.917730] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-22T17:38:53.276769] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T17:38:53.442352] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T17:38:53.717730] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-22T17:38:54.517727] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-22T17:38:54.817327] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T17:38:55.317632] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-22T17:38:55.421035] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:38:55.873780] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T17:38:55.890058] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T17:38:56.117743] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-22T17:38:56.677619] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T17:38:56.917701] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-22T17:38:57.525099] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T17:38:57.717709] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-22T17:38:58.517705] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-22T17:38:58.589553] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T17:38:58.598756] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-22T17:38:58.598882] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-22T17:38:58.982710] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-22T17:38:58.982816] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-22T17:38:58.983705] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-22T17:38:58.983771] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-22T17:38:58.985349] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-22T17:38:59.319639] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-22T17:38:59.319786] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-22T17:38:59.321016] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-22T17:38:59.321838] [INFO ] [MAIN ] Update Progress: 311/2367 symbols completed. BMY took 38.6s. Estimated remaining: 4h 17m 15s. Rate: 8.0 symbols/min [2025-10-22T17:38:59.492763] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:59.499589] [DEBUG] [LOCAL ] BNJ: Loaded 2517 existing records from primary storage. [2025-10-22T17:38:59.499883] [INFO ] [MAIN ] BNJ: Loaded 2517 existing records. [2025-10-22T17:38:59.673412] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:59.673619] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-22T17:38:59.673697] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-22T17:38:59.673866] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-22T17:38:59.673920] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-22T17:39:00.038506] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:00.117685] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-22T17:39:00.269202] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T17:39:00.270593] [INFO ] [REMOTE ] BNH: Full fetch complete (6864 records). [2025-10-22T17:39:00.270685] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-22T17:39:00.670724] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-22T17:39:00.681937] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-22T17:39:00.682258] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-22T17:39:00.687458] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-22T17:39:00.709361] [DEBUG] [LOCAL ] BNH: Trimmed 6864 records to 4701 (keeping 200 days of data) [2025-10-22T17:39:00.723874] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T17:39:00.753509] [DEBUG] [LOCAL ] BNH: Primary data saved (4701 records). [2025-10-22T17:39:00.753639] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-22T17:39:00.753765] [INFO ] [MAIN ] Update Progress: 312/2367 symbols completed. BNH took 26.5s. Estimated remaining: 4h 16m 27s. Rate: 8.0 symbols/min [2025-10-22T17:39:00.916307] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:00.917692] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-22T17:39:00.958598] [DEBUG] [LOCAL ] BNL: Loaded 47118 existing records from primary storage. [2025-10-22T17:39:00.958944] [INFO ] [MAIN ] BNL: Loaded 47118 existing records. [2025-10-22T17:39:01.137823] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:01.138049] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-22T17:39:01.138097] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-22T17:39:01.138467] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-22T17:39:01.138522] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-22T17:39:01.540761] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:01.597069] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T17:39:01.717724] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-22T17:39:02.356131] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T17:39:02.517729] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-22T17:39:02.989414] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-22T17:39:03.317692] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-22T17:39:03.440539] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T17:39:04.117729] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-22T17:39:04.359277] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T17:39:04.363722] [INFO ] [REMOTE ] BNED: Full fetch complete (41971 records). [2025-10-22T17:39:04.363867] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-22T17:39:04.748944] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-22T17:39:04.749035] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-22T17:39:04.749566] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-22T17:39:04.749609] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-22T17:39:04.750611] [DEBUG] [LOCAL ] BNED: Trimmed 41971 records to 28217 (keeping 200 days of data) [2025-10-22T17:39:04.909042] [DEBUG] [LOCAL ] BNED: Primary data saved (28217 records). [2025-10-22T17:39:04.909182] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-22T17:39:04.909263] [INFO ] [MAIN ] Update Progress: 313/2367 symbols completed. BNED took 31.7s. Estimated remaining: 4h 15m 58s. Rate: 8.0 symbols/min [2025-10-22T17:39:04.922827] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-22T17:39:05.080829] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:05.128668] [DEBUG] [LOCAL ] BNS: Loaded 51426 existing records from primary storage. [2025-10-22T17:39:05.128987] [INFO ] [MAIN ] BNS: Loaded 51426 existing records. [2025-10-22T17:39:05.305130] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:05.305419] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-22T17:39:05.305557] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-22T17:39:05.305843] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-22T17:39:05.305904] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-22T17:39:05.663037] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:05.687077] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:39:05.717678] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-22T17:39:06.517738] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-22T17:39:06.991763] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T17:39:07.105531] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-22T17:39:07.114901] [INFO ] [REMOTE ] BN: Full fetch complete (76957 records). [2025-10-22T17:39:07.115028] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-22T17:39:07.336974] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-22T17:39:07.511019] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-22T17:39:07.511147] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-22T17:39:07.512008] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-22T17:39:07.512087] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-22T17:39:07.539913] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:39:07.538676] [DEBUG] [LOCAL ] BN: Trimmed 76957 records to 52983 (keeping 200 days of data) [2025-10-22T17:39:07.864438] [DEBUG] [LOCAL ] BN: Primary data saved (52983 records). [2025-10-22T17:39:07.864565] [INFO ] [MAIN ] BN: Full history saved. [2025-10-22T17:39:07.865480] [INFO ] [MAIN ] Update Progress: 314/2367 symbols completed. BN took 37.8s. Estimated remaining: 4h 15m 21s. Rate: 8.0 symbols/min [2025-10-22T17:39:08.030732] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:08.037936] [DEBUG] [LOCAL ] BNT: Loaded 3550 existing records from primary storage. [2025-10-22T17:39:08.038153] [INFO ] [MAIN ] BNT: Loaded 3550 existing records. [2025-10-22T17:39:08.126170] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-22T17:39:08.214131] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:08.214373] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-22T17:39:08.214431] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-22T17:39:08.214556] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-22T17:39:08.214595] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-22T17:39:08.566932] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:08.578769] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T17:39:08.917721] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-22T17:39:09.166624] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T17:39:09.393577] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-22T17:39:09.717749] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-22T17:39:10.103190] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-22T17:39:10.517730] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-22T17:39:10.937821] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-22T17:39:11.317698] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-22T17:39:11.831286] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T17:39:12.117709] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-22T17:39:12.477893] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-22T17:39:12.917715] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-22T17:39:13.518339] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T17:39:13.717720] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-22T17:39:14.371283] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-22T17:39:14.517701] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-22T17:39:15.075726] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T17:39:15.317695] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-22T17:39:16.117673] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-22T17:39:16.745583] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T17:39:16.885128] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T17:39:16.917618] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-22T17:39:17.717722] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-22T17:39:18.265047] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T17:39:18.517719] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-22T17:39:18.588014] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:39:18.886330] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T17:39:19.317755] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-22T17:39:20.117777] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-22T17:39:20.671181] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T17:39:20.672177] [INFO ] [REMOTE ] BNJ: Full fetch complete (3879 records). [2025-10-22T17:39:20.672245] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-22T17:39:20.923116] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-22T17:39:21.044427] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-22T17:39:21.044619] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-22T17:39:21.044848] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-22T17:39:21.044960] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-22T17:39:21.045397] [DEBUG] [LOCAL ] BNJ: Trimmed 3879 records to 2500 (keeping 200 days of data) [2025-10-22T17:39:21.061219] [DEBUG] [LOCAL ] BNJ: Primary data saved (2500 records). [2025-10-22T17:39:21.061295] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-22T17:39:21.061379] [INFO ] [MAIN ] Update Progress: 315/2367 symbols completed. BNJ took 21.7s. Estimated remaining: 4h 15m 50s. Rate: 8.0 symbols/min [2025-10-22T17:39:21.231410] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:21.265701] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T17:39:21.280614] [DEBUG] [LOCAL ] BNY: Loaded 7268 existing records from primary storage. [2025-10-22T17:39:21.280869] [INFO ] [MAIN ] BNY: Loaded 7268 existing records. [2025-10-22T17:39:21.452415] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:21.452675] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-22T17:39:21.452735] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-22T17:39:21.452899] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-22T17:39:21.452937] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-22T17:39:21.722850] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-22T17:39:21.853836] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:22.321380] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T17:39:22.517696] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-22T17:39:23.209718] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-22T17:39:23.317721] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-22T17:39:23.753755] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T17:39:24.034583] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-22T17:39:24.117698] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-22T17:39:24.917737] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-22T17:39:25.613601] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:39:25.717703] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-22T17:39:26.199543] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T17:39:26.517669] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-22T17:39:27.317745] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-22T17:39:27.381410] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T17:39:27.809623] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T17:39:27.840228] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T17:39:28.117723] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-22T17:39:28.861157] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T17:39:28.917611] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-22T17:39:29.717700] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-22T17:39:30.403361] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T17:39:30.487422] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T17:39:30.517670] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-22T17:39:31.218369] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T17:39:31.317720] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-22T17:39:32.117715] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-22T17:39:32.753405] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T17:39:32.926534] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-22T17:39:32.946873] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:39:33.717739] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-22T17:39:33.795328] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:39:34.243074] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-22T17:39:34.517738] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-22T17:39:35.317757] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-22T17:39:35.907264] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T17:39:36.117727] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-22T17:39:36.431688] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T17:39:36.728229] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-22T17:39:36.729723] [INFO ] [REMOTE ] BNT: Full fetch complete (4857 records). [2025-10-22T17:39:36.729795] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-22T17:39:36.922920] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-22T17:39:37.103218] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-22T17:39:37.103296] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-22T17:39:37.103449] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-22T17:39:37.103539] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-22T17:39:37.103940] [DEBUG] [LOCAL ] BNT: Trimmed 4857 records to 3527 (keeping 200 days of data) [2025-10-22T17:39:37.125029] [DEBUG] [LOCAL ] BNT: Primary data saved (3527 records). [2025-10-22T17:39:37.125105] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-22T17:39:37.125176] [INFO ] [MAIN ] Update Progress: 316/2367 symbols completed. BNT took 29.3s. Estimated remaining: 4h 16m 39s. Rate: 8.0 symbols/min [2025-10-22T17:39:37.297997] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:37.318331] [DEBUG] [LOCAL ] BOC: Loaded 18280 existing records from primary storage. [2025-10-22T17:39:37.318589] [INFO ] [MAIN ] BOC: Loaded 18280 existing records. [2025-10-22T17:39:37.493497] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:37.493735] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-22T17:39:37.493796] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-22T17:39:37.493956] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-22T17:39:37.493993] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-22T17:39:37.723920] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-22T17:39:37.784684] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T17:39:37.890102] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:38.517717] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-22T17:39:38.957321] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T17:39:39.317736] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-22T17:39:39.571837] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T17:39:39.944340] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T17:39:39.946456] [INFO ] [REMOTE ] BNY: Full fetch complete (10392 records). [2025-10-22T17:39:39.946527] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-22T17:39:40.124210] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-22T17:39:40.308603] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-22T17:39:40.308709] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-22T17:39:40.308983] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-22T17:39:40.309024] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-22T17:39:40.309441] [DEBUG] [LOCAL ] BNY: Trimmed 10392 records to 7253 (keeping 200 days of data) [2025-10-22T17:39:40.352019] [DEBUG] [LOCAL ] BNY: Primary data saved (7253 records). [2025-10-22T17:39:40.352135] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-22T17:39:40.352211] [INFO ] [MAIN ] Update Progress: 317/2367 symbols completed. BNY took 19.3s. Estimated remaining: 4h 16m 4s. Rate: 8.0 symbols/min [2025-10-22T17:39:40.917721] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-22T17:39:41.356767] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T17:39:41.717715] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-22T17:39:42.517709] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-22T17:39:42.551220] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:39:43.143744] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T17:39:43.317669] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-22T17:39:43.531295] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:39:43.540018] [INFO ] [REMOTE ] BNL: Full fetch complete (67287 records). [2025-10-22T17:39:43.540175] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-22T17:39:43.927185] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-22T17:39:43.927269] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-22T17:39:43.928242] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-22T17:39:43.928305] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-22T17:39:43.929614] [DEBUG] [LOCAL ] BNL: Trimmed 67287 records to 47073 (keeping 200 days of data) [2025-10-22T17:39:44.144935] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-22T17:39:44.236512] [DEBUG] [LOCAL ] BNL: Primary data saved (47073 records). [2025-10-22T17:39:44.236675] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-22T17:39:44.237489] [INFO ] [MAIN ] Update Progress: 318/2367 symbols completed. BNL took 43.5s. Estimated remaining: 4h 15m 33s. Rate: 8.0 symbols/min [2025-10-22T17:39:44.457261] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T17:39:44.917763] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-22T17:39:45.991557] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T17:39:46.000233] [INFO ] [REMOTE ] BNS: Full fetch complete (74644 records). [2025-10-22T17:39:46.000362] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-22T17:39:46.158536] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T17:39:46.193618] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-22T17:39:46.435291] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-22T17:39:46.435421] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-22T17:39:46.436270] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-22T17:39:46.436333] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-22T17:39:46.437727] [DEBUG] [LOCAL ] BNS: Trimmed 74644 records to 51416 (keeping 200 days of data) [2025-10-22T17:39:46.742003] [DEBUG] [LOCAL ] BNS: Primary data saved (51416 records). [2025-10-22T17:39:46.742116] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-22T17:39:46.742193] [INFO ] [MAIN ] Update Progress: 319/2367 symbols completed. BNS took 41.8s. Estimated remaining: 4h 14m 53s. Rate: 8.0 symbols/min [2025-10-22T17:39:47.167007] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T17:39:47.170981] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-22T17:39:48.061119] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:39:48.065159] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-22T17:39:49.056784] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T17:39:49.061584] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-22T17:39:50.046474] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T17:39:50.051971] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-22T17:39:50.997389] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T17:39:51.001734] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-22T17:39:52.228759] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T17:39:52.232180] [INFO ] [REMOTE ] BOC: Full fetch complete (25831 records). [2025-10-22T17:39:52.232259] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-22T17:39:52.591840] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-22T17:39:52.591916] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-22T17:39:52.592343] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-22T17:39:52.592382] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-22T17:39:52.593020] [DEBUG] [LOCAL ] BOC: Trimmed 25831 records to 18186 (keeping 200 days of data) [2025-10-22T17:39:52.693927] [DEBUG] [LOCAL ] BOC: Primary data saved (18186 records). [2025-10-22T17:39:52.694063] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-22T17:39:52.694137] [INFO ] [MAIN ] Update Progress: 320/2367 symbols completed. BOC took 15.6s. Estimated remaining: 4h 14m 36s. Rate: 8.0 symbols/min [2025-10-22T17:39:53.268788] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:53.369175] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:53.399332] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:53.399627] [DEBUG] [LOCAL ] BOE: No existing data file found in primary storage. [2025-10-22T17:39:53.354587] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:53.400267] [WARN ] [MAIN ] BOE: No existing data found, performing full refresh instead. [2025-10-22T17:39:53.400376] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-22T17:39:53.400420] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-22T17:39:53.400569] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-22T17:39:53.400619] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-22T17:39:53.635466] [DEBUG] [LOCAL ] BOND: Loaded 32458 existing records from primary storage. [2025-10-22T17:39:53.649788] [DEBUG] [LOCAL ] BOH: Loaded 30727 existing records from primary storage. [2025-10-22T17:39:53.660077] [INFO ] [MAIN ] BOH: Loaded 30727 existing records. [2025-10-22T17:39:53.689547] [INFO ] [MAIN ] BOND: Loaded 32458 existing records. [2025-10-22T17:39:53.708737] [DEBUG] [LOCAL ] BOOT: Loaded 39541 existing records from primary storage. [2025-10-22T17:39:53.789239] [INFO ] [MAIN ] BOOT: Loaded 39541 existing records. [2025-10-22T17:39:54.154418] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:54.192457] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-22T17:39:54.265217] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:54.269277] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-22T17:39:54.277461] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-22T17:39:54.300211] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-22T17:39:54.317108] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-22T17:39:54.316986] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:54.377047] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-22T17:39:54.459507] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-22T17:39:54.465755] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-22T17:39:54.454312] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:54.473196] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-22T17:39:54.476450] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-22T17:39:54.506359] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-22T17:39:54.570566] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-22T17:39:54.598474] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-22T17:39:55.217754] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:55.238954] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-22T17:39:55.370693] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:55.386734] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-22T17:39:55.451966] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:55.452405] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-22T17:39:55.470081] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T17:39:55.475588] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-22T17:39:56.457509] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T17:39:56.462603] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-22T17:39:56.561091] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:39:56.568135] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-22T17:39:56.637046] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T17:39:56.644492] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-22T17:39:56.715907] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:39:56.917750] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-22T17:39:57.283110] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T17:39:57.717678] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-22T17:39:57.808822] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T17:39:57.845269] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T17:39:58.433403] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T17:39:58.473691] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T17:39:58.517694] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-22T17:39:59.317722] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-22T17:39:59.726237] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T17:40:00.117709] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-22T17:40:00.785908] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T17:40:00.917716] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-22T17:40:01.442491] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T17:40:01.717735] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-22T17:40:02.517750] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-22T17:40:03.069096] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T17:40:03.249799] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T17:40:03.317715] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-22T17:40:04.019495] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T17:40:04.117619] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-22T17:40:04.734817] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:40:04.917735] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-22T17:40:05.532756] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:40:05.717663] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-22T17:40:05.897153] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T17:40:06.517821] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-22T17:40:07.317687] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-22T17:40:07.457308] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:40:07.536704] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T17:40:08.117719] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-22T17:40:08.775573] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T17:40:08.917682] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-22T17:40:09.108525] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T17:40:09.112812] [INFO ] [REMOTE ] BOE: Full fetch complete (26969 records). [2025-10-22T17:40:09.112903] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-22T17:40:09.475085] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-22T17:40:09.475193] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-22T17:40:09.475582] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-22T17:40:09.475622] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-22T17:40:09.476433] [DEBUG] [LOCAL ] BOE: Trimmed 26969 records to 18068 (keeping 200 days of data) [2025-10-22T17:40:09.581283] [DEBUG] [LOCAL ] BOE: Primary data saved (18068 records). [2025-10-22T17:40:09.581416] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-22T17:40:09.581483] [INFO ] [MAIN ] Update Progress: 321/2367 symbols completed. BOE took 16.9s. Estimated remaining: 4h 15m 29s. Rate: 8.0 symbols/min [2025-10-22T17:40:09.723171] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-22T17:40:09.749128] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:09.797063] [DEBUG] [LOCAL ] BORR: Loaded 51097 existing records from primary storage. [2025-10-22T17:40:09.797397] [INFO ] [MAIN ] BORR: Loaded 51097 existing records. [2025-10-22T17:40:09.992736] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:09.993014] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-22T17:40:09.993066] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-22T17:40:09.993373] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-22T17:40:09.993432] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-22T17:40:10.346010] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:10.517736] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-22T17:40:11.002677] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-22T17:40:11.165350] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T17:40:11.317682] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-22T17:40:12.122901] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-22T17:40:12.148305] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T17:40:12.528507] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T17:40:12.917690] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-22T17:40:13.558069] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T17:40:13.717710] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-22T17:40:14.231691] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:40:14.517739] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-22T17:40:15.105498] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T17:40:15.317707] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-22T17:40:16.117694] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-22T17:40:16.468992] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T17:40:16.519475] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T17:40:16.917684] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-22T17:40:17.245536] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T17:40:17.717748] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-22T17:40:18.408867] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T17:40:18.517707] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-22T17:40:19.317770] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-22T17:40:19.624002] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T17:40:19.862673] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T17:40:20.117759] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-22T17:40:20.770165] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T17:40:20.917681] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-22T17:40:21.449922] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T17:40:21.717729] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-22T17:40:22.456210] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T17:40:22.517714] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-22T17:40:23.317679] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-22T17:40:23.510258] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T17:40:24.053410] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:40:24.059056] [INFO ] [REMOTE ] BOH: Full fetch complete (45456 records). [2025-10-22T17:40:24.059146] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-22T17:40:24.122764] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-22T17:40:24.440539] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-22T17:40:24.440756] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-22T17:40:24.441401] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-22T17:40:24.441450] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-22T17:40:24.442534] [DEBUG] [LOCAL ] BOH: Trimmed 45456 records to 30638 (keeping 200 days of data) [2025-10-22T17:40:24.624847] [DEBUG] [LOCAL ] BOH: Primary data saved (30638 records). [2025-10-22T17:40:24.625024] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-22T17:40:24.625118] [INFO ] [MAIN ] Update Progress: 322/2367 symbols completed. BOH took 31.9s. Estimated remaining: 4h 16m 9s. Rate: 8.0 symbols/min [2025-10-22T17:40:24.797925] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:24.819441] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T17:40:24.844172] [DEBUG] [LOCAL ] BOW: Loaded 22908 existing records from primary storage. [2025-10-22T17:40:24.844419] [INFO ] [MAIN ] BOW: Loaded 22908 existing records. [2025-10-22T17:40:24.922782] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-22T17:40:25.027758] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:25.027967] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-22T17:40:25.028015] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-22T17:40:25.028270] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-22T17:40:25.028310] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-22T17:40:25.389216] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:25.643663] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T17:40:25.717617] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-22T17:40:26.517713] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-22T17:40:26.929018] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-22T17:40:26.934961] [INFO ] [REMOTE ] BOOT: Full fetch complete (59938 records). [2025-10-22T17:40:26.935068] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-22T17:40:27.321904] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-22T17:40:27.321622] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-22T17:40:27.322035] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-22T17:40:27.324329] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-22T17:40:27.324485] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-22T17:40:27.325720] [DEBUG] [LOCAL ] BOOT: Trimmed 59938 records to 39419 (keeping 200 days of data) [2025-10-22T17:40:27.475024] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T17:40:27.599342] [DEBUG] [LOCAL ] BOOT: Primary data saved (39419 records). [2025-10-22T17:40:27.599484] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-22T17:40:27.599563] [INFO ] [MAIN ] Update Progress: 323/2367 symbols completed. BOOT took 34.9s. Estimated remaining: 4h 15m 33s. Rate: 8.0 symbols/min [2025-10-22T17:40:27.777095] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:27.817768] [DEBUG] [LOCAL ] BOX: Loaded 50139 existing records from primary storage. [2025-10-22T17:40:27.818063] [INFO ] [MAIN ] BOX: Loaded 50139 existing records. [2025-10-22T17:40:28.005137] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:28.005434] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-22T17:40:28.005542] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-22T17:40:28.011457] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-22T17:40:28.020331] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-22T17:40:28.088617] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T17:40:28.122619] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-22T17:40:28.152307] [INFO ] [REMOTE ] BOND: Full fetch complete (46645 records). [2025-10-22T17:40:28.203966] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-22T17:40:28.490397] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:40:28.599093] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:28.824619] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-22T17:40:28.824759] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-22T17:40:28.825567] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-22T17:40:28.825672] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-22T17:40:28.827104] [DEBUG] [LOCAL ] BOND: Trimmed 46645 records to 32409 (keeping 200 days of data) [2025-10-22T17:40:28.931082] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-22T17:40:29.032163] [DEBUG] [LOCAL ] BOND: Primary data saved (32409 records). [2025-10-22T17:40:29.032347] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-22T17:40:29.032459] [INFO ] [MAIN ] Update Progress: 324/2367 symbols completed. BOND took 36.3s. Estimated remaining: 4h 14m 47s. Rate: 8.0 symbols/min [2025-10-22T17:40:29.201575] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:29.248732] [DEBUG] [LOCAL ] BP: Loaded 53706 existing records from primary storage. [2025-10-22T17:40:29.249080] [INFO ] [MAIN ] BP: Loaded 53706 existing records. [2025-10-22T17:40:29.447296] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:29.447525] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-22T17:40:29.447581] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-22T17:40:29.447847] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-22T17:40:29.447903] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-22T17:40:29.721399] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-22T17:40:29.816014] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:29.826185] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:40:29.971874] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T17:40:30.517710] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-22T17:40:31.317679] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-22T17:40:31.586630] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T17:40:32.117712] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-22T17:40:32.188562] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T17:40:32.218971] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T17:40:32.917681] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-22T17:40:33.627829] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T17:40:33.717606] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-22T17:40:34.517715] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-22T17:40:34.956478] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:40:35.317751] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-22T17:40:35.442625] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T17:40:35.664091] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T17:40:36.117699] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-22T17:40:36.917782] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-22T17:40:37.724238] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-22T17:40:37.736291] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-22T17:40:37.867072] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T17:40:37.875026] [INFO ] [REMOTE ] BORR: Full fetch complete (74161 records). [2025-10-22T17:40:37.875181] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-22T17:40:37.876044] [FATAL] [VALIDATOR ] BORR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:40:37.876138] [FATAL] [MAIN ] BORR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:40:37.876181] [WARN ] [MAIN ] BORR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:40:37.876244] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-22T17:40:37.876329] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-10-22T17:40:37.876384] [INFO ] [LOCAL ] BORR: Starting deletion of derivative data. [2025-10-22T17:40:37.876549] [DEBUG] [LOCAL ] BORR: Deleted derivative data file. [2025-10-22T17:40:37.877286] [INFO ] [MAIN ] Update Progress: 325/2367 symbols completed. BORR took 28.3s. Estimated remaining: 4h 14m 48s. Rate: 8.0 symbols/min [2025-10-22T17:40:38.042512] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:38.075761] [DEBUG] [LOCAL ] BR: Loaded 34606 existing records from primary storage. [2025-10-22T17:40:38.076045] [INFO ] [MAIN ] BR: Loaded 34606 existing records. [2025-10-22T17:40:38.256848] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:38.257212] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-22T17:40:38.257314] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-22T17:40:38.257904] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-22T17:40:38.258067] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-22T17:40:38.523464] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-22T17:40:38.575622] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T17:40:38.670154] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:39.049214] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T17:40:39.317716] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-22T17:40:40.117735] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-22T17:40:40.462322] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T17:40:40.642006] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T17:40:40.819052] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T17:40:40.917675] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-22T17:40:41.717721] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-22T17:40:41.898440] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T17:40:42.517771] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-22T17:40:43.170226] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T17:40:43.274962] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T17:40:43.317701] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-22T17:40:44.117732] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-22T17:40:44.628607] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:40:44.917709] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-22T17:40:45.717762] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-22T17:40:46.170802] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T17:40:46.227614] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T17:40:46.517729] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-22T17:40:46.649016] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T17:40:47.317728] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-22T17:40:48.037316] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:40:48.117711] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-22T17:40:48.603347] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T17:40:48.608314] [INFO ] [REMOTE ] BOW: Full fetch complete (32111 records). [2025-10-22T17:40:48.608447] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-22T17:40:48.932207] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-22T17:40:48.980870] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-22T17:40:48.981101] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-22T17:40:48.981577] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-22T17:40:48.981621] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-22T17:40:48.982457] [DEBUG] [LOCAL ] BOW: Trimmed 32111 records to 22829 (keeping 200 days of data) [2025-10-22T17:40:49.115523] [DEBUG] [LOCAL ] BOW: Primary data saved (22829 records). [2025-10-22T17:40:49.115688] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-22T17:40:49.115788] [INFO ] [MAIN ] Update Progress: 326/2367 symbols completed. BOW took 24.5s. Estimated remaining: 4h 15m 4s. Rate: 8.0 symbols/min [2025-10-22T17:40:49.287713] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:49.337504] [DEBUG] [LOCAL ] BRBR: Loaded 51828 existing records from primary storage. [2025-10-22T17:40:49.337870] [INFO ] [MAIN ] BRBR: Loaded 51828 existing records. [2025-10-22T17:40:49.516090] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:49.516330] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-22T17:40:49.516495] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-22T17:40:49.516836] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-22T17:40:49.516916] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-22T17:40:49.712374] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:40:49.720562] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-22T17:40:49.900066] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:50.517692] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-22T17:40:50.829022] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T17:40:51.317676] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-22T17:40:51.779340] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T17:40:51.895181] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-22T17:40:52.117735] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-22T17:40:52.816702] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T17:40:52.917694] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-22T17:40:53.719353] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-22T17:40:53.723512] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T17:40:54.522562] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-22T17:40:54.529004] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T17:40:55.325099] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-22T17:40:55.341672] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:40:56.117741] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-22T17:40:56.704467] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-22T17:40:56.917676] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-22T17:40:57.054598] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:40:57.236478] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T17:40:57.717743] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-22T17:40:58.473583] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T17:40:58.517612] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-22T17:40:59.317700] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-22T17:40:59.672142] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T17:40:59.680602] [INFO ] [REMOTE ] BOX: Full fetch complete (72350 records). [2025-10-22T17:40:59.680793] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-22T17:41:00.084988] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-22T17:41:00.085214] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-22T17:41:00.086030] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-22T17:41:00.086110] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-22T17:41:00.087809] [DEBUG] [LOCAL ] BOX: Trimmed 72350 records to 50125 (keeping 200 days of data) [2025-10-22T17:41:00.135574] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-22T17:41:00.213003] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T17:41:00.422881] [DEBUG] [LOCAL ] BOX: Primary data saved (50125 records). [2025-10-22T17:41:00.423026] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-22T17:41:00.423799] [INFO ] [MAIN ] Update Progress: 327/2367 symbols completed. BOX took 32.8s. Estimated remaining: 4h 15m 21s. Rate: 8.0 symbols/min [2025-10-22T17:41:00.597538] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:00.617130] [DEBUG] [LOCAL ] BRC: Loaded 18420 existing records from primary storage. [2025-10-22T17:41:00.617355] [INFO ] [MAIN ] BRC: Loaded 18420 existing records. [2025-10-22T17:41:00.793450] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:00.793693] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-22T17:41:00.793752] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-22T17:41:00.793990] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-22T17:41:00.794046] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-22T17:41:00.932074] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-22T17:41:01.145273] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:01.717718] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-22T17:41:02.039597] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-22T17:41:02.078955] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T17:41:02.517726] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-22T17:41:02.670371] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:41:03.196594] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T17:41:03.317733] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-22T17:41:04.117741] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-22T17:41:04.786497] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-22T17:41:04.875258] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T17:41:04.883255] [INFO ] [REMOTE ] BR: Full fetch complete (50030 records). [2025-10-22T17:41:04.883567] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-22T17:41:04.927800] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-22T17:41:05.305050] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-22T17:41:05.305166] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-22T17:41:05.305876] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-22T17:41:05.305941] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-22T17:41:05.307162] [DEBUG] [LOCAL ] BR: Trimmed 50030 records to 34554 (keeping 200 days of data) [2025-10-22T17:41:05.535867] [DEBUG] [LOCAL ] BR: Primary data saved (34554 records). [2025-10-22T17:41:05.536007] [INFO ] [MAIN ] BR: Full history saved. [2025-10-22T17:41:05.536816] [INFO ] [MAIN ] Update Progress: 328/2367 symbols completed. BR took 27.7s. Estimated remaining: 4h 14m 58s. Rate: 8.0 symbols/min [2025-10-22T17:41:05.729323] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-22T17:41:05.733290] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:05.794552] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T17:41:05.822172] [DEBUG] [LOCAL ] BRCC: Loaded 40061 existing records from primary storage. [2025-10-22T17:41:05.822491] [INFO ] [MAIN ] BRCC: Loaded 40061 existing records. [2025-10-22T17:41:05.998098] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:05.998305] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-22T17:41:05.998351] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-22T17:41:05.998708] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-22T17:41:05.998767] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-22T17:41:06.344074] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:06.460815] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:41:06.517614] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-22T17:41:07.317720] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-22T17:41:08.005555] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T17:41:08.117697] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-22T17:41:08.353923] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-22T17:41:08.917706] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-22T17:41:09.214012] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T17:41:09.520682] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-22T17:41:09.717757] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-22T17:41:10.517704] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-22T17:41:11.032233] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T17:41:11.279376] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:41:11.317638] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-22T17:41:11.624157] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T17:41:12.117683] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-22T17:41:12.733135] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:41:12.794034] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T17:41:12.917669] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-22T17:41:13.717686] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-22T17:41:13.863968] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T17:41:14.517714] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-22T17:41:15.317812] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-22T17:41:15.549556] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T17:41:15.583320] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T17:41:16.117720] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-22T17:41:16.917678] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-22T17:41:17.159465] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T17:41:17.205425] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:41:17.717725] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-22T17:41:18.517711] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-22T17:41:18.963402] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T17:41:19.068545] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T17:41:19.078632] [INFO ] [REMOTE ] BP: Full fetch complete (77881 records). [2025-10-22T17:41:19.079081] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-22T17:41:19.322932] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-22T17:41:19.523904] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-22T17:41:19.524002] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-22T17:41:19.524945] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-22T17:41:19.525015] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-22T17:41:19.534956] [DEBUG] [LOCAL ] BP: Trimmed 77881 records to 53706 (keeping 200 days of data) [2025-10-22T17:41:19.536030] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T17:41:19.540240] [INFO ] [REMOTE ] BRC: Full fetch complete (28398 records). [2025-10-22T17:41:19.540377] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-22T17:41:20.057033] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-22T17:41:20.063332] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-22T17:41:20.064017] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-22T17:41:20.064102] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-22T17:41:20.122850] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-22T17:41:20.151378] [DEBUG] [LOCAL ] BRC: Trimmed 28398 records to 18341 (keeping 200 days of data) [2025-10-22T17:41:20.361268] [DEBUG] [LOCAL ] BRC: Primary data saved (18341 records). [2025-10-22T17:41:20.372076] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-22T17:41:20.372455] [INFO ] [MAIN ] Update Progress: 329/2367 symbols completed. BRC took 19.9s. Estimated remaining: 4h 15m 36s. Rate: 8.0 symbols/min [2025-10-22T17:41:20.462788] [DEBUG] [LOCAL ] BP: Primary data saved (53706 records). [2025-10-22T17:41:20.482407] [INFO ] [MAIN ] BP: Full history saved. [2025-10-22T17:41:20.485021] [INFO ] [MAIN ] Update Progress: 330/2367 symbols completed. BP took 51.5s. Estimated remaining: 4h 14m 43s. Rate: 8.0 symbols/min [2025-10-22T17:41:20.671346] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:20.694144] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-22T17:41:20.703019] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-22T17:41:20.707502] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-22T17:41:20.729076] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-22T17:41:20.728993] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:20.729382] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-22T17:41:20.729480] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-22T17:41:20.761458] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-22T17:41:20.799679] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-22T17:41:20.824261] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-22T17:41:20.835759] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-22T17:41:20.835891] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-22T17:41:20.835940] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-22T17:41:21.431983] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:21.432527] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-22T17:41:21.515780] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:21.547919] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-22T17:41:21.677180] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:41:21.677672] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-22T17:41:21.677778] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:41:21.677831] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-22T17:41:21.677869] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:41:21.677941] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-22T17:41:21.678016] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-22T17:41:21.678056] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-22T17:41:21.678292] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-22T17:41:21.678513] [INFO ] [MAIN ] Update Progress: 331/2367 symbols completed. BRCE took 1.3s. Estimated remaining: 4h 13m 56s. Rate: 8.0 symbols/min [2025-10-22T17:41:21.722879] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-22T17:41:21.892710] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:21.921052] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T17:41:21.990944] [DEBUG] [LOCAL ] BRO: Loaded 52096 existing records from primary storage. [2025-10-22T17:41:21.991324] [INFO ] [MAIN ] BRO: Loaded 52096 existing records. [2025-10-22T17:41:22.179173] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:22.179404] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-22T17:41:22.179458] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-22T17:41:22.179698] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-22T17:41:22.179756] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-22T17:41:22.528606] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-22T17:41:22.535402] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:22.747858] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:41:22.748166] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-22T17:41:22.748255] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:41:22.748314] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-22T17:41:22.748387] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:41:22.748461] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-22T17:41:22.748527] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-22T17:41:22.748565] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-22T17:41:22.748628] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-22T17:41:22.748716] [INFO ] [MAIN ] Update Progress: 332/2367 symbols completed. BRIE took 2.3s. Estimated remaining: 4h 13m 10s. Rate: 8.0 symbols/min [2025-10-22T17:41:22.923467] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:22.972138] [DEBUG] [LOCAL ] BROS: Loaded 53301 existing records from primary storage. [2025-10-22T17:41:22.972458] [INFO ] [MAIN ] BROS: Loaded 53301 existing records. [2025-10-22T17:41:23.155409] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:23.155713] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-22T17:41:23.155789] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-22T17:41:23.156167] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-22T17:41:23.156243] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-22T17:41:23.318308] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-22T17:41:23.525359] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:23.560097] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T17:41:24.117714] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-22T17:41:24.917738] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-22T17:41:25.203079] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:41:25.717671] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-22T17:41:26.033962] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T17:41:26.042847] [INFO ] [REMOTE ] BRBR: Full fetch complete (73224 records). [2025-10-22T17:41:26.042988] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-22T17:41:26.374004] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T17:41:26.474504] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-22T17:41:26.474595] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-22T17:41:26.475434] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-22T17:41:26.475499] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-22T17:41:26.476979] [DEBUG] [LOCAL ] BRBR: Trimmed 73224 records to 51828 (keeping 200 days of data) [2025-10-22T17:41:26.524639] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-22T17:41:26.777662] [DEBUG] [LOCAL ] BRBR: Primary data saved (51828 records). [2025-10-22T17:41:26.777808] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-22T17:41:26.778394] [INFO ] [MAIN ] Update Progress: 333/2367 symbols completed. BRBR took 37.7s. Estimated remaining: 4h 12m 41s. Rate: 8.0 symbols/min [2025-10-22T17:41:26.968385] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:26.968572] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-22T17:41:26.968609] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-22T17:41:26.968740] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-22T17:41:26.968781] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-22T17:41:26.968822] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-22T17:41:26.968853] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-22T17:41:27.317250] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:27.317561] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-22T17:41:27.578386] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:41:27.578688] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-22T17:41:27.578778] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:41:27.578825] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-22T17:41:27.578885] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:41:27.578956] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-22T17:41:27.579020] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-22T17:41:27.579055] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-22T17:41:27.579097] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-22T17:41:27.579143] [INFO ] [MAIN ] Update Progress: 334/2367 symbols completed. BRSL took 0.8s. Estimated remaining: 4h 11m 53s. Rate: 8.1 symbols/min [2025-10-22T17:41:27.770301] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:27.783540] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T17:41:27.826517] [DEBUG] [LOCAL ] BRSP: Loaded 36602 existing records from primary storage. [2025-10-22T17:41:27.826852] [INFO ] [MAIN ] BRSP: Loaded 36602 existing records. [2025-10-22T17:41:28.014741] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:28.014967] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-22T17:41:28.015015] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-22T17:41:28.015195] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-22T17:41:28.015233] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-22T17:41:28.120262] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-22T17:41:28.382152] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:28.414012] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T17:41:28.917709] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-22T17:41:29.717729] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-22T17:41:29.934546] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:41:30.517772] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-22T17:41:30.914835] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T17:41:31.035556] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T17:41:31.317737] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-22T17:41:32.117712] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-22T17:41:32.300319] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T17:41:32.711556] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:41:32.917713] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-22T17:41:33.535294] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T17:41:33.717792] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-22T17:41:34.436530] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T17:41:34.517750] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-22T17:41:34.881483] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T17:41:35.317691] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-22T17:41:35.991366] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T17:41:36.117702] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-22T17:41:36.817573] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T17:41:36.917668] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-22T17:41:37.405414] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T17:41:37.717726] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-22T17:41:38.517744] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-22T17:41:39.059084] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-22T17:41:39.317669] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-22T17:41:39.560871] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T17:41:39.667587] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T17:41:39.674380] [INFO ] [REMOTE ] BRCC: Full fetch complete (57339 records). [2025-10-22T17:41:39.674528] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-22T17:41:40.117209] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-22T17:41:40.117307] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-22T17:41:40.118182] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-22T17:41:40.118292] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-22T17:41:40.119567] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-22T17:41:40.121319] [DEBUG] [LOCAL ] BRCC: Trimmed 57339 records to 40024 (keeping 200 days of data) [2025-10-22T17:41:40.358729] [DEBUG] [LOCAL ] BRCC: Primary data saved (40024 records). [2025-10-22T17:41:40.358859] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-22T17:41:40.359530] [INFO ] [MAIN ] Update Progress: 335/2367 symbols completed. BRCC took 34.8s. Estimated remaining: 4h 12m 18s. Rate: 8.1 symbols/min [2025-10-22T17:41:40.556207] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:40.566808] [DEBUG] [LOCAL ] BRT: Loaded 5264 existing records from primary storage. [2025-10-22T17:41:40.567025] [INFO ] [MAIN ] BRT: Loaded 5264 existing records. [2025-10-22T17:41:40.767850] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:40.768087] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-22T17:41:40.768134] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-22T17:41:40.768357] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-22T17:41:40.768412] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-22T17:41:40.925842] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-22T17:41:41.142005] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:41.181428] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T17:41:41.717694] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-22T17:41:41.869706] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T17:41:42.516988] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T17:41:42.524207] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-22T17:41:43.317689] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-22T17:41:43.662849] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T17:41:44.008127] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T17:41:44.117704] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-22T17:41:44.750281] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:41:44.815015] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T17:41:44.917714] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-22T17:41:45.565761] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T17:41:45.717717] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-22T17:41:46.517733] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-22T17:41:47.220553] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T17:41:47.317717] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-22T17:41:47.912891] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T17:41:48.117714] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-22T17:41:48.228526] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T17:41:48.917718] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-22T17:41:49.392518] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T17:41:49.717682] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-22T17:41:49.990948] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T17:41:50.517724] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-22T17:41:51.150012] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T17:41:51.149854] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T17:41:51.317713] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-22T17:41:52.117697] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-22T17:41:52.917681] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-22T17:41:52.999241] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:41:53.005724] [INFO ] [REMOTE ] BRSP: Full fetch complete (54058 records). [2025-10-22T17:41:53.005855] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-22T17:41:53.401990] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-22T17:41:53.402069] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-22T17:41:53.402765] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-22T17:41:53.402831] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-22T17:41:53.404175] [DEBUG] [LOCAL ] BRSP: Trimmed 54058 records to 36477 (keeping 200 days of data) [2025-10-22T17:41:53.615984] [DEBUG] [LOCAL ] BRSP: Primary data saved (36477 records). [2025-10-22T17:41:53.616129] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-22T17:41:53.616674] [INFO ] [MAIN ] Update Progress: 336/2367 symbols completed. BRSP took 26.0s. Estimated remaining: 4h 12m 46s. Rate: 8.0 symbols/min [2025-10-22T17:41:53.721684] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-22T17:41:53.804876] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:53.848773] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:41:53.879933] [DEBUG] [LOCAL ] BRW: Loaded 21018 existing records from primary storage. [2025-10-22T17:41:53.880254] [INFO ] [MAIN ] BRW: Loaded 21018 existing records. [2025-10-22T17:41:54.074851] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:54.075148] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-22T17:41:54.075210] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-22T17:41:54.075792] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-22T17:41:54.075852] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-22T17:41:54.422501] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T17:41:54.456049] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:54.517719] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-22T17:41:55.120575] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-22T17:41:55.212754] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-22T17:41:55.317704] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-22T17:41:56.117752] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-22T17:41:56.917670] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-22T17:41:56.956103] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T17:41:56.964511] [INFO ] [REMOTE ] BRO: Full fetch complete (75108 records). [2025-10-22T17:41:56.964621] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-22T17:41:57.359125] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-22T17:41:57.359315] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-22T17:41:57.360185] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-22T17:41:57.360274] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-22T17:41:57.361715] [DEBUG] [LOCAL ] BRO: Trimmed 75108 records to 52096 (keeping 200 days of data) [2025-10-22T17:41:57.488707] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:41:57.613774] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T17:41:57.709921] [DEBUG] [LOCAL ] BRO: Primary data saved (52096 records). [2025-10-22T17:41:57.710060] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-22T17:41:57.710806] [INFO ] [MAIN ] Update Progress: 337/2367 symbols completed. BRO took 36.0s. Estimated remaining: 4h 12m 18s. Rate: 8.0 symbols/min [2025-10-22T17:41:57.722946] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-22T17:41:57.878308] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:57.926121] [DEBUG] [LOCAL ] BRX: Loaded 51823 existing records from primary storage. [2025-10-22T17:41:57.926422] [INFO ] [MAIN ] BRX: Loaded 51823 existing records. [2025-10-22T17:41:58.097496] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:58.097740] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-22T17:41:58.097791] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-22T17:41:58.098012] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-22T17:41:58.098068] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-22T17:41:58.442136] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:58.517607] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-22T17:41:59.317637] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-22T17:41:59.899425] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T17:41:59.997766] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T17:42:00.121191] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-22T17:42:00.127217] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T17:42:00.917720] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-22T17:42:01.717734] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-22T17:42:02.517688] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-22T17:42:02.705288] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-22T17:42:02.806884] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T17:42:03.317723] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-22T17:42:04.117722] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-22T17:42:04.200898] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:42:04.202635] [INFO ] [REMOTE ] BRT: Full fetch complete (7151 records). [2025-10-22T17:42:04.202742] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-22T17:42:04.574925] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-22T17:42:04.575032] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-22T17:42:04.575394] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-22T17:42:04.575580] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-22T17:42:04.576164] [DEBUG] [LOCAL ] BRT: Trimmed 7151 records to 5261 (keeping 200 days of data) [2025-10-22T17:42:04.607939] [DEBUG] [LOCAL ] BRT: Primary data saved (5261 records). [2025-10-22T17:42:04.608009] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-22T17:42:04.608081] [INFO ] [MAIN ] Update Progress: 338/2367 symbols completed. BRT took 24.2s. Estimated remaining: 4h 12m 7s. Rate: 8.0 symbols/min [2025-10-22T17:42:04.780031] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:04.807163] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (3.09 seconds). [2025-10-22T17:42:04.842904] [DEBUG] [LOCAL ] BSAC: Loaded 32912 existing records from primary storage. [2025-10-22T17:42:04.843392] [INFO ] [MAIN ] BSAC: Loaded 32912 existing records. [2025-10-22T17:42:04.922763] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-22T17:42:05.024281] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:05.024584] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-22T17:42:05.024699] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-22T17:42:05.024949] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-22T17:42:05.025020] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-22T17:42:05.129502] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T17:42:05.395488] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:05.717734] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-22T17:42:06.248353] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.93 seconds). [2025-10-22T17:42:06.257416] [INFO ] [REMOTE ] BROS: Full fetch complete (77271 records). [2025-10-22T17:42:06.257798] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-22T17:42:06.522849] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-22T17:42:06.657524] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-22T17:42:06.660735] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-22T17:42:06.661808] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-22T17:42:06.661874] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-22T17:42:06.663341] [DEBUG] [LOCAL ] BROS: Trimmed 77271 records to 53301 (keeping 200 days of data) [2025-10-22T17:42:06.887136] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T17:42:06.988229] [DEBUG] [LOCAL ] BROS: Primary data saved (53301 records). [2025-10-22T17:42:06.988366] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-22T17:42:06.988444] [INFO ] [MAIN ] Update Progress: 339/2367 symbols completed. BROS took 44.2s. Estimated remaining: 4h 11m 30s. Rate: 8.1 symbols/min [2025-10-22T17:42:07.150808] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:07.181153] [DEBUG] [LOCAL ] BSBR: Loaded 35863 existing records from primary storage. [2025-10-22T17:42:07.181422] [INFO ] [MAIN ] BSBR: Loaded 35863 existing records. [2025-10-22T17:42:07.326738] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-22T17:42:07.356602] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:07.356880] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-22T17:42:07.356934] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-22T17:42:07.357136] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-22T17:42:07.357193] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-22T17:42:07.720178] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:07.731538] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T17:42:07.788049] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-10-22T17:42:08.117722] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-22T17:42:08.390020] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T17:42:08.917777] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-22T17:42:09.705816] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T17:42:09.717608] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-22T17:42:09.891399] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T17:42:10.517701] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-22T17:42:10.748338] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T17:42:11.317692] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-22T17:42:11.674773] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T17:42:12.117719] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-22T17:42:12.917687] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-22T17:42:13.174330] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T17:42:13.465242] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T17:42:13.717679] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-22T17:42:13.772340] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:42:14.517698] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-22T17:42:15.317717] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-22T17:42:15.396096] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:42:15.874767] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T17:42:16.117699] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-22T17:42:16.830183] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T17:42:16.917740] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-22T17:42:17.157199] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:42:17.717735] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-22T17:42:18.475713] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:42:18.517717] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-22T17:42:18.694434] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T17:42:19.317730] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-22T17:42:20.117743] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-22T17:42:20.322315] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T17:42:20.639155] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T17:42:20.917835] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-22T17:42:21.494740] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T17:42:21.717883] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-22T17:42:22.280600] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T17:42:22.517698] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-22T17:42:23.322819] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-22T17:42:23.343156] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T17:42:23.580159] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T17:42:24.117686] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-22T17:42:24.491879] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T17:42:24.496634] [INFO ] [REMOTE ] BRW: Full fetch complete (30010 records). [2025-10-22T17:42:24.496796] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-22T17:42:24.497477] [FATAL] [VALIDATOR ] BRW: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:42:24.497566] [FATAL] [MAIN ] BRW: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:42:24.497612] [WARN ] [MAIN ] BRW: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:42:24.497755] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-22T17:42:24.497829] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-22T17:42:24.497867] [INFO ] [LOCAL ] BRW: Starting deletion of derivative data. [2025-10-22T17:42:24.498252] [DEBUG] [LOCAL ] BRW: Deleted derivative data file. [2025-10-22T17:42:24.498553] [INFO ] [MAIN ] Update Progress: 340/2367 symbols completed. BRW took 30.9s. Estimated remaining: 4h 12m 22s. Rate: 8.0 symbols/min [2025-10-22T17:42:24.668586] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:24.679108] [DEBUG] [LOCAL ] BSL: Loaded 8084 existing records from primary storage. [2025-10-22T17:42:24.679341] [INFO ] [MAIN ] BSL: Loaded 8084 existing records. [2025-10-22T17:42:24.862981] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:24.863205] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-22T17:42:24.863257] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-22T17:42:24.863419] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-22T17:42:24.863476] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-22T17:42:24.922867] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-22T17:42:25.238469] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:25.564330] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T17:42:25.717718] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-22T17:42:26.420859] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:42:26.517669] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-22T17:42:27.085182] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T17:42:27.317732] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-22T17:42:27.975101] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-22T17:42:27.998856] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T17:42:28.117722] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-22T17:42:28.917735] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-22T17:42:29.426141] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:42:29.717724] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-22T17:42:30.296738] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T17:42:30.446133] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T17:42:30.517779] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-22T17:42:31.302771] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T17:42:31.317602] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-22T17:42:32.117683] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-22T17:42:32.209922] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:42:32.917740] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-22T17:42:33.479425] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T17:42:33.717690] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-22T17:42:34.318509] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T17:42:34.517723] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-22T17:42:35.037784] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T17:42:35.047933] [INFO ] [REMOTE ] BRX: Full fetch complete (75150 records). [2025-10-22T17:42:35.048184] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-22T17:42:35.321493] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-22T17:42:35.310131] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T17:42:35.477094] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-22T17:42:35.477177] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-22T17:42:35.478017] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-22T17:42:35.478080] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-22T17:42:35.479444] [DEBUG] [LOCAL ] BRX: Trimmed 75150 records to 51818 (keeping 200 days of data) [2025-10-22T17:42:35.789952] [DEBUG] [LOCAL ] BRX: Primary data saved (51818 records). [2025-10-22T17:42:35.790095] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-22T17:42:35.790920] [INFO ] [MAIN ] Update Progress: 341/2367 symbols completed. BRX took 38.1s. Estimated remaining: 4h 12m 37s. Rate: 8.0 symbols/min [2025-10-22T17:42:35.961981] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:35.994788] [DEBUG] [LOCAL ] BSM: Loaded 32421 existing records from primary storage. [2025-10-22T17:42:35.995046] [INFO ] [MAIN ] BSM: Loaded 32421 existing records. [2025-10-22T17:42:36.129874] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-22T17:42:36.173418] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:36.173739] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-22T17:42:36.173790] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-22T17:42:36.173975] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-22T17:42:36.174029] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-22T17:42:36.538484] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:36.917723] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-22T17:42:37.025593] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T17:42:37.031849] [INFO ] [REMOTE ] BSBR: Full fetch complete (51142 records). [2025-10-22T17:42:37.031970] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-22T17:42:37.413443] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-22T17:42:37.413673] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-22T17:42:37.414372] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-22T17:42:37.414447] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-22T17:42:37.415624] [DEBUG] [LOCAL ] BSBR: Trimmed 51142 records to 35877 (keeping 200 days of data) [2025-10-22T17:42:37.543042] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T17:42:37.642756] [DEBUG] [LOCAL ] BSBR: Primary data saved (35877 records). [2025-10-22T17:42:37.642904] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-22T17:42:37.642991] [INFO ] [MAIN ] Update Progress: 342/2367 symbols completed. BSBR took 30.7s. Estimated remaining: 4h 11m 57s. Rate: 8.0 symbols/min [2025-10-22T17:42:37.728130] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-22T17:42:37.752074] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T17:42:37.854178] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:37.872476] [DEBUG] [LOCAL ] BST: Loaded 18592 existing records from primary storage. [2025-10-22T17:42:37.872929] [INFO ] [MAIN ] BST: Loaded 18592 existing records. [2025-10-22T17:42:38.049229] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:38.049447] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-22T17:42:38.049494] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-22T17:42:38.049694] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-22T17:42:38.049750] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-22T17:42:38.395235] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:38.517680] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-22T17:42:39.098427] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T17:42:39.104012] [INFO ] [REMOTE ] BSAC: Full fetch complete (44988 records). [2025-10-22T17:42:39.104185] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-22T17:42:39.104870] [FATAL] [VALIDATOR ] BSAC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:42:39.104961] [FATAL] [MAIN ] BSAC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:42:39.105003] [WARN ] [MAIN ] BSAC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:42:39.105043] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-22T17:42:39.105100] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-22T17:42:39.105136] [INFO ] [LOCAL ] BSAC: Starting deletion of derivative data. [2025-10-22T17:42:39.105265] [DEBUG] [LOCAL ] BSAC: Deleted derivative data file. [2025-10-22T17:42:39.105336] [INFO ] [MAIN ] Update Progress: 343/2367 symbols completed. BSAC took 34.5s. Estimated remaining: 4h 11m 14s. Rate: 8.1 symbols/min [2025-10-22T17:42:39.275258] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:39.299259] [DEBUG] [LOCAL ] BSTZ: Loaded 24579 existing records from primary storage. [2025-10-22T17:42:39.299519] [INFO ] [MAIN ] BSTZ: Loaded 24579 existing records. [2025-10-22T17:42:39.329995] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-22T17:42:39.485521] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:39.485790] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-22T17:42:39.485853] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-22T17:42:39.486076] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-22T17:42:39.486132] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-22T17:42:39.853323] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:39.872368] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T17:42:40.117706] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-22T17:42:40.508804] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T17:42:40.917788] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-22T17:42:41.364506] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T17:42:41.717759] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-22T17:42:42.321850] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T17:42:42.517690] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-22T17:42:42.893579] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T17:42:43.317752] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-22T17:42:43.813155] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T17:42:44.117680] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-22T17:42:44.263257] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T17:42:44.917734] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-22T17:42:45.519466] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:42:45.717671] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-22T17:42:46.039509] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T17:42:46.517713] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-22T17:42:46.779616] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T17:42:47.317713] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-22T17:42:47.666047] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T17:42:48.117680] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-22T17:42:48.174005] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T17:42:48.917718] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-22T17:42:49.219892] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T17:42:49.717741] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-22T17:42:50.130252] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T17:42:50.504237] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T17:42:50.517605] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-22T17:42:51.263528] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T17:42:51.317615] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-22T17:42:52.117719] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-22T17:42:52.212384] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T17:42:52.214548] [INFO ] [REMOTE ] BSL: Full fetch complete (12978 records). [2025-10-22T17:42:52.214616] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-22T17:42:52.575811] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-22T17:42:52.575897] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-22T17:42:52.576223] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-22T17:42:52.576263] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-22T17:42:52.576724] [DEBUG] [LOCAL ] BSL: Trimmed 12978 records to 7898 (keeping 200 days of data) [2025-10-22T17:42:52.623454] [DEBUG] [LOCAL ] BSL: Primary data saved (7898 records). [2025-10-22T17:42:52.623581] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-22T17:42:52.623677] [INFO ] [MAIN ] Update Progress: 344/2367 symbols completed. BSL took 28.1s. Estimated remaining: 4h 11m 42s. Rate: 8.0 symbols/min [2025-10-22T17:42:52.789696] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:52.841307] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-22T17:42:52.841614] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-22T17:42:52.922750] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-22T17:42:53.028339] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:53.028545] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-22T17:42:53.028601] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-22T17:42:53.028813] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-22T17:42:53.028868] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-22T17:42:53.397573] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:53.408766] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T17:42:53.717678] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-22T17:42:54.455195] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T17:42:54.517684] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-22T17:42:54.926838] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T17:42:55.157530] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T17:42:55.317705] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-22T17:42:56.117722] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-22T17:42:56.917773] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-22T17:42:57.352270] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T17:42:57.453313] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T17:42:57.717714] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-22T17:42:58.042679] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T17:42:58.517706] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-22T17:42:58.995530] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T17:42:59.001049] [INFO ] [REMOTE ] BSM: Full fetch complete (46877 records). [2025-10-22T17:42:59.001220] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-22T17:42:59.322921] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-22T17:42:59.371384] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-22T17:42:59.371467] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-22T17:42:59.372101] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-22T17:42:59.372164] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-22T17:42:59.373112] [DEBUG] [LOCAL ] BSM: Trimmed 46877 records to 32282 (keeping 200 days of data) [2025-10-22T17:42:59.564077] [DEBUG] [LOCAL ] BSM: Primary data saved (32282 records). [2025-10-22T17:42:59.564206] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-22T17:42:59.564282] [INFO ] [MAIN ] Update Progress: 345/2367 symbols completed. BSM took 23.8s. Estimated remaining: 4h 11m 31s. Rate: 8.0 symbols/min [2025-10-22T17:42:59.733714] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:59.741446] [DEBUG] [LOCAL ] BTA: Loaded 5770 existing records from primary storage. [2025-10-22T17:42:59.741627] [INFO ] [MAIN ] BTA: Loaded 5770 existing records. [2025-10-22T17:42:59.916857] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:59.917183] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-22T17:42:59.917350] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-22T17:42:59.917544] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-22T17:42:59.917730] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-22T17:43:00.124543] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-22T17:43:00.287214] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:00.315536] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T17:43:00.667583] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T17:43:00.917700] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-22T17:43:01.246949] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T17:43:01.717742] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-22T17:43:01.904556] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T17:43:02.517734] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-22T17:43:03.317721] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-22T17:43:03.646208] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T17:43:03.653388] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T17:43:04.117756] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-22T17:43:04.532614] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T17:43:04.917715] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-22T17:43:05.019183] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:43:05.717746] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-22T17:43:06.517692] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-22T17:43:06.758395] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T17:43:06.950059] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T17:43:07.317758] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-22T17:43:07.941804] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T17:43:07.948689] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36427 records). [2025-10-22T17:43:07.948879] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-22T17:43:08.119435] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-22T17:43:08.350026] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-22T17:43:08.350199] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-22T17:43:08.350865] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-22T17:43:08.350949] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-22T17:43:08.363042] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T17:43:08.367350] [DEBUG] [LOCAL ] BSTZ: Trimmed 36427 records to 24418 (keeping 200 days of data) [2025-10-22T17:43:08.514707] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24418 records). [2025-10-22T17:43:08.514845] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-22T17:43:08.514925] [INFO ] [MAIN ] Update Progress: 346/2367 symbols completed. BSTZ took 29.4s. Estimated remaining: 4h 11m 33s. Rate: 8.0 symbols/min [2025-10-22T17:43:08.685611] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:08.685813] [DEBUG] [LOCAL ] BTE: No existing data file found in primary storage. [2025-10-22T17:43:08.685858] [WARN ] [MAIN ] BTE: No existing data found, performing full refresh instead. [2025-10-22T17:43:08.685972] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-22T17:43:08.686084] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-22T17:43:08.686145] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-22T17:43:08.686181] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-22T17:43:08.869986] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T17:43:08.921338] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-22T17:43:09.087409] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:09.717720] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-22T17:43:10.109845] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T17:43:10.517774] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-22T17:43:11.317717] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-22T17:43:11.681786] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T17:43:11.685000] [INFO ] [REMOTE ] BST: Full fetch complete (28298 records). [2025-10-22T17:43:11.685079] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-22T17:43:12.025822] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-22T17:43:12.123965] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-22T17:43:12.126932] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-22T17:43:12.127012] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-22T17:43:12.127474] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-22T17:43:12.127516] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-22T17:43:12.128346] [DEBUG] [LOCAL ] BST: Trimmed 28298 records to 18388 (keeping 200 days of data) [2025-10-22T17:43:12.242697] [DEBUG] [LOCAL ] BST: Primary data saved (18388 records). [2025-10-22T17:43:12.242845] [INFO ] [MAIN ] BST: Full history saved. [2025-10-22T17:43:12.242922] [INFO ] [MAIN ] Update Progress: 347/2367 symbols completed. BST took 34.6s. Estimated remaining: 4h 11m 3s. Rate: 8.0 symbols/min [2025-10-22T17:43:12.425036] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:12.425246] [DEBUG] [LOCAL ] BTI: No existing data file found in primary storage. [2025-10-22T17:43:12.425294] [WARN ] [MAIN ] BTI: No existing data found, performing full refresh instead. [2025-10-22T17:43:12.425414] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-22T17:43:12.425457] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-22T17:43:12.425498] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-10-22T17:43:12.425530] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-22T17:43:12.859105] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:12.917703] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-22T17:43:13.101967] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T17:43:13.717681] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-22T17:43:14.063437] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T17:43:14.225873] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T17:43:14.478554] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:43:14.517612] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-22T17:43:15.317677] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-22T17:43:15.993078] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T17:43:16.117689] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-22T17:43:16.282445] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T17:43:16.693440] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T17:43:16.917685] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-22T17:43:17.717734] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-22T17:43:18.517758] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-22T17:43:18.778491] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T17:43:19.317740] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-22T17:43:19.747122] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T17:43:19.788970] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T17:43:19.929442] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T17:43:20.117749] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-22T17:43:20.917733] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-22T17:43:21.717719] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-22T17:43:22.231669] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T17:43:22.299684] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T17:43:22.373471] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T17:43:22.517735] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-22T17:43:23.317722] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-22T17:43:23.860278] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-22T17:43:24.117613] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-22T17:43:24.450345] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T17:43:24.917674] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-22T17:43:24.949053] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T17:43:24.950706] [INFO ] [REMOTE ] BTA: Full fetch complete (9297 records). [2025-10-22T17:43:24.950777] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-22T17:43:25.310143] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-22T17:43:25.310217] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-22T17:43:25.310435] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-22T17:43:25.310473] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-22T17:43:25.310887] [DEBUG] [LOCAL ] BTA: Trimmed 9297 records to 5760 (keeping 200 days of data) [2025-10-22T17:43:25.343786] [DEBUG] [LOCAL ] BTA: Primary data saved (5760 records). [2025-10-22T17:43:25.343881] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-22T17:43:25.343953] [INFO ] [MAIN ] Update Progress: 348/2367 symbols completed. BTA took 25.8s. Estimated remaining: 4h 11m 29s. Rate: 8.0 symbols/min [2025-10-22T17:43:25.507930] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:25.516587] [DEBUG] [LOCAL ] BTO: Loaded 8841 existing records from primary storage. [2025-10-22T17:43:25.516837] [INFO ] [MAIN ] BTO: Loaded 8841 existing records. [2025-10-22T17:43:25.692844] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:43:25.693079] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-22T17:43:25.693132] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-22T17:43:25.693301] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-22T17:43:25.693354] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-22T17:43:25.722987] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-22T17:43:26.039499] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:26.517674] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-22T17:43:26.872551] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T17:43:27.317709] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-22T17:43:27.805197] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-22T17:43:28.043420] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T17:43:28.117715] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-22T17:43:28.166212] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T17:43:28.917765] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-22T17:43:29.434102] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T17:43:29.717721] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-22T17:43:30.517692] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-22T17:43:30.621194] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-22T17:43:30.630599] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-22T17:43:30.630765] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-22T17:43:31.020726] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-22T17:43:31.020804] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-22T17:43:31.021723] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-22T17:43:31.021818] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-22T17:43:31.023358] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 53688 (keeping 200 days of data) [2025-10-22T17:43:31.318418] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-22T17:43:31.343097] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-22T17:43:31.343197] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-22T17:43:31.343868] [INFO ] [MAIN ] Update Progress: 349/2367 symbols completed. BSX took 38.7s. Estimated remaining: 4h 11m 13s. Rate: 8.0 symbols/min [2025-10-22T17:43:31.514445] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:31.530847] [DEBUG] [LOCAL ] BTT: Loaded 15421 existing records from primary storage. [2025-10-22T17:43:31.531077] [INFO ] [MAIN ] BTT: Loaded 15421 existing records. [2025-10-22T17:43:31.714996] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:43:31.715187] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-22T17:43:31.715301] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-22T17:43:31.715569] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-22T17:43:31.715694] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-22T17:43:31.879662] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-22T17:43:32.130954] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-22T17:43:32.136715] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:32.189030] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T17:43:32.202200] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:43:32.917721] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-22T17:43:33.717703] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-22T17:43:34.146332] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T17:43:34.403306] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T17:43:34.517730] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-22T17:43:34.596391] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:43:35.273568] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T17:43:35.317738] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-22T17:43:36.117673] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-22T17:43:36.252554] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T17:43:36.917725] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-22T17:43:37.717694] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-22T17:43:37.871446] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T17:43:37.912528] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:43:38.517721] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-22T17:43:38.655964] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T17:43:39.317754] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-22T17:43:40.089408] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T17:43:40.117699] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-22T17:43:40.186944] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T17:43:40.917748] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-22T17:43:41.057972] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T17:43:41.717790] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-22T17:43:42.320937] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T17:43:42.517729] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-22T17:43:43.125518] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T17:43:43.314107] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T17:43:43.317684] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-22T17:43:44.067136] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T17:43:44.069829] [INFO ] [REMOTE ] BTO: Full fetch complete (13258 records). [2025-10-22T17:43:44.069924] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-22T17:43:44.122971] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-22T17:43:44.471552] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-22T17:43:44.471701] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-22T17:43:44.472291] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-22T17:43:44.472355] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-22T17:43:44.473100] [DEBUG] [LOCAL ] BTO: Trimmed 13258 records to 8703 (keeping 200 days of data) [2025-10-22T17:43:44.533762] [DEBUG] [LOCAL ] BTO: Primary data saved (8703 records). [2025-10-22T17:43:44.533959] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-22T17:43:44.534082] [INFO ] [MAIN ] Update Progress: 350/2367 symbols completed. BTO took 19.2s. Estimated remaining: 4h 11m 38s. Rate: 8.0 symbols/min [2025-10-22T17:43:44.718471] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:44.777285] [DEBUG] [LOCAL ] BTU: Loaded 53337 existing records from primary storage. [2025-10-22T17:43:44.777768] [INFO ] [MAIN ] BTU: Loaded 53337 existing records. [2025-10-22T17:43:44.924143] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-22T17:43:44.969105] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:43:44.969509] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-22T17:43:44.969612] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-22T17:43:44.970150] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-22T17:43:44.970211] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-22T17:43:45.332206] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:45.717760] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-22T17:43:45.896046] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T17:43:46.065874] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T17:43:46.517745] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-22T17:43:47.317746] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-22T17:43:47.484969] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T17:43:48.111272] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T17:43:48.121893] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-22T17:43:48.923403] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-22T17:43:48.944294] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T17:43:48.954356] [INFO ] [REMOTE ] BTE: Full fetch complete (76347 records). [2025-10-22T17:43:48.954681] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-22T17:43:49.372587] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-22T17:43:49.372736] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-22T17:43:49.373950] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-22T17:43:49.374021] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-22T17:43:49.376199] [DEBUG] [LOCAL ] BTE: Trimmed 76347 records to 52696 (keeping 200 days of data) [2025-10-22T17:43:49.708193] [DEBUG] [LOCAL ] BTE: Primary data saved (52696 records). [2025-10-22T17:43:49.708414] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-22T17:43:49.708565] [INFO ] [MAIN ] Update Progress: 351/2367 symbols completed. BTE took 41.2s. Estimated remaining: 4h 11m 17s. Rate: 8.0 symbols/min [2025-10-22T17:43:49.722960] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-22T17:43:49.898266] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:49.898587] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-22T17:43:49.898637] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-22T17:43:49.898794] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-22T17:43:49.898837] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-22T17:43:49.898880] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-22T17:43:49.898913] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-22T17:43:50.268010] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:50.295550] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-22T17:43:50.305698] [INFO ] [REMOTE ] BTI: Full fetch complete (77651 records). [2025-10-22T17:43:50.305959] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-22T17:43:50.455670] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:43:50.524873] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-22T17:43:50.798803] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-22T17:43:50.799482] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-22T17:43:50.801009] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-22T17:43:50.801088] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-22T17:43:50.803219] [DEBUG] [LOCAL ] BTI: Trimmed 77651 records to 53592 (keeping 200 days of data) [2025-10-22T17:43:50.921866] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T17:43:51.200119] [DEBUG] [LOCAL ] BTI: Primary data saved (53592 records). [2025-10-22T17:43:51.200331] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-22T17:43:51.200425] [INFO ] [MAIN ] Update Progress: 352/2367 symbols completed. BTI took 39.0s. Estimated remaining: 4h 10m 36s. Rate: 8.0 symbols/min [2025-10-22T17:43:51.322830] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-22T17:43:51.374060] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:51.397173] [DEBUG] [LOCAL ] BTZ: Loaded 22540 existing records from primary storage. [2025-10-22T17:43:51.397430] [INFO ] [MAIN ] BTZ: Loaded 22540 existing records. [2025-10-22T17:43:51.574785] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:43:51.609307] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:43:51.610106] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-22T17:43:51.609864] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-22T17:43:51.610315] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-22T17:43:51.610379] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:43:51.610607] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-22T17:43:51.610764] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:43:51.610845] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-22T17:43:51.610931] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-22T17:43:51.610973] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-22T17:43:51.611014] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-22T17:43:51.611093] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-22T17:43:51.611072] [INFO ] [MAIN ] Update Progress: 353/2367 symbols completed. BTX took 1.9s. Estimated remaining: 4h 9m 48s. Rate: 8.1 symbols/min [2025-10-22T17:43:51.611262] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-22T17:43:52.006768] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:52.135805] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-22T17:43:52.159454] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:52.209087] [DEBUG] [LOCAL ] BUD: Loaded 52604 existing records from primary storage. [2025-10-22T17:43:52.209579] [INFO ] [MAIN ] BUD: Loaded 52604 existing records. [2025-10-22T17:43:52.403413] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:43:52.403860] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-22T17:43:52.403937] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-22T17:43:52.404381] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-22T17:43:52.404500] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-22T17:43:52.620977] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T17:43:52.846542] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:52.917748] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-22T17:43:53.100786] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T17:43:53.717718] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-22T17:43:54.196804] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T17:43:54.517702] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-22T17:43:55.320611] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-22T17:43:55.515046] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:43:55.567921] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T17:43:56.117697] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-22T17:43:56.917682] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-22T17:43:57.068902] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T17:43:57.300814] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T17:43:57.717714] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-22T17:43:58.517682] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-22T17:43:58.724628] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T17:43:58.872209] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T17:43:59.248791] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T17:43:59.317675] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-22T17:44:00.117720] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-22T17:44:00.223957] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T17:44:00.917716] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-22T17:44:01.717712] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-22T17:44:01.764610] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T17:44:01.767259] [INFO ] [REMOTE ] BTT: Full fetch complete (22497 records). [2025-10-22T17:44:01.767341] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-22T17:44:02.177499] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-22T17:44:02.177576] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-22T17:44:02.178021] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-22T17:44:02.178082] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-22T17:44:02.178727] [DEBUG] [LOCAL ] BTT: Trimmed 22497 records to 15359 (keeping 200 days of data) [2025-10-22T17:44:02.279548] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-22T17:44:02.312901] [DEBUG] [LOCAL ] BTT: Primary data saved (15359 records). [2025-10-22T17:44:02.313013] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-22T17:44:02.313090] [INFO ] [MAIN ] Update Progress: 354/2367 symbols completed. BTT took 31.0s. Estimated remaining: 4h 9m 59s. Rate: 8.1 symbols/min [2025-10-22T17:44:02.484297] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:02.497193] [DEBUG] [LOCAL ] BUI: Loaded 11926 existing records from primary storage. [2025-10-22T17:44:02.497406] [INFO ] [MAIN ] BUI: Loaded 11926 existing records. [2025-10-22T17:44:02.529119] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-22T17:44:02.690519] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:02.690995] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-22T17:44:02.691126] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-22T17:44:02.696919] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-22T17:44:02.706919] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-22T17:44:02.708072] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T17:44:03.069840] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:03.317688] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-22T17:44:04.117694] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-22T17:44:04.539754] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-22T17:44:04.917742] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-22T17:44:05.058270] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:44:05.188976] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:44:05.717709] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-22T17:44:06.517693] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-22T17:44:06.629630] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T17:44:07.317742] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-22T17:44:07.399302] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T17:44:07.491213] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T17:44:08.117735] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-22T17:44:08.917734] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-22T17:44:08.981162] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T17:44:09.717699] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-22T17:44:09.752464] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T17:44:09.882595] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T17:44:10.517702] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-22T17:44:11.299517] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T17:44:11.317613] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-22T17:44:11.496311] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T17:44:12.118450] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-22T17:44:12.120497] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T17:44:12.917685] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-22T17:44:13.283752] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T17:44:13.717699] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-22T17:44:14.517693] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-22T17:44:14.702554] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T17:44:14.736075] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T17:44:15.317694] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-22T17:44:15.369394] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T17:44:16.117700] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-22T17:44:16.316111] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T17:44:16.917711] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-22T17:44:17.694299] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T17:44:17.717613] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-22T17:44:18.517755] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-22T17:44:18.956443] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T17:44:18.966755] [INFO ] [REMOTE ] BTU: Full fetch complete (77302 records). [2025-10-22T17:44:18.967035] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-22T17:44:19.137764] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T17:44:19.323821] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-22T17:44:19.438137] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-22T17:44:19.438244] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-22T17:44:19.439808] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-22T17:44:19.439889] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-22T17:44:19.441777] [DEBUG] [LOCAL ] BTU: Trimmed 77302 records to 53337 (keeping 200 days of data) [2025-10-22T17:44:19.609767] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T17:44:19.880585] [DEBUG] [LOCAL ] BTU: Primary data saved (53337 records). [2025-10-22T17:44:19.880846] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-22T17:44:19.880986] [INFO ] [MAIN ] Update Progress: 355/2367 symbols completed. BTU took 35.3s. Estimated remaining: 4h 10m 49s. Rate: 8.0 symbols/min [2025-10-22T17:44:20.064121] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:20.113615] [DEBUG] [LOCAL ] BUR: Loaded 45478 existing records from primary storage. [2025-10-22T17:44:20.114174] [INFO ] [MAIN ] BUR: Loaded 45478 existing records. [2025-10-22T17:44:20.126243] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-22T17:44:20.303682] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:20.303893] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-22T17:44:20.303940] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-22T17:44:20.304138] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-22T17:44:20.304176] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-22T17:44:20.695451] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:20.709176] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T17:44:20.714028] [INFO ] [REMOTE ] BTZ: Full fetch complete (33309 records). [2025-10-22T17:44:20.714157] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-22T17:44:20.919177] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-22T17:44:21.150223] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-22T17:44:21.150376] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-22T17:44:21.159264] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-22T17:44:21.160338] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T17:44:21.159990] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-22T17:44:21.164680] [DEBUG] [LOCAL ] BTZ: Trimmed 33309 records to 22396 (keeping 200 days of data) [2025-10-22T17:44:21.317227] [DEBUG] [LOCAL ] BTZ: Primary data saved (22396 records). [2025-10-22T17:44:21.317364] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-22T17:44:21.317443] [INFO ] [MAIN ] Update Progress: 356/2367 symbols completed. BTZ took 30.1s. Estimated remaining: 4h 10m 7s. Rate: 8.0 symbols/min [2025-10-22T17:44:21.491540] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:21.533373] [DEBUG] [LOCAL ] BURL: Loaded 45509 existing records from primary storage. [2025-10-22T17:44:21.533719] [INFO ] [MAIN ] BURL: Loaded 45509 existing records. [2025-10-22T17:44:21.712229] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:21.712437] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-22T17:44:21.712484] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-22T17:44:21.712765] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-22T17:44:21.712822] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-22T17:44:21.723971] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-22T17:44:22.072032] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:22.517711] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-22T17:44:22.806162] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T17:44:23.317683] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-22T17:44:23.374080] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T17:44:23.402835] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T17:44:24.117730] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-22T17:44:24.917731] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-22T17:44:25.275787] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T17:44:25.284989] [INFO ] [REMOTE ] BUD: Full fetch complete (76485 records). [2025-10-22T17:44:25.285169] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-22T17:44:25.702884] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-22T17:44:25.702989] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-22T17:44:25.703912] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-22T17:44:25.704036] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-22T17:44:25.705435] [DEBUG] [LOCAL ] BUD: Trimmed 76485 records to 52597 (keeping 200 days of data) [2025-10-22T17:44:25.755770] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-22T17:44:25.934491] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:44:26.046095] [DEBUG] [LOCAL ] BUD: Primary data saved (52597 records). [2025-10-22T17:44:26.046244] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-22T17:44:26.047018] [INFO ] [MAIN ] Update Progress: 357/2367 symbols completed. BUD took 34.4s. Estimated remaining: 4h 9m 44s. Rate: 8.0 symbols/min [2025-10-22T17:44:26.439762] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T17:44:26.455608] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T17:44:26.517613] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-22T17:44:27.317676] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-22T17:44:27.407298] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T17:44:28.117719] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-22T17:44:28.917713] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-22T17:44:28.951296] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:44:28.973424] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T17:44:28.975898] [INFO ] [REMOTE ] BUI: Full fetch complete (16555 records). [2025-10-22T17:44:28.975967] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-22T17:44:29.343571] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-22T17:44:29.343677] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-22T17:44:29.344081] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-22T17:44:29.344124] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-22T17:44:29.344626] [DEBUG] [LOCAL ] BUI: Trimmed 16555 records to 11824 (keeping 200 days of data) [2025-10-22T17:44:29.414621] [DEBUG] [LOCAL ] BUI: Primary data saved (11824 records). [2025-10-22T17:44:29.414782] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-22T17:44:29.414862] [INFO ] [MAIN ] Update Progress: 358/2367 symbols completed. BUI took 27.1s. Estimated remaining: 4h 9m 14s. Rate: 8.1 symbols/min [2025-10-22T17:44:29.717759] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-22T17:44:30.570104] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:44:30.579804] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-22T17:44:30.982135] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T17:44:31.317751] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-22T17:44:32.041977] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T17:44:32.117707] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-22T17:44:32.962891] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T17:44:32.973161] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-22T17:44:33.947187] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T17:44:33.958884] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-22T17:44:34.865170] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T17:44:34.874480] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-22T17:44:35.419899] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T17:44:35.430587] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-22T17:44:36.291930] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T17:44:36.302242] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-22T17:44:37.198493] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:44:37.207716] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-22T17:44:38.550351] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-22T17:44:38.563788] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-22T17:44:38.841763] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:44:38.851602] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-22T17:44:39.996566] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T17:44:40.006105] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-22T17:44:40.622499] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:44:40.635230] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-22T17:44:41.554075] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T17:44:41.561771] [INFO ] [REMOTE ] BUR: Full fetch complete (64544 records). [2025-10-22T17:44:41.561883] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-22T17:44:41.944559] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-22T17:44:41.944762] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-22T17:44:41.945479] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-22T17:44:41.945520] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-22T17:44:41.946802] [DEBUG] [LOCAL ] BUR: Trimmed 64544 records to 45446 (keeping 200 days of data) [2025-10-22T17:44:42.213037] [DEBUG] [LOCAL ] BUR: Primary data saved (45446 records). [2025-10-22T17:44:42.213372] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-22T17:44:42.213473] [INFO ] [MAIN ] Update Progress: 359/2367 symbols completed. BUR took 22.3s. Estimated remaining: 4h 9m 37s. Rate: 8.0 symbols/min [2025-10-22T17:44:42.239030] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T17:44:42.249850] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-22T17:44:43.905572] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:44:43.912631] [INFO ] [REMOTE ] BURL: Full fetch complete (65791 records). [2025-10-22T17:44:43.912760] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-22T17:44:44.291203] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-22T17:44:44.291288] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-22T17:44:44.292039] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-22T17:44:44.292103] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-22T17:44:44.293395] [DEBUG] [LOCAL ] BURL: Trimmed 65791 records to 45416 (keeping 200 days of data) [2025-10-22T17:44:44.571759] [DEBUG] [LOCAL ] BURL: Primary data saved (45416 records). [2025-10-22T17:44:44.571911] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-22T17:44:44.571996] [INFO ] [MAIN ] Update Progress: 360/2367 symbols completed. BURL took 23.3s. Estimated remaining: 4h 9m 1s. Rate: 8.1 symbols/min [2025-10-22T17:44:45.267274] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:45.228612] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:45.264227] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:45.287708] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:45.288094] [DEBUG] [LOCAL ] BVN: No existing data file found in primary storage. [2025-10-22T17:44:45.288595] [WARN ] [MAIN ] BVN: No existing data found, performing full refresh instead. [2025-10-22T17:44:45.288842] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-22T17:44:45.288907] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-22T17:44:45.288964] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-22T17:44:45.289006] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-22T17:44:45.409032] [DEBUG] [LOCAL ] BUXX: Loaded 15430 existing records from primary storage. [2025-10-22T17:44:45.440930] [INFO ] [MAIN ] BUXX: Loaded 15430 existing records. [2025-10-22T17:44:45.636594] [DEBUG] [LOCAL ] BW: Loaded 40403 existing records from primary storage. [2025-10-22T17:44:45.685720] [INFO ] [MAIN ] BW: Loaded 40403 existing records. [2025-10-22T17:44:45.714358] [DEBUG] [LOCAL ] BV: Loaded 38499 existing records from primary storage. [2025-10-22T17:44:45.779443] [INFO ] [MAIN ] BV: Loaded 38499 existing records. [2025-10-22T17:44:45.901030] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:46.091968] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-22T17:44:46.144321] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-22T17:44:46.217143] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:46.261050] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:46.234560] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-22T17:44:46.261405] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-22T17:44:46.280246] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-22T17:44:46.281282] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-22T17:44:46.281411] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-22T17:44:46.286792] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-22T17:44:46.298553] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-22T17:44:46.420911] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:46.447345] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-22T17:44:46.460265] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-22T17:44:46.545159] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-22T17:44:46.571898] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-22T17:44:47.266919] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:47.284276] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-22T17:44:47.367309] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:47.384847] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-22T17:44:47.475639] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:47.476005] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-22T17:44:47.957682] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T17:44:47.966047] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-22T17:44:48.230616] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T17:44:48.233515] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-22T17:44:48.426134] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T17:44:48.432195] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-22T17:44:48.818747] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T17:44:48.821715] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-22T17:44:49.245264] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T17:44:49.255399] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-22T17:44:49.285015] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T17:44:49.293518] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-22T17:44:49.670715] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T17:44:49.717616] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-22T17:44:49.794803] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T17:44:50.515067] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T17:44:50.520183] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-22T17:44:50.548674] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T17:44:50.756054] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:44:51.317714] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-22T17:44:52.117731] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-22T17:44:52.264748] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T17:44:52.732061] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T17:44:52.917723] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-22T17:44:53.531399] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T17:44:53.717724] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-22T17:44:53.892730] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T17:44:54.517705] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-22T17:44:55.237544] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:44:55.317665] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-22T17:44:55.343283] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T17:44:56.117717] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-22T17:44:56.922726] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-22T17:44:56.934372] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T17:44:57.405144] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T17:44:57.717660] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-22T17:44:57.927335] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T17:44:58.517712] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-22T17:44:59.317718] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-22T17:44:59.364577] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T17:45:00.075169] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:45:00.117674] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-22T17:45:00.805440] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T17:45:00.917709] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-22T17:45:01.625024] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T17:45:01.717702] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-22T17:45:02.517737] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-22T17:45:02.567559] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T17:45:03.317764] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-22T17:45:03.445860] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T17:45:03.758459] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T17:45:04.117719] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-22T17:45:04.709153] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T17:45:04.917774] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-22T17:45:05.474141] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T17:45:05.717745] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-22T17:45:06.517727] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-22T17:45:06.575147] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T17:45:07.144924] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T17:45:07.195291] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T17:45:07.317715] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-22T17:45:08.117721] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-22T17:45:08.680040] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T17:45:08.686202] [INFO ] [REMOTE ] BV: Full fetch complete (54688 records). [2025-10-22T17:45:08.686344] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-22T17:45:08.686970] [FATAL] [VALIDATOR ] BV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:45:08.687056] [FATAL] [MAIN ] BV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:45:08.687099] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:45:08.687163] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-22T17:45:08.687243] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-22T17:45:08.687281] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-10-22T17:45:08.687442] [DEBUG] [LOCAL ] BV: Deleted derivative data file. [2025-10-22T17:45:08.687532] [INFO ] [MAIN ] Update Progress: 361/2367 symbols completed. BV took 24.1s. Estimated remaining: 4h 10m 26s. Rate: 8.0 symbols/min [2025-10-22T17:45:08.855853] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:08.904958] [DEBUG] [LOCAL ] BWA: Loaded 52084 existing records from primary storage. [2025-10-22T17:45:08.905291] [INFO ] [MAIN ] BWA: Loaded 52084 existing records. [2025-10-22T17:45:08.925696] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-22T17:45:09.092831] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:09.093041] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-22T17:45:09.093088] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-22T17:45:09.093304] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-22T17:45:09.093361] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-22T17:45:09.495454] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:09.717724] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-22T17:45:09.790938] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T17:45:10.507527] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T17:45:10.510424] [INFO ] [REMOTE ] BUXX: Full fetch complete (20744 records). [2025-10-22T17:45:10.510508] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-22T17:45:10.522947] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-22T17:45:10.892539] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T17:45:10.932256] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-22T17:45:10.932965] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-22T17:45:10.933530] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-22T17:45:10.933575] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-22T17:45:10.934220] [DEBUG] [LOCAL ] BUXX: Trimmed 20744 records to 15332 (keeping 200 days of data) [2025-10-22T17:45:11.026247] [DEBUG] [LOCAL ] BUXX: Primary data saved (15332 records). [2025-10-22T17:45:11.026404] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-22T17:45:11.026483] [INFO ] [MAIN ] Update Progress: 362/2367 symbols completed. BUXX took 26.5s. Estimated remaining: 4h 9m 50s. Rate: 8.0 symbols/min [2025-10-22T17:45:11.193355] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:11.209738] [DEBUG] [LOCAL ] BWG: Loaded 12632 existing records from primary storage. [2025-10-22T17:45:11.209933] [INFO ] [MAIN ] BWG: Loaded 12632 existing records. [2025-10-22T17:45:11.322859] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-22T17:45:11.383521] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:11.383867] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-22T17:45:11.383917] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-22T17:45:11.384066] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-22T17:45:11.384104] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-22T17:45:11.726560] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:12.117696] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-22T17:45:12.427088] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T17:45:12.917716] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-22T17:45:13.084594] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T17:45:13.480117] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T17:45:13.717699] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-22T17:45:14.495302] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T17:45:14.500511] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T17:45:14.517613] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-22T17:45:15.317726] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-22T17:45:16.117710] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-22T17:45:16.336835] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:45:16.876495] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T17:45:16.909282] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T17:45:16.917307] [INFO ] [REMOTE ] BW: Full fetch complete (59048 records). [2025-10-22T17:45:16.917453] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-22T17:45:16.917680] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-22T17:45:16.919197] [FATAL] [VALIDATOR ] BW: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:45:16.919296] [FATAL] [MAIN ] BW: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:45:16.919348] [WARN ] [MAIN ] BW: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:45:16.919388] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-22T17:45:16.919447] [DEBUG] [LOCAL ] BW: No primary data file found to delete. [2025-10-22T17:45:16.919482] [INFO ] [LOCAL ] BW: Starting deletion of derivative data. [2025-10-22T17:45:16.919735] [DEBUG] [LOCAL ] BW: Deleted derivative data file. [2025-10-22T17:45:16.919828] [INFO ] [MAIN ] Update Progress: 363/2367 symbols completed. BW took 32.3s. Estimated remaining: 4h 9m 34s. Rate: 8.0 symbols/min [2025-10-22T17:45:17.097190] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:17.097449] [DEBUG] [LOCAL ] BWLP: No existing data file found in primary storage. [2025-10-22T17:45:17.097505] [WARN ] [MAIN ] BWLP: No existing data found, performing full refresh instead. [2025-10-22T17:45:17.097670] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-22T17:45:17.097728] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-22T17:45:17.097772] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-22T17:45:17.097805] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-22T17:45:17.452587] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:17.717711] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-22T17:45:18.517722] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-22T17:45:18.921882] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T17:45:19.232885] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T17:45:19.317686] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-22T17:45:19.726494] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-22T17:45:19.734711] [INFO ] [REMOTE ] BVN: Full fetch complete (63486 records). [2025-10-22T17:45:19.734833] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-22T17:45:20.118119] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-22T17:45:20.130660] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T17:45:20.130904] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-22T17:45:20.134666] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-22T17:45:20.135555] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-22T17:45:20.135602] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-22T17:45:20.137014] [DEBUG] [LOCAL ] BVN: Trimmed 63486 records to 44515 (keeping 200 days of data) [2025-10-22T17:45:20.398823] [DEBUG] [LOCAL ] BVN: Primary data saved (44515 records). [2025-10-22T17:45:20.398953] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-22T17:45:20.399022] [INFO ] [MAIN ] Update Progress: 364/2367 symbols completed. BVN took 35.8s. Estimated remaining: 4h 9m 4s. Rate: 8.0 symbols/min [2025-10-22T17:45:20.561785] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:20.571155] [DEBUG] [LOCAL ] BWMX: Loaded 7868 existing records from primary storage. [2025-10-22T17:45:20.571342] [INFO ] [MAIN ] BWMX: Loaded 7868 existing records. [2025-10-22T17:45:20.741293] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:20.741492] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-22T17:45:20.741539] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-22T17:45:20.741706] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-22T17:45:20.741762] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-22T17:45:20.925976] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-22T17:45:21.089955] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:21.679378] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:45:21.717612] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-22T17:45:21.948060] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T17:45:22.517708] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-22T17:45:23.317819] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-22T17:45:23.379241] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T17:45:23.586282] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T17:45:24.117734] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-22T17:45:24.596500] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T17:45:24.917685] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-22T17:45:25.049678] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T17:45:25.693220] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T17:45:25.717732] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-22T17:45:26.517741] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-22T17:45:27.179344] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T17:45:27.278629] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T17:45:27.317711] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-22T17:45:27.974213] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T17:45:28.117724] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-22T17:45:28.917729] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-22T17:45:29.717764] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-22T17:45:29.801791] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T17:45:30.435904] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T17:45:30.517742] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-22T17:45:30.548784] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T17:45:31.317783] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-22T17:45:31.914054] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:45:32.117739] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-22T17:45:32.917767] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-22T17:45:33.082613] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T17:45:33.365417] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T17:45:33.539190] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T17:45:33.717750] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-22T17:45:34.460522] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T17:45:34.517727] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-22T17:45:35.317699] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-22T17:45:36.018610] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:45:36.117667] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-22T17:45:36.273172] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T17:45:36.917684] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-22T17:45:37.432146] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:45:37.453401] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-22T17:45:37.717708] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-22T17:45:38.517715] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-22T17:45:39.258896] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T17:45:39.317742] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-22T17:45:39.730700] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T17:45:40.117702] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-22T17:45:40.404115] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T17:45:40.405950] [INFO ] [REMOTE ] BWG: Full fetch complete (17703 records). [2025-10-22T17:45:40.406146] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-22T17:45:40.774364] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-22T17:45:40.774458] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-22T17:45:40.775076] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-22T17:45:40.775150] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-22T17:45:40.775985] [DEBUG] [LOCAL ] BWG: Trimmed 17703 records to 12559 (keeping 200 days of data) [2025-10-22T17:45:40.850458] [DEBUG] [LOCAL ] BWG: Primary data saved (12559 records). [2025-10-22T17:45:40.850592] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-22T17:45:40.850695] [INFO ] [MAIN ] Update Progress: 365/2367 symbols completed. BWG took 29.8s. Estimated remaining: 4h 10m 8s. Rate: 8.0 symbols/min [2025-10-22T17:45:40.924705] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-22T17:45:40.977047] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T17:45:41.070689] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:41.077029] [DEBUG] [LOCAL ] BWNB: Loaded 4079 existing records from primary storage. [2025-10-22T17:45:41.077194] [INFO ] [MAIN ] BWNB: Loaded 4079 existing records. [2025-10-22T17:45:41.255899] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:41.256130] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-22T17:45:41.256202] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-22T17:45:41.256540] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-22T17:45:41.256579] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-22T17:45:41.643221] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:41.717698] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-22T17:45:42.232058] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-22T17:45:42.517731] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-22T17:45:43.042926] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T17:45:43.051912] [INFO ] [REMOTE ] BWA: Full fetch complete (75894 records). [2025-10-22T17:45:43.052073] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-22T17:45:43.323024] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-22T17:45:43.466300] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-22T17:45:43.466389] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-22T17:45:43.467350] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-22T17:45:43.467423] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-22T17:45:43.469009] [DEBUG] [LOCAL ] BWA: Trimmed 75894 records to 52078 (keeping 200 days of data) [2025-10-22T17:45:43.809750] [DEBUG] [LOCAL ] BWA: Primary data saved (52078 records). [2025-10-22T17:45:43.810013] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-22T17:45:43.810905] [INFO ] [MAIN ] Update Progress: 366/2367 symbols completed. BWA took 35.1s. Estimated remaining: 4h 9m 36s. Rate: 8.0 symbols/min [2025-10-22T17:45:44.013028] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:44.013269] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-10-22T17:45:44.013314] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-10-22T17:45:44.013443] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-22T17:45:44.013483] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-22T17:45:44.013524] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-10-22T17:45:44.013556] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-22T17:45:44.120400] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-22T17:45:44.142706] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T17:45:44.170261] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T17:45:44.417111] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:44.719857] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T17:45:44.917682] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-22T17:45:45.720250] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-22T17:45:45.722987] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T17:45:45.724850] [INFO ] [REMOTE ] BWMX: Full fetch complete (9901 records). [2025-10-22T17:45:45.724917] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-22T17:45:45.725288] [FATAL] [VALIDATOR ] BWMX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:45:45.725367] [FATAL] [MAIN ] BWMX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:45:45.725433] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:45:45.725501] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-22T17:45:45.725558] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-10-22T17:45:45.725592] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-10-22T17:45:45.725774] [DEBUG] [LOCAL ] BWMX: Deleted derivative data file. [2025-10-22T17:45:45.725856] [INFO ] [MAIN ] Update Progress: 367/2367 symbols completed. BWMX took 25.3s. Estimated remaining: 4h 8m 58s. Rate: 8.0 symbols/min [2025-10-22T17:45:45.898682] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:45.941747] [DEBUG] [LOCAL ] BWXT: Loaded 47258 existing records from primary storage. [2025-10-22T17:45:45.942210] [INFO ] [MAIN ] BWXT: Loaded 47258 existing records. [2025-10-22T17:45:46.118993] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:46.119293] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-22T17:45:46.119339] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-22T17:45:46.119584] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-22T17:45:46.119679] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-22T17:45:46.198900] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-22T17:45:46.471505] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:46.517636] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-22T17:45:47.317795] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-22T17:45:48.117715] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-22T17:45:48.474833] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T17:45:48.485504] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-22T17:45:48.512283] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T17:45:48.917694] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-22T17:45:49.717741] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-22T17:45:50.148816] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T17:45:50.154442] [INFO ] [REMOTE ] BWLP: Full fetch complete (47857 records). [2025-10-22T17:45:50.154552] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-22T17:45:50.522808] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-22T17:45:50.611793] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-22T17:45:50.612125] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-22T17:45:50.612817] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-22T17:45:50.612884] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-22T17:45:50.614024] [DEBUG] [LOCAL ] BWLP: Trimmed 47857 records to 32092 (keeping 200 days of data) [2025-10-22T17:45:50.809674] [DEBUG] [LOCAL ] BWLP: Primary data saved (32092 records). [2025-10-22T17:45:50.809813] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-22T17:45:50.809884] [INFO ] [MAIN ] Update Progress: 368/2367 symbols completed. BWLP took 33.9s. Estimated remaining: 4h 8m 37s. Rate: 8.0 symbols/min [2025-10-22T17:45:50.988910] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:51.044172] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T17:45:51.045419] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-22T17:45:51.047672] [INFO ] [MAIN ] BX: Loaded 53483 existing records. [2025-10-22T17:45:51.227762] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:51.228112] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-22T17:45:51.228162] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-22T17:45:51.228530] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-22T17:45:51.228588] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-22T17:45:51.319686] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-22T17:45:51.595220] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:51.632716] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T17:45:51.925696] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T17:45:52.117685] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-22T17:45:52.917768] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-22T17:45:53.501030] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-22T17:45:53.717785] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-22T17:45:54.127596] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T17:45:54.517739] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-22T17:45:55.056358] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:45:55.218405] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T17:45:55.317720] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-22T17:45:56.117720] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-22T17:45:56.917763] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-22T17:45:56.957849] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:45:57.491949] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T17:45:57.717697] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-22T17:45:57.788447] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T17:45:58.517697] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-22T17:45:59.317689] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-22T17:45:59.347019] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T17:45:59.607025] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T17:45:59.705182] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-22T17:46:00.117738] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-22T17:46:00.917698] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-22T17:46:01.717692] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-22T17:46:02.461330] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-22T17:46:02.517723] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-22T17:46:03.046441] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-22T17:46:03.317761] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-22T17:46:03.490557] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-22T17:46:03.510468] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T17:46:04.117707] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-22T17:46:04.168300] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:46:04.917743] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-22T17:46:05.717707] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-22T17:46:05.758726] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T17:46:06.517693] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-22T17:46:06.739660] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T17:46:06.959303] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T17:46:07.149067] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T17:46:07.317675] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-22T17:46:07.806594] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T17:46:08.117730] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-22T17:46:08.917764] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-22T17:46:09.543901] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T17:46:09.545040] [INFO ] [REMOTE ] BWNB: Full fetch complete (5594 records). [2025-10-22T17:46:09.545114] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-22T17:46:09.725218] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-22T17:46:09.931619] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-22T17:46:09.931772] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-22T17:46:09.932025] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-22T17:46:09.932076] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-22T17:46:09.932444] [DEBUG] [LOCAL ] BWNB: Trimmed 5594 records to 4051 (keeping 200 days of data) [2025-10-22T17:46:09.957891] [DEBUG] [LOCAL ] BWNB: Primary data saved (4051 records). [2025-10-22T17:46:09.958041] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-22T17:46:09.958123] [INFO ] [MAIN ] Update Progress: 369/2367 symbols completed. BWNB took 29.1s. Estimated remaining: 4h 9m 33s. Rate: 8.0 symbols/min [2025-10-22T17:46:10.128245] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:10.142950] [DEBUG] [LOCAL ] BXC: Loaded 13531 existing records from primary storage. [2025-10-22T17:46:10.143200] [INFO ] [MAIN ] BXC: Loaded 13531 existing records. [2025-10-22T17:46:10.322134] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:10.322442] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-22T17:46:10.322499] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-22T17:46:10.322734] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-22T17:46:10.322792] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-22T17:46:10.521610] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-22T17:46:10.649782] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T17:46:10.651676] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-22T17:46:10.663752] [INFO ] [REMOTE ] BWSN: Full fetch complete (6381 records). [2025-10-22T17:46:10.679701] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-22T17:46:10.847003] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:11.106776] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-22T17:46:11.106856] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-22T17:46:11.107037] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-22T17:46:11.107077] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-22T17:46:11.107509] [DEBUG] [LOCAL ] BWSN: Trimmed 6381 records to 5048 (keeping 200 days of data) [2025-10-22T17:46:11.138537] [DEBUG] [LOCAL ] BWSN: Primary data saved (5048 records). [2025-10-22T17:46:11.138691] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-22T17:46:11.138778] [INFO ] [MAIN ] Update Progress: 370/2367 symbols completed. BWSN took 27.3s. Estimated remaining: 4h 8m 52s. Rate: 8.0 symbols/min [2025-10-22T17:46:11.314852] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:11.317692] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-22T17:46:11.362178] [DEBUG] [LOCAL ] BXMT: Loaded 47278 existing records from primary storage. [2025-10-22T17:46:11.362477] [INFO ] [MAIN ] BXMT: Loaded 47278 existing records. [2025-10-22T17:46:11.538579] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:11.538854] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-22T17:46:11.538901] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-22T17:46:11.539068] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-22T17:46:11.539106] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-22T17:46:11.889420] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:12.117707] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-22T17:46:12.737523] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-22T17:46:12.917724] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-22T17:46:13.179085] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T17:46:13.717734] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-22T17:46:13.998482] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:46:14.517705] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-22T17:46:14.908773] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T17:46:15.317697] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-22T17:46:15.739625] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T17:46:15.955347] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:46:16.117756] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-22T17:46:16.401190] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T17:46:16.917728] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-22T17:46:17.717742] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-22T17:46:18.021524] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T17:46:18.517743] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-22T17:46:18.701339] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T17:46:19.317688] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-22T17:46:19.606035] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T17:46:20.117673] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-22T17:46:20.216199] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T17:46:20.917671] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-22T17:46:21.037518] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:46:21.717713] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-22T17:46:22.370500] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-22T17:46:22.378702] [INFO ] [REMOTE ] BWXT: Full fetch complete (68100 records). [2025-10-22T17:46:22.378878] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-22T17:46:22.524952] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-22T17:46:22.788018] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-22T17:46:22.788190] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-22T17:46:22.789045] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-22T17:46:22.789131] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-22T17:46:22.790594] [DEBUG] [LOCAL ] BWXT: Trimmed 68100 records to 47260 (keeping 200 days of data) [2025-10-22T17:46:22.932788] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T17:46:22.974320] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T17:46:22.988208] [INFO ] [REMOTE ] BX: Full fetch complete (77218 records). [2025-10-22T17:46:22.988393] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-22T17:46:22.989756] [FATAL] [VALIDATOR ] BX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:46:23.044004] [FATAL] [MAIN ] BX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:46:23.053884] [WARN ] [MAIN ] BX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:46:23.080750] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-22T17:46:23.081816] [DEBUG] [LOCAL ] BX: No primary data file found to delete. [2025-10-22T17:46:23.082108] [INFO ] [LOCAL ] BX: Starting deletion of derivative data. [2025-10-22T17:46:23.083213] [DEBUG] [LOCAL ] BX: Deleted derivative data file. [2025-10-22T17:46:23.083720] [INFO ] [MAIN ] Update Progress: 371/2367 symbols completed. BX took 32.3s. Estimated remaining: 4h 9m 8s. Rate: 8.0 symbols/min [2025-10-22T17:46:23.275575] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:23.325076] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-22T17:46:23.353255] [DEBUG] [LOCAL ] BWXT: Primary data saved (47260 records). [2025-10-22T17:46:23.354682] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-22T17:46:23.354815] [INFO ] [MAIN ] Update Progress: 372/2367 symbols completed. BWXT took 37.6s. Estimated remaining: 4h 8m 22s. Rate: 8.0 symbols/min [2025-10-22T17:46:23.354231] [DEBUG] [LOCAL ] BXMX: Loaded 19175 existing records from primary storage. [2025-10-22T17:46:23.389876] [INFO ] [MAIN ] BXMX: Loaded 19175 existing records. [2025-10-22T17:46:23.534007] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T17:46:23.700067] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:23.753579] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:23.753768] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-22T17:46:23.753816] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-22T17:46:23.754046] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-22T17:46:23.754097] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-22T17:46:24.060373] [DEBUG] [LOCAL ] BXP: Loaded 49875 existing records from primary storage. [2025-10-22T17:46:24.066257] [INFO ] [MAIN ] BXP: Loaded 49875 existing records. [2025-10-22T17:46:24.138062] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-22T17:46:24.239638] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:24.318808] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:24.318971] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-22T17:46:24.319019] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-22T17:46:24.319239] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-22T17:46:24.319293] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-22T17:46:24.660319] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:24.917667] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-22T17:46:25.090631] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T17:46:25.283171] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T17:46:25.717733] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-22T17:46:26.258029] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T17:46:26.517683] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-22T17:46:27.308093] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T17:46:27.317738] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-22T17:46:28.117712] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-22T17:46:28.181253] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T17:46:28.225103] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T17:46:28.917735] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-22T17:46:29.101267] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T17:46:29.717752] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-22T17:46:30.517732] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-22T17:46:30.566997] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T17:46:30.858937] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T17:46:31.317720] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-22T17:46:32.128197] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-22T17:46:32.156380] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T17:46:32.477895] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T17:46:32.917708] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-22T17:46:33.717760] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-22T17:46:33.959342] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T17:46:34.021556] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T17:46:34.517694] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-22T17:46:35.317884] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-22T17:46:35.361463] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T17:46:35.495022] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T17:46:36.117725] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-22T17:46:36.912973] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T17:46:36.917602] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-22T17:46:37.231805] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T17:46:37.717729] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-22T17:46:37.936212] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T17:46:38.517707] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-22T17:46:38.714685] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T17:46:39.317692] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-22T17:46:39.528088] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T17:46:40.117722] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-22T17:46:40.188115] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:46:40.917698] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-22T17:46:41.575054] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T17:46:41.717851] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-22T17:46:41.883175] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T17:46:42.517713] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-22T17:46:42.610373] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T17:46:43.317728] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-22T17:46:43.935104] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-22T17:46:43.937361] [INFO ] [REMOTE ] BXC: Full fetch complete (18287 records). [2025-10-22T17:46:43.937433] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-22T17:46:43.938135] [FATAL] [VALIDATOR ] BXC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:46:43.938239] [FATAL] [MAIN ] BXC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:46:43.938311] [WARN ] [MAIN ] BXC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:46:43.938360] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-22T17:46:43.938414] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-10-22T17:46:43.938447] [INFO ] [LOCAL ] BXC: Starting deletion of derivative data. [2025-10-22T17:46:43.938571] [DEBUG] [LOCAL ] BXC: Deleted derivative data file. [2025-10-22T17:46:43.938637] [INFO ] [MAIN ] Update Progress: 373/2367 symbols completed. BXC took 34.0s. Estimated remaining: 4h 9m 25s. Rate: 8.0 symbols/min [2025-10-22T17:46:44.109897] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:44.117683] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-22T17:46:44.153386] [DEBUG] [LOCAL ] BXSL: Loaded 48203 existing records from primary storage. [2025-10-22T17:46:44.153720] [INFO ] [MAIN ] BXSL: Loaded 48203 existing records. [2025-10-22T17:46:44.337690] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:44.338167] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-22T17:46:44.338233] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-22T17:46:44.367700] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-22T17:46:44.367959] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-22T17:46:44.403428] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T17:46:44.742988] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:44.917714] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-22T17:46:45.202304] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T17:46:45.717715] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-22T17:46:46.517679] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-22T17:46:46.667265] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T17:46:46.675113] [INFO ] [REMOTE ] BXMT: Full fetch complete (69497 records). [2025-10-22T17:46:46.675226] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-22T17:46:46.676007] [FATAL] [VALIDATOR ] BXMT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:46:46.676094] [FATAL] [MAIN ] BXMT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:46:46.676137] [WARN ] [MAIN ] BXMT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:46:46.676174] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-22T17:46:46.676232] [DEBUG] [LOCAL ] BXMT: No primary data file found to delete. [2025-10-22T17:46:46.676267] [INFO ] [LOCAL ] BXMT: Starting deletion of derivative data. [2025-10-22T17:46:46.676433] [DEBUG] [LOCAL ] BXMT: Deleted derivative data file. [2025-10-22T17:46:46.676917] [INFO ] [MAIN ] Update Progress: 374/2367 symbols completed. BXMT took 35.5s. Estimated remaining: 4h 8m 52s. Rate: 8.0 symbols/min [2025-10-22T17:46:46.841561] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:46.863033] [DEBUG] [LOCAL ] BY: Loaded 21802 existing records from primary storage. [2025-10-22T17:46:46.863268] [INFO ] [MAIN ] BY: Loaded 21802 existing records. [2025-10-22T17:46:47.039844] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:47.040091] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-22T17:46:47.040147] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-22T17:46:47.040311] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-22T17:46:47.040348] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-22T17:46:47.323604] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-22T17:46:47.411461] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:47.458323] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T17:46:47.698979] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T17:46:47.702334] [INFO ] [REMOTE ] BXMX: Full fetch complete (28406 records). [2025-10-22T17:46:47.702450] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-22T17:46:47.703015] [FATAL] [VALIDATOR ] BXMX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:46:47.703102] [FATAL] [MAIN ] BXMX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:46:47.703144] [WARN ] [MAIN ] BXMX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:46:47.703183] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-22T17:46:47.703240] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-10-22T17:46:47.703275] [INFO ] [LOCAL ] BXMX: Starting deletion of derivative data. [2025-10-22T17:46:47.703413] [DEBUG] [LOCAL ] BXMX: Deleted derivative data file. [2025-10-22T17:46:47.703480] [INFO ] [MAIN ] Update Progress: 375/2367 symbols completed. BXMX took 24.6s. Estimated remaining: 4h 8m 10s. Rate: 8.0 symbols/min [2025-10-22T17:46:47.878800] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:47.919876] [DEBUG] [LOCAL ] BYD: Loaded 44943 existing records from primary storage. [2025-10-22T17:46:47.920229] [INFO ] [MAIN ] BYD: Loaded 44943 existing records. [2025-10-22T17:46:48.098989] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:48.099202] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-22T17:46:48.099250] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-22T17:46:48.099438] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-22T17:46:48.099479] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-22T17:46:48.122905] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-22T17:46:48.468913] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:48.917698] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-22T17:46:49.156731] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T17:46:49.268808] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T17:46:49.717732] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-22T17:46:50.394819] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T17:46:50.522850] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-22T17:46:50.538495] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:46:51.317782] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-22T17:46:52.117742] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-22T17:46:52.568460] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-22T17:46:52.736093] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:46:52.917705] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-22T17:46:53.690446] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:46:53.717701] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-22T17:46:54.283169] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T17:46:54.517694] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-22T17:46:55.317680] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-22T17:46:55.544634] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T17:46:55.820529] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T17:46:55.945547] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T17:46:56.117686] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-22T17:46:56.917723] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-22T17:46:57.717700] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-22T17:46:58.453670] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-22T17:46:58.462611] [INFO ] [REMOTE ] BXP: Full fetch complete (72275 records). [2025-10-22T17:46:58.462798] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-22T17:46:58.526256] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-22T17:46:58.881047] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-22T17:46:58.881317] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-22T17:46:58.882284] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-22T17:46:58.882392] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-22T17:46:58.900634] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T17:46:58.933855] [DEBUG] [LOCAL ] BXP: Trimmed 72275 records to 49849 (keeping 200 days of data) [2025-10-22T17:46:58.935238] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-22T17:46:59.236167] [DEBUG] [LOCAL ] BXP: Primary data saved (49849 records). [2025-10-22T17:46:59.236296] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-22T17:46:59.236370] [INFO ] [MAIN ] Update Progress: 376/2367 symbols completed. BXP took 35.9s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-10-22T17:46:59.323865] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-22T17:46:59.417089] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:59.432888] [DEBUG] [LOCAL ] BYM: Loaded 11430 existing records from primary storage. [2025-10-22T17:46:59.433208] [INFO ] [MAIN ] BYM: Loaded 11430 existing records. [2025-10-22T17:46:59.622045] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:59.622285] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-22T17:46:59.622332] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-22T17:46:59.622517] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-22T17:46:59.622572] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-22T17:46:59.976174] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:00.117732] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-22T17:47:00.217401] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T17:47:00.362970] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T17:47:00.917712] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-22T17:47:01.717745] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-22T17:47:01.914810] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:47:02.133317] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T17:47:02.517704] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-22T17:47:03.317720] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-22T17:47:03.547000] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T17:47:03.646913] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T17:47:04.117727] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-22T17:47:04.789409] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T17:47:04.917676] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-22T17:47:05.225153] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T17:47:05.717641] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-22T17:47:06.517686] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-22T17:47:06.680637] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T17:47:06.765516] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:47:07.317723] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-22T17:47:08.013335] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T17:47:08.117720] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-22T17:47:08.486800] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T17:47:08.490399] [INFO ] [REMOTE ] BY: Full fetch complete (29623 records). [2025-10-22T17:47:08.490484] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-22T17:47:08.869705] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-22T17:47:08.869807] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-22T17:47:08.870266] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-22T17:47:08.870309] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-22T17:47:08.871092] [DEBUG] [LOCAL ] BY: Trimmed 29623 records to 21636 (keeping 200 days of data) [2025-10-22T17:47:08.924229] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-22T17:47:09.006190] [DEBUG] [LOCAL ] BY: Primary data saved (21636 records). [2025-10-22T17:47:09.006319] [INFO ] [MAIN ] BY: Full history saved. [2025-10-22T17:47:09.006399] [INFO ] [MAIN ] Update Progress: 377/2367 symbols completed. BY took 22.3s. Estimated remaining: 4h 8m 29s. Rate: 8.0 symbols/min [2025-10-22T17:47:09.174756] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:09.174978] [DEBUG] [LOCAL ] BZH: No existing data file found in primary storage. [2025-10-22T17:47:09.175071] [WARN ] [MAIN ] BZH: No existing data found, performing full refresh instead. [2025-10-22T17:47:09.175168] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-22T17:47:09.175233] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-22T17:47:09.175311] [DEBUG] [LOCAL ] BZH: No primary data file found to delete. [2025-10-22T17:47:09.175364] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-22T17:47:09.535426] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:09.717678] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-22T17:47:09.995613] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T17:47:10.176374] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:47:10.517693] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-22T17:47:10.927787] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T17:47:11.317708] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-22T17:47:12.117769] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-22T17:47:12.153776] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T17:47:12.370344] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T17:47:12.917703] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-22T17:47:13.230817] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T17:47:13.673275] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T17:47:13.717691] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-22T17:47:14.517761] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-22T17:47:14.959226] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T17:47:15.317703] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-22T17:47:15.454851] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T17:47:16.117714] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-22T17:47:16.917713] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-22T17:47:17.136972] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T17:47:17.136250] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T17:47:17.149168] [INFO ] [REMOTE ] BXSL: Full fetch complete (69687 records). [2025-10-22T17:47:17.149277] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-22T17:47:17.150010] [FATAL] [VALIDATOR ] BXSL: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:47:17.150097] [FATAL] [MAIN ] BXSL: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:47:17.150139] [WARN ] [MAIN ] BXSL: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:47:17.150177] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-22T17:47:17.150232] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-22T17:47:17.150267] [INFO ] [LOCAL ] BXSL: Starting deletion of derivative data. [2025-10-22T17:47:17.150430] [DEBUG] [LOCAL ] BXSL: Deleted derivative data file. [2025-10-22T17:47:17.151102] [INFO ] [MAIN ] Update Progress: 378/2367 symbols completed. BXSL took 33.2s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-10-22T17:47:17.332004] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:17.383431] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-22T17:47:17.383756] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-10-22T17:47:17.555238] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:47:17.555470] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-22T17:47:17.555516] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-22T17:47:17.555728] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-22T17:47:17.555787] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-22T17:47:17.728555] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-22T17:47:17.909792] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:18.480413] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T17:47:18.511941] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T17:47:18.520952] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-22T17:47:19.317692] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-22T17:47:19.917512] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:47:20.117684] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-22T17:47:20.192475] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T17:47:20.917732] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-22T17:47:21.712326] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:47:21.719591] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-22T17:47:22.509880] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T17:47:22.518597] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-22T17:47:23.317700] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-22T17:47:23.445570] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T17:47:23.946060] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-22T17:47:24.117671] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-22T17:47:24.889854] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T17:47:24.897724] [INFO ] [REMOTE ] BYD: Full fetch complete (65439 records). [2025-10-22T17:47:24.897884] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-22T17:47:24.930392] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-22T17:47:25.293266] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-22T17:47:25.293356] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-22T17:47:25.294145] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-22T17:47:25.294207] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-22T17:47:25.295432] [DEBUG] [LOCAL ] BYD: Trimmed 65439 records to 44941 (keeping 200 days of data) [2025-10-22T17:47:25.562822] [DEBUG] [LOCAL ] BYD: Primary data saved (44941 records). [2025-10-22T17:47:25.562945] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-22T17:47:25.563028] [INFO ] [MAIN ] Update Progress: 379/2367 symbols completed. BYD took 37.9s. Estimated remaining: 4h 8m 22s. Rate: 8.0 symbols/min [2025-10-22T17:47:25.729944] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:25.727517] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-22T17:47:25.748897] [DEBUG] [LOCAL ] CAAP: Loaded 19895 existing records from primary storage. [2025-10-22T17:47:25.749125] [INFO ] [MAIN ] CAAP: Loaded 19895 existing records. [2025-10-22T17:47:25.933791] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:47:25.934015] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-22T17:47:25.934188] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-22T17:47:25.934461] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-22T17:47:25.934596] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-22T17:47:26.265953] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-22T17:47:26.396183] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-22T17:47:26.395128] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:26.419985] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T17:47:26.517727] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-22T17:47:27.317716] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-22T17:47:28.117709] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-22T17:47:28.377608] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T17:47:28.636777] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-22T17:47:28.917716] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-22T17:47:28.936031] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T17:47:29.717708] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-22T17:47:30.517744] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-22T17:47:30.569914] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T17:47:30.572122] [INFO ] [REMOTE ] BYM: Full fetch complete (17305 records). [2025-10-22T17:47:30.572192] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-22T17:47:30.925516] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-22T17:47:30.925595] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-22T17:47:30.925994] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-22T17:47:30.926057] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-22T17:47:30.926682] [DEBUG] [LOCAL ] BYM: Trimmed 17305 records to 11369 (keeping 200 days of data) [2025-10-22T17:47:30.995261] [DEBUG] [LOCAL ] BYM: Primary data saved (11369 records). [2025-10-22T17:47:30.995395] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-22T17:47:30.995473] [INFO ] [MAIN ] Update Progress: 380/2367 symbols completed. BYM took 31.8s. Estimated remaining: 4h 8m 4s. Rate: 8.0 symbols/min [2025-10-22T17:47:31.166249] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:31.182720] [DEBUG] [LOCAL ] CABO: Loaded 16710 existing records from primary storage. [2025-10-22T17:47:31.182961] [INFO ] [MAIN ] CABO: Loaded 16710 existing records. [2025-10-22T17:47:31.333612] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-22T17:47:31.364759] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:47:31.366070] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-22T17:47:31.366144] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-22T17:47:31.366445] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-22T17:47:31.366725] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-22T17:47:31.490433] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:47:31.598014] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-22T17:47:31.784590] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:32.117716] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-22T17:47:32.891078] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T17:47:32.917677] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-22T17:47:33.033406] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T17:47:33.717785] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-22T17:47:34.130380] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T17:47:34.517749] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-22T17:47:34.678569] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T17:47:35.317710] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-22T17:47:35.400595] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:47:36.117733] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-22T17:47:36.917734] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-22T17:47:36.955975] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-22T17:47:37.310468] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T17:47:37.717716] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-22T17:47:37.900750] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T17:47:38.436936] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T17:47:38.517708] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-22T17:47:39.316734] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T17:47:39.320121] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-22T17:47:40.117713] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-22T17:47:40.814028] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T17:47:40.819150] [INFO ] [REMOTE ] BZH: Full fetch complete (47248 records). [2025-10-22T17:47:40.819300] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-22T17:47:40.922700] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-22T17:47:41.193258] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-22T17:47:41.193340] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-22T17:47:41.193936] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-22T17:47:41.193999] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-22T17:47:41.195039] [DEBUG] [LOCAL ] BZH: Trimmed 47248 records to 32065 (keeping 200 days of data) [2025-10-22T17:47:41.376630] [DEBUG] [LOCAL ] BZH: Primary data saved (32065 records). [2025-10-22T17:47:41.376820] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-22T17:47:41.376895] [INFO ] [MAIN ] Update Progress: 381/2367 symbols completed. BZH took 32.4s. Estimated remaining: 4h 8m 11s. Rate: 8.0 symbols/min [2025-10-22T17:47:41.542200] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:41.563738] [DEBUG] [LOCAL ] CACI: Loaded 22510 existing records from primary storage. [2025-10-22T17:47:41.564001] [INFO ] [MAIN ] CACI: Loaded 22510 existing records. [2025-10-22T17:47:41.721981] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-22T17:47:41.744362] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:47:41.744630] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-22T17:47:41.744875] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-22T17:47:41.745047] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-22T17:47:41.745086] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-22T17:47:42.129033] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:42.148350] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:47:42.183622] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T17:47:42.517698] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-22T17:47:42.823580] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T17:47:43.317718] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-22T17:47:43.525724] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T17:47:44.117721] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-22T17:47:44.878067] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:47:44.917718] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-22T17:47:45.717765] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-22T17:47:46.107611] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T17:47:46.398970] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-22T17:47:46.517721] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-22T17:47:47.206517] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T17:47:47.317666] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-22T17:47:48.117721] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-22T17:47:48.624832] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T17:47:48.882422] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T17:47:48.917733] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-22T17:47:49.189080] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T17:47:49.717741] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-22T17:47:50.445620] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T17:47:50.517764] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-22T17:47:51.317737] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-22T17:47:51.517704] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T17:47:51.570565] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T17:47:52.117706] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-22T17:47:52.495399] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T17:47:52.797404] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T17:47:52.917714] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-22T17:47:53.717709] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-22T17:47:53.825586] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T17:47:54.517706] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-22T17:47:54.640076] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T17:47:55.317677] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-22T17:47:55.551128] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T17:47:56.117692] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-22T17:47:56.433812] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T17:47:56.917667] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-22T17:47:57.317231] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T17:47:57.717681] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-22T17:47:58.041930] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T17:47:58.517695] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-22T17:47:58.927743] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T17:47:58.933578] [INFO ] [REMOTE ] CAAP: Full fetch complete (27906 records). [2025-10-22T17:47:58.933756] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-22T17:47:59.337448] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-22T17:47:59.350376] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-22T17:47:59.350459] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-22T17:47:59.350947] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-22T17:47:59.351010] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-22T17:47:59.351904] [DEBUG] [LOCAL ] CAAP: Trimmed 27906 records to 19805 (keeping 200 days of data) [2025-10-22T17:47:59.469160] [DEBUG] [LOCAL ] CAAP: Primary data saved (19805 records). [2025-10-22T17:47:59.469322] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-22T17:47:59.469407] [INFO ] [MAIN ] Update Progress: 382/2367 symbols completed. CAAP took 33.9s. Estimated remaining: 4h 8m 59s. Rate: 8.0 symbols/min [2025-10-22T17:47:59.672947] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:59.685788] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T17:47:59.731662] [DEBUG] [LOCAL ] CADE: Loaded 49677 existing records from primary storage. [2025-10-22T17:47:59.731979] [INFO ] [MAIN ] CADE: Loaded 49677 existing records. [2025-10-22T17:47:59.908120] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:47:59.908427] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-22T17:47:59.908484] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-22T17:47:59.908902] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-22T17:47:59.908958] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-22T17:48:00.122930] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-22T17:48:00.250510] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:00.917748] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-22T17:48:01.289987] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T17:48:01.292500] [INFO ] [REMOTE ] CABO: Full fetch complete (23184 records). [2025-10-22T17:48:01.292670] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-22T17:48:01.686398] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-22T17:48:01.686618] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-22T17:48:01.687230] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-22T17:48:01.687298] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-22T17:48:01.688188] [DEBUG] [LOCAL ] CABO: Trimmed 23184 records to 16659 (keeping 200 days of data) [2025-10-22T17:48:01.730346] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-22T17:48:01.792442] [DEBUG] [LOCAL ] CABO: Primary data saved (16659 records). [2025-10-22T17:48:01.792756] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-22T17:48:01.792857] [INFO ] [MAIN ] Update Progress: 383/2367 symbols completed. CABO took 30.8s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-10-22T17:48:01.975637] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:01.975876] [DEBUG] [LOCAL ] CAE: No existing data file found in primary storage. [2025-10-22T17:48:01.975945] [WARN ] [MAIN ] CAE: No existing data found, performing full refresh instead. [2025-10-22T17:48:01.976160] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-22T17:48:01.976272] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-22T17:48:01.976376] [DEBUG] [LOCAL ] CAE: No primary data file found to delete. [2025-10-22T17:48:01.976445] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-22T17:48:02.088201] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-22T17:48:02.123880] [INFO ] [REMOTE ] C: Full fetch complete (77528 records). [2025-10-22T17:48:02.137804] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-22T17:48:02.140946] [FATAL] [VALIDATOR ] C: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:48:02.151623] [FATAL] [MAIN ] C: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:48:02.179728] [WARN ] [MAIN ] C: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:48:02.179824] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-22T17:48:02.201136] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-10-22T17:48:02.204703] [INFO ] [LOCAL ] C: Starting deletion of derivative data. [2025-10-22T17:48:02.224669] [DEBUG] [LOCAL ] C: Deleted derivative data file. [2025-10-22T17:48:02.225397] [INFO ] [MAIN ] Update Progress: 384/2367 symbols completed. C took 45.1s. Estimated remaining: 4h 7m 40s. Rate: 8.0 symbols/min [2025-10-22T17:48:02.633186] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:02.640735] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:02.641930] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-22T17:48:02.649451] [DEBUG] [LOCAL ] CAF: Loaded 3490 existing records from primary storage. [2025-10-22T17:48:02.649736] [INFO ] [MAIN ] CAF: Loaded 3490 existing records. [2025-10-22T17:48:02.890057] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:02.890803] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-22T17:48:02.892415] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T17:48:02.892626] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-22T17:48:02.903325] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-22T17:48:02.903391] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-22T17:48:03.036837] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:48:03.071509] [INFO ] [REMOTE ] CACI: Full fetch complete (38357 records). [2025-10-22T17:48:03.078048] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-22T17:48:03.325717] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-22T17:48:03.429927] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:03.648779] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-22T17:48:03.648863] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-22T17:48:03.649389] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-22T17:48:03.649428] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-22T17:48:03.650266] [DEBUG] [LOCAL ] CACI: Trimmed 38357 records to 22378 (keeping 200 days of data) [2025-10-22T17:48:03.790835] [DEBUG] [LOCAL ] CACI: Primary data saved (22378 records). [2025-10-22T17:48:03.790972] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-22T17:48:03.791100] [INFO ] [MAIN ] Update Progress: 385/2367 symbols completed. CACI took 22.4s. Estimated remaining: 4h 7m 2s. Rate: 8.0 symbols/min [2025-10-22T17:48:03.988418] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:04.008610] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:48:04.064101] [DEBUG] [LOCAL ] CAG: Loaded 53666 existing records from primary storage. [2025-10-22T17:48:04.064453] [INFO ] [MAIN ] CAG: Loaded 53666 existing records. [2025-10-22T17:48:04.123153] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-22T17:48:04.248212] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:04.248563] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-22T17:48:04.248622] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-22T17:48:04.249331] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-22T17:48:04.249390] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-22T17:48:04.606198] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:04.726524] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T17:48:04.912804] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T17:48:04.917615] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-22T17:48:05.717718] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-22T17:48:06.497117] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:48:06.497352] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T17:48:06.517599] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-22T17:48:07.317714] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-22T17:48:08.117671] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-22T17:48:08.370945] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T17:48:08.709478] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T17:48:08.710544] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:48:08.917700] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-22T17:48:09.717698] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-22T17:48:10.297275] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T17:48:10.517720] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-22T17:48:10.687393] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T17:48:11.128551] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T17:48:11.317696] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-22T17:48:12.117704] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-22T17:48:12.888037] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T17:48:12.917608] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-22T17:48:13.717732] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-22T17:48:13.785112] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:48:14.176492] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T17:48:14.517749] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-22T17:48:15.317759] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-22T17:48:15.962279] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T17:48:15.969052] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-22T17:48:16.103220] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:48:16.117684] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-22T17:48:16.920551] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-22T17:48:17.568307] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T17:48:17.717737] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-22T17:48:18.517717] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-22T17:48:18.801153] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T17:48:19.292052] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T17:48:19.317611] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-22T17:48:20.117679] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-22T17:48:20.302718] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T17:48:20.807593] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T17:48:20.917717] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-22T17:48:21.717755] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-22T17:48:21.788170] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T17:48:21.930573] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T17:48:22.111030] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-22T17:48:22.517718] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-22T17:48:22.988439] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T17:48:23.317704] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-22T17:48:23.998743] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T17:48:24.117716] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-22T17:48:24.687161] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T17:48:24.688559] [INFO ] [REMOTE ] CAF: Full fetch complete (5507 records). [2025-10-22T17:48:24.688671] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-22T17:48:24.689138] [FATAL] [VALIDATOR ] CAF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:48:24.689261] [FATAL] [MAIN ] CAF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:48:24.689306] [WARN ] [MAIN ] CAF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:48:24.689384] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-22T17:48:24.689448] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-10-22T17:48:24.689486] [INFO ] [LOCAL ] CAF: Starting deletion of derivative data. [2025-10-22T17:48:24.689609] [DEBUG] [LOCAL ] CAF: Deleted derivative data file. [2025-10-22T17:48:24.689729] [INFO ] [MAIN ] Update Progress: 386/2367 symbols completed. CAF took 22.5s. Estimated remaining: 4h 8m 3s. Rate: 8.0 symbols/min [2025-10-22T17:48:24.857273] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:24.905273] [DEBUG] [LOCAL ] CAH: Loaded 51443 existing records from primary storage. [2025-10-22T17:48:24.905557] [INFO ] [MAIN ] CAH: Loaded 51443 existing records. [2025-10-22T17:48:24.925399] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-22T17:48:25.088471] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:25.088754] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-22T17:48:25.088829] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-22T17:48:25.089158] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-22T17:48:25.089195] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-22T17:48:25.445534] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:25.717686] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-22T17:48:26.517724] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-22T17:48:26.935791] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T17:48:27.317714] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-22T17:48:27.749606] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T17:48:28.117704] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-22T17:48:28.262401] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T17:48:28.917678] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-22T17:48:29.093674] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T17:48:29.102133] [INFO ] [REMOTE ] CADE: Full fetch complete (70745 records). [2025-10-22T17:48:29.102251] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-22T17:48:29.484865] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-22T17:48:29.484960] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-22T17:48:29.485736] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-22T17:48:29.485797] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-22T17:48:29.487123] [DEBUG] [LOCAL ] CADE: Trimmed 70745 records to 49685 (keeping 200 days of data) [2025-10-22T17:48:29.718004] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-22T17:48:29.793577] [DEBUG] [LOCAL ] CADE: Primary data saved (49685 records). [2025-10-22T17:48:29.793734] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-22T17:48:29.793819] [INFO ] [MAIN ] Update Progress: 387/2367 symbols completed. CADE took 30.3s. Estimated remaining: 4h 7m 44s. Rate: 8.0 symbols/min [2025-10-22T17:48:29.931549] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:48:29.981411] [INFO ] [REMOTE ] CAE: Full fetch complete (56582 records). [2025-10-22T17:48:29.999556] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:29.998033] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-22T17:48:30.410460] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-22T17:48:30.410564] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-22T17:48:30.411267] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-22T17:48:30.413513] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-22T17:48:30.415025] [DEBUG] [LOCAL ] CAL: Loaded 42780 existing records from primary storage. [2025-10-22T17:48:30.415789] [INFO ] [MAIN ] CAL: Loaded 42780 existing records. [2025-10-22T17:48:30.473139] [DEBUG] [LOCAL ] CAE: Trimmed 56582 records to 39045 (keeping 200 days of data) [2025-10-22T17:48:30.577453] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T17:48:30.677028] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-22T17:48:30.722738] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:30.725692] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-22T17:48:30.727680] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-22T17:48:30.731348] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-22T17:48:30.732886] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-22T17:48:31.199597] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:31.216358] [DEBUG] [LOCAL ] CAE: Primary data saved (39045 records). [2025-10-22T17:48:31.216523] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-22T17:48:31.216602] [INFO ] [MAIN ] Update Progress: 388/2367 symbols completed. CAE took 29.4s. Estimated remaining: 4h 7m 5s. Rate: 8.0 symbols/min [2025-10-22T17:48:31.320850] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-22T17:48:31.410510] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:31.449926] [DEBUG] [LOCAL ] CALX: Loaded 37319 existing records from primary storage. [2025-10-22T17:48:31.450317] [INFO ] [MAIN ] CALX: Loaded 37319 existing records. [2025-10-22T17:48:31.669367] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:31.669675] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-22T17:48:31.669828] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-22T17:48:31.670173] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-22T17:48:31.670241] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-22T17:48:31.995514] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-22T17:48:32.086928] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:32.117683] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-22T17:48:32.564339] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T17:48:32.691866] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:48:32.917728] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-22T17:48:33.717720] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-22T17:48:33.762349] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T17:48:34.332162] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T17:48:34.517721] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-22T17:48:35.179579] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:48:35.317684] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-22T17:48:36.117715] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-22T17:48:36.289784] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:48:36.816570] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T17:48:36.917758] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-22T17:48:37.717703] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-22T17:48:37.986030] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T17:48:38.517701] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-22T17:48:39.167808] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-22T17:48:39.168929] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T17:48:39.317694] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-22T17:48:39.732694] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T17:48:40.117708] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-22T17:48:40.862523] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T17:48:40.917757] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-22T17:48:41.717704] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-22T17:48:41.827903] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T17:48:42.139281] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T17:48:42.517677] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-22T17:48:43.309911] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:48:43.318500] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-22T17:48:43.913353] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T17:48:44.117695] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-22T17:48:44.871809] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T17:48:44.917613] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-22T17:48:45.717723] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-22T17:48:45.800600] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:48:46.517715] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-22T17:48:46.881716] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T17:48:46.912077] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T17:48:47.317718] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-22T17:48:48.087522] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:48:48.117611] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-22T17:48:48.859497] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T17:48:48.917671] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-22T17:48:49.598782] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T17:48:49.717676] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-22T17:48:50.311887] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T17:48:50.517739] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-22T17:48:51.280164] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T17:48:51.317617] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-22T17:48:52.117727] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-22T17:48:52.358583] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T17:48:52.917760] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-22T17:48:52.947202] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:48:53.717691] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-22T17:48:53.903688] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T17:48:53.912334] [INFO ] [REMOTE ] CAG: Full fetch complete (77827 records). [2025-10-22T17:48:53.912461] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-22T17:48:54.294195] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-22T17:48:54.294296] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-22T17:48:54.295162] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-22T17:48:54.295241] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-22T17:48:54.296954] [DEBUG] [LOCAL ] CAG: Trimmed 77827 records to 53666 (keeping 200 days of data) [2025-10-22T17:48:54.526252] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-22T17:48:54.555566] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T17:48:54.672511] [DEBUG] [LOCAL ] CAG: Primary data saved (53666 records). [2025-10-22T17:48:54.672711] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-22T17:48:54.673355] [INFO ] [MAIN ] Update Progress: 389/2367 symbols completed. CAG took 50.9s. Estimated remaining: 4h 8m 19s. Rate: 8.0 symbols/min [2025-10-22T17:48:54.842612] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:54.867876] [DEBUG] [LOCAL ] CANG: Loaded 27080 existing records from primary storage. [2025-10-22T17:48:54.868138] [INFO ] [MAIN ] CANG: Loaded 27080 existing records. [2025-10-22T17:48:55.049050] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:55.049371] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-22T17:48:55.049602] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-22T17:48:55.056343] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-22T17:48:55.065279] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-22T17:48:55.152173] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T17:48:55.324943] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-22T17:48:55.442004] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:56.117707] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-22T17:48:56.199314] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T17:48:56.206306] [INFO ] [REMOTE ] CAL: Full fetch complete (61875 records). [2025-10-22T17:48:56.206427] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-22T17:48:56.595455] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-22T17:48:56.595533] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-22T17:48:56.596249] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-22T17:48:56.596311] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-22T17:48:56.597448] [DEBUG] [LOCAL ] CAL: Trimmed 61875 records to 42762 (keeping 200 days of data) [2025-10-22T17:48:56.850174] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T17:48:56.866463] [INFO ] [REMOTE ] CALX: Full fetch complete (54055 records). [2025-10-22T17:48:56.878103] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-22T17:48:56.882429] [DEBUG] [LOCAL ] CAL: Primary data saved (42762 records). [2025-10-22T17:48:56.882940] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-22T17:48:56.883064] [INFO ] [MAIN ] Update Progress: 390/2367 symbols completed. CAL took 27.1s. Estimated remaining: 4h 7m 44s. Rate: 8.0 symbols/min [2025-10-22T17:48:56.926188] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-22T17:48:57.211418] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:57.347260] [DEBUG] [LOCAL ] CAPL: Loaded 5485 existing records from primary storage. [2025-10-22T17:48:57.358703] [INFO ] [MAIN ] CAPL: Loaded 5485 existing records. [2025-10-22T17:48:57.628309] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-22T17:48:57.634748] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-22T17:48:57.664330] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-22T17:48:57.664528] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-22T17:48:57.676795] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:57.678016] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-22T17:48:57.678355] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-22T17:48:57.678889] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-22T17:48:57.679020] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-22T17:48:57.679172] [DEBUG] [LOCAL ] CALX: Trimmed 54055 records to 37238 (keeping 200 days of data) [2025-10-22T17:48:58.098169] [DEBUG] [LOCAL ] CALX: Primary data saved (37238 records). [2025-10-22T17:48:58.121353] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-22T17:48:58.127352] [INFO ] [MAIN ] Update Progress: 391/2367 symbols completed. CALX took 26.9s. Estimated remaining: 4h 7m 5s. Rate: 8.0 symbols/min [2025-10-22T17:48:58.121174] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T17:48:58.298947] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-22T17:48:58.540252] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:58.518572] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:58.540870] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-22T17:48:58.568606] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T17:48:58.624253] [DEBUG] [LOCAL ] CARR: Loaded 53603 existing records from primary storage. [2025-10-22T17:48:58.624632] [INFO ] [MAIN ] CARR: Loaded 53603 existing records. [2025-10-22T17:48:58.802017] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:58.802262] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-22T17:48:58.802311] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-22T17:48:58.802794] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-22T17:48:58.802862] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-22T17:48:59.146969] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:59.317688] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-22T17:48:59.398925] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-22T17:49:00.117700] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-22T17:49:00.315950] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T17:49:00.325091] [INFO ] [REMOTE ] CAH: Full fetch complete (74839 records). [2025-10-22T17:49:00.325226] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-22T17:49:00.667802] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T17:49:00.802495] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-22T17:49:00.802588] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-22T17:49:00.803431] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-22T17:49:00.803496] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-22T17:49:00.805060] [DEBUG] [LOCAL ] CAH: Trimmed 74839 records to 51420 (keeping 200 days of data) [2025-10-22T17:49:00.910690] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T17:49:00.926837] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-22T17:49:01.139181] [DEBUG] [LOCAL ] CAH: Primary data saved (51420 records). [2025-10-22T17:49:01.139381] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-22T17:49:01.139493] [INFO ] [MAIN ] Update Progress: 392/2367 symbols completed. CAH took 36.4s. Estimated remaining: 4h 6m 35s. Rate: 8.0 symbols/min [2025-10-22T17:49:01.304919] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:49:01.305135] [DEBUG] [LOCAL ] CARS: No existing data file found in primary storage. [2025-10-22T17:49:01.305194] [WARN ] [MAIN ] CARS: No existing data found, performing full refresh instead. [2025-10-22T17:49:01.305310] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-22T17:49:01.305352] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-22T17:49:01.305397] [DEBUG] [LOCAL ] CARS: No primary data file found to delete. [2025-10-22T17:49:01.305430] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-22T17:49:01.649089] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:49:01.717726] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-22T17:49:02.517673] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-22T17:49:02.966554] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T17:49:03.124936] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T17:49:03.183989] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T17:49:03.317681] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-22T17:49:04.117692] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-22T17:49:04.905741] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T17:49:04.917613] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-22T17:49:05.650757] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T17:49:05.717758] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-22T17:49:05.939495] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T17:49:06.517682] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-22T17:49:06.801300] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T17:49:07.317713] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-22T17:49:07.842212] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T17:49:08.117747] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-22T17:49:08.489813] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:49:08.742377] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T17:49:08.917724] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-22T17:49:09.717713] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-22T17:49:10.517693] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-22T17:49:10.774803] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T17:49:11.165160] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T17:49:11.196804] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T17:49:11.317768] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-22T17:49:12.117701] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-22T17:49:12.797703] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T17:49:12.917672] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-22T17:49:13.717679] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-22T17:49:14.074529] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T17:49:14.408842] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T17:49:14.517679] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-22T17:49:14.842166] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T17:49:15.317738] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-22T17:49:15.846110] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T17:49:16.117727] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-22T17:49:16.864556] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T17:49:16.917731] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-22T17:49:17.172955] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T17:49:17.717689] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-22T17:49:18.184947] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T17:49:18.334204] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T17:49:18.517765] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-22T17:49:19.060150] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-22T17:49:19.317694] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-22T17:49:20.117723] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-22T17:49:20.804099] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T17:49:20.917720] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-22T17:49:21.717835] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-22T17:49:21.749562] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T17:49:22.310008] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T17:49:22.519290] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-22T17:49:22.521732] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T17:49:22.523374] [INFO ] [REMOTE ] CAPL: Full fetch complete (8709 records). [2025-10-22T17:49:22.523482] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-22T17:49:22.877515] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-22T17:49:22.877618] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-22T17:49:22.877870] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-22T17:49:22.877914] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-22T17:49:22.878294] [DEBUG] [LOCAL ] CAPL: Trimmed 8709 records to 5383 (keeping 200 days of data) [2025-10-22T17:49:22.910479] [DEBUG] [LOCAL ] CAPL: Primary data saved (5383 records). [2025-10-22T17:49:22.910622] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-22T17:49:22.910739] [INFO ] [MAIN ] Update Progress: 393/2367 symbols completed. CAPL took 26.0s. Estimated remaining: 4h 7m 39s. Rate: 8.0 symbols/min [2025-10-22T17:49:23.077003] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:49:23.123893] [DEBUG] [LOCAL ] CAT: Loaded 52953 existing records from primary storage. [2025-10-22T17:49:23.124187] [INFO ] [MAIN ] CAT: Loaded 52953 existing records. [2025-10-22T17:49:23.303737] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:49:23.303960] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-22T17:49:23.304007] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-22T17:49:23.304325] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-22T17:49:23.304381] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-22T17:49:23.325481] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-22T17:49:23.660119] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:49:24.117733] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-22T17:49:24.578586] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T17:49:24.688594] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T17:49:24.917717] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-22T17:49:25.361274] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T17:49:25.717736] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-22T17:49:26.517700] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-22T17:49:27.098486] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T17:49:27.210158] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-22T17:49:27.317677] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-22T17:49:27.995239] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T17:49:28.117720] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-22T17:49:28.917640] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-22T17:49:29.294907] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-22T17:49:29.442811] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T17:49:29.449954] [INFO ] [REMOTE ] CARS: Full fetch complete (56564 records). [2025-10-22T17:49:29.450082] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-22T17:49:29.725310] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-22T17:49:29.823771] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-22T17:49:29.823842] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-22T17:49:29.824490] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-22T17:49:29.824529] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-22T17:49:29.825594] [DEBUG] [LOCAL ] CARS: Trimmed 56564 records to 39772 (keeping 200 days of data) [2025-10-22T17:49:30.047201] [DEBUG] [LOCAL ] CARS: Primary data saved (39772 records). [2025-10-22T17:49:30.047346] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-22T17:49:30.047433] [INFO ] [MAIN ] Update Progress: 394/2367 symbols completed. CARS took 28.9s. Estimated remaining: 4h 7m 30s. Rate: 8.0 symbols/min [2025-10-22T17:49:30.212904] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:49:30.221040] [DEBUG] [LOCAL ] CATO: Loaded 6616 existing records from primary storage. [2025-10-22T17:49:30.221192] [INFO ] [MAIN ] CATO: Loaded 6616 existing records. [2025-10-22T17:49:30.392960] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:49:30.393131] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-22T17:49:30.393176] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-22T17:49:30.393330] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-22T17:49:30.393384] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-22T17:49:30.529711] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-22T17:49:30.753457] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:49:30.792965] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T17:49:31.317734] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-22T17:49:31.568280] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T17:49:32.014624] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T17:49:32.019426] [INFO ] [REMOTE ] CANG: Full fetch complete (39519 records). [2025-10-22T17:49:32.019511] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-22T17:49:32.120256] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-22T17:49:32.246836] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T17:49:32.397415] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-22T17:49:32.397488] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-22T17:49:32.398046] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-22T17:49:32.398110] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-22T17:49:32.398946] [DEBUG] [LOCAL ] CANG: Trimmed 39519 records to 27031 (keeping 200 days of data) [2025-10-22T17:49:32.542231] [DEBUG] [LOCAL ] CANG: Primary data saved (27031 records). [2025-10-22T17:49:32.542338] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-22T17:49:32.542416] [INFO ] [MAIN ] Update Progress: 395/2367 symbols completed. CANG took 37.9s. Estimated remaining: 4h 6m 57s. Rate: 8.0 symbols/min [2025-10-22T17:49:32.729034] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:49:32.778961] [DEBUG] [LOCAL ] CAVA: Loaded 53551 existing records from primary storage. [2025-10-22T17:49:32.779288] [INFO ] [MAIN ] CAVA: Loaded 53551 existing records. [2025-10-22T17:49:32.925997] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-22T17:49:32.956747] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:49:32.957049] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-22T17:49:32.957096] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-22T17:49:32.957329] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-22T17:49:32.957371] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-22T17:49:33.301144] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:49:33.717741] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-22T17:49:34.206682] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-22T17:49:34.215531] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-22T17:49:34.215690] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-22T17:49:34.482727] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T17:49:34.522811] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-22T17:49:34.617529] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-22T17:49:34.617612] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-22T17:49:34.618580] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-22T17:49:34.618667] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-22T17:49:34.620105] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 53603 (keeping 200 days of data) [2025-10-22T17:49:34.947239] [DEBUG] [LOCAL ] CARR: Primary data saved (53603 records). [2025-10-22T17:49:34.947470] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-22T17:49:34.947585] [INFO ] [MAIN ] Update Progress: 396/2367 symbols completed. CARR took 36.8s. Estimated remaining: 4h 6m 24s. Rate: 8.0 symbols/min [2025-10-22T17:49:35.120349] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:49:35.162954] [DEBUG] [LOCAL ] CB: Loaded 49973 existing records from primary storage. [2025-10-22T17:49:35.163255] [INFO ] [MAIN ] CB: Loaded 49973 existing records. [2025-10-22T17:49:35.319478] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-22T17:49:35.341117] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:49:35.342406] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-22T17:49:35.342456] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-22T17:49:35.342633] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-22T17:49:35.342707] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-22T17:49:35.558338] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-22T17:49:35.739908] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:49:36.117721] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-22T17:49:36.175136] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T17:49:36.726183] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-22T17:49:36.917691] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-22T17:49:37.387163] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T17:49:37.717712] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-22T17:49:37.995468] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T17:49:38.517724] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-22T17:49:39.317711] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-22T17:49:39.533036] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:49:39.930679] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T17:49:40.117697] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-22T17:49:40.281462] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T17:49:40.917720] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-22T17:49:41.717683] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-22T17:49:41.789482] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:49:42.308755] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T17:49:42.517723] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-22T17:49:42.882277] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T17:49:43.155731] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T17:49:43.317729] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-22T17:49:44.117711] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-22T17:49:44.917737] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-22T17:49:45.435028] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-22T17:49:45.717710] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-22T17:49:46.034853] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T17:49:46.517716] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-22T17:49:46.815392] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T17:49:47.317723] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-22T17:49:47.910494] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T17:49:48.117740] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-22T17:49:48.702907] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T17:49:48.917693] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-22T17:49:49.033189] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:49:49.717677] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-22T17:49:50.271612] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-22T17:49:50.517727] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-22T17:49:51.072177] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T17:49:51.278357] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:49:51.294753] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T17:49:51.317609] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-22T17:49:52.117725] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-22T17:49:52.866219] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:49:52.903472] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T17:49:52.917609] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-22T17:49:53.597948] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T17:49:53.599483] [INFO ] [REMOTE ] CATO: Full fetch complete (10717 records). [2025-10-22T17:49:53.599556] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-22T17:49:53.722738] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-22T17:49:53.961620] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-22T17:49:53.961718] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-22T17:49:53.961971] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-22T17:49:53.962028] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-22T17:49:53.962458] [DEBUG] [LOCAL ] CATO: Trimmed 10717 records to 6647 (keeping 200 days of data) [2025-10-22T17:49:53.997581] [DEBUG] [LOCAL ] CATO: Primary data saved (6647 records). [2025-10-22T17:49:53.997691] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-22T17:49:53.998174] [INFO ] [MAIN ] Update Progress: 397/2367 symbols completed. CATO took 24.0s. Estimated remaining: 4h 7m 14s. Rate: 8.0 symbols/min [2025-10-22T17:49:54.517713] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-22T17:49:55.317757] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-22T17:49:55.757730] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T17:49:56.117707] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-22T17:49:56.872882] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-22T17:49:56.882259] [INFO ] [REMOTE ] CAT: Full fetch complete (76893 records). [2025-10-22T17:49:56.882399] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-22T17:49:57.292604] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-22T17:49:57.292784] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-22T17:49:57.294401] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-22T17:49:57.294514] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-22T17:49:57.296891] [DEBUG] [LOCAL ] CAT: Trimmed 76893 records to 52953 (keeping 200 days of data) [2025-10-22T17:49:57.421063] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-22T17:49:57.456315] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-22T17:49:57.686271] [DEBUG] [LOCAL ] CAT: Primary data saved (52953 records). [2025-10-22T17:49:57.686458] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-22T17:49:57.686684] [INFO ] [MAIN ] Update Progress: 398/2367 symbols completed. CAT took 34.8s. Estimated remaining: 4h 6m 47s. Rate: 8.0 symbols/min [2025-10-22T17:49:57.717177] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T17:49:57.727574] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-22T17:49:59.476002] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T17:49:59.491173] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-22T17:49:59.751461] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-22T17:49:59.762960] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-22T17:50:01.375894] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T17:50:01.389563] [INFO ] [REMOTE ] CB: Full fetch complete (72875 records). [2025-10-22T17:50:01.389802] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-22T17:50:01.877354] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-22T17:50:01.877550] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-22T17:50:01.878570] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-22T17:50:01.878714] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-22T17:50:01.880284] [DEBUG] [LOCAL ] CB: Trimmed 72875 records to 49964 (keeping 200 days of data) [2025-10-22T17:50:02.030516] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-22T17:50:02.048971] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-22T17:50:02.256589] [DEBUG] [LOCAL ] CB: Primary data saved (49964 records). [2025-10-22T17:50:02.256771] [INFO ] [MAIN ] CB: Full history saved. [2025-10-22T17:50:02.256866] [INFO ] [MAIN ] Update Progress: 399/2367 symbols completed. CB took 27.3s. Estimated remaining: 4h 6m 25s. Rate: 8.0 symbols/min [2025-10-22T17:50:04.453867] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-22T17:50:04.465239] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-22T17:50:07.092140] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-22T17:50:07.100812] [INFO ] [REMOTE ] CAVA: Full fetch complete (77457 records). [2025-10-22T17:50:07.100954] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-22T17:50:07.496562] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-22T17:50:07.496681] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-22T17:50:07.497553] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-22T17:50:07.497618] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-22T17:50:07.499234] [DEBUG] [LOCAL ] CAVA: Trimmed 77457 records to 53551 (keeping 200 days of data) [2025-10-22T17:50:07.820436] [DEBUG] [LOCAL ] CAVA: Primary data saved (53551 records). [2025-10-22T17:50:07.820573] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-22T17:50:07.821224] [INFO ] [MAIN ] Update Progress: 400/2367 symbols completed. CAVA took 35.3s. Estimated remaining: 4h 6m 8s. Rate: 8.0 symbols/min [2025-10-22T17:50:08.457755] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:08.494532] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:08.538335] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:08.554179] [DEBUG] [LOCAL ] CBL: No existing data file found in primary storage. [2025-10-22T17:50:08.557867] [WARN ] [MAIN ] CBL: No existing data found, performing full refresh instead. [2025-10-22T17:50:08.539792] [DEBUG] [LOCAL ] CBAN: No existing data file found in primary storage. [2025-10-22T17:50:08.559839] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-22T17:50:08.559613] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:08.560241] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-22T17:50:08.560155] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-22T17:50:08.560632] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-22T17:50:08.560331] [WARN ] [MAIN ] CBAN: No existing data found, performing full refresh instead. [2025-10-22T17:50:08.561386] [DEBUG] [LOCAL ] CBL: No primary data file found to delete. [2025-10-22T17:50:08.561201] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-22T17:50:08.561824] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-22T17:50:08.561752] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-22T17:50:08.562094] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-22T17:50:08.562005] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-22T17:50:08.562276] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-22T17:50:08.562182] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-22T17:50:08.650966] [DEBUG] [LOCAL ] CBNA: Loaded 2888 existing records from primary storage. [2025-10-22T17:50:08.628576] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-10-22T17:50:08.722765] [INFO ] [MAIN ] CBNA: Loaded 2888 existing records. [2025-10-22T17:50:08.722412] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-22T17:50:09.407569] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:09.602010] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-22T17:50:09.622255] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-22T17:50:09.702215] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-22T17:50:09.754191] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-22T17:50:09.998033] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:10.051499] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-22T17:50:10.115178] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:10.089604] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:10.115508] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-22T17:50:10.131601] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-22T17:50:10.368426] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:10.368737] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-22T17:50:10.468995] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:50:10.469305] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-22T17:50:10.469415] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:50:10.469465] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-22T17:50:10.469502] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:50:10.469551] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-22T17:50:10.469622] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-22T17:50:10.469755] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-22T17:50:10.469837] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-22T17:50:10.469903] [INFO ] [MAIN ] Update Progress: 401/2367 symbols completed. CBO took 2.6s. Estimated remaining: 4h 5m 37s. Rate: 8.0 symbols/min [2025-10-22T17:50:10.643129] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:10.693138] [DEBUG] [LOCAL ] CBRE: Loaded 50283 existing records from primary storage. [2025-10-22T17:50:10.693453] [INFO ] [MAIN ] CBRE: Loaded 50283 existing records. [2025-10-22T17:50:10.875600] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:10.875856] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-22T17:50:10.875913] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-22T17:50:10.876124] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-22T17:50:10.876195] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-22T17:50:11.240038] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:11.244143] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-22T17:50:11.245481] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T17:50:11.247158] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-22T17:50:11.255514] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T17:50:11.258879] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-22T17:50:11.402773] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T17:50:11.407084] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-22T17:50:11.728205] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T17:50:11.730098] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-22T17:50:11.903952] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T17:50:11.907459] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-22T17:50:12.235165] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T17:50:12.236346] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-22T17:50:12.302716] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:50:12.306815] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-22T17:50:12.549254] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T17:50:12.552839] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-22T17:50:12.559753] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-22T17:50:12.561007] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-22T17:50:12.896188] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T17:50:12.917611] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-22T17:50:13.213860] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T17:50:13.326614] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T17:50:13.438426] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:50:13.717692] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-22T17:50:14.303948] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:50:14.517720] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-22T17:50:14.765848] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T17:50:15.317755] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-22T17:50:16.117690] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-22T17:50:16.135923] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T17:50:16.447259] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T17:50:16.734392] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T17:50:16.917712] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-22T17:50:17.717735] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-22T17:50:18.081406] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-22T17:50:18.517737] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-22T17:50:18.700131] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T17:50:19.317719] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-22T17:50:19.339494] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T17:50:20.117696] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-22T17:50:20.917674] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-22T17:50:21.029979] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T17:50:21.121437] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T17:50:21.717721] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-22T17:50:22.012059] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T17:50:22.517722] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-22T17:50:23.317678] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-22T17:50:23.395111] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:50:23.415131] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T17:50:24.117678] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-22T17:50:24.302082] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T17:50:24.917693] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-22T17:50:24.963151] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:50:25.498840] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T17:50:25.717681] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-22T17:50:26.171371] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-22T17:50:26.517740] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-22T17:50:27.317704] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-22T17:50:27.494594] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T17:50:27.983045] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T17:50:28.117707] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-22T17:50:28.917724] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-22T17:50:29.717728] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-22T17:50:29.800915] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T17:50:30.000495] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:50:30.002435] [INFO ] [REMOTE ] CBAN: Full fetch complete (16225 records). [2025-10-22T17:50:30.002547] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-22T17:50:30.390332] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-22T17:50:30.390434] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-22T17:50:30.390856] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-22T17:50:30.390917] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-22T17:50:30.391551] [DEBUG] [LOCAL ] CBAN: Trimmed 16225 records to 10154 (keeping 200 days of data) [2025-10-22T17:50:30.454019] [DEBUG] [LOCAL ] CBAN: Primary data saved (10154 records). [2025-10-22T17:50:30.454149] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-22T17:50:30.454222] [INFO ] [MAIN ] Update Progress: 402/2367 symbols completed. CBAN took 22.6s. Estimated remaining: 4h 6m 30s. Rate: 8.0 symbols/min [2025-10-22T17:50:30.522862] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-22T17:50:30.631422] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:30.660209] [DEBUG] [LOCAL ] CBT: Loaded 31053 existing records from primary storage. [2025-10-22T17:50:30.660483] [INFO ] [MAIN ] CBT: Loaded 31053 existing records. [2025-10-22T17:50:30.769796] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:50:30.857316] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:30.857561] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-22T17:50:30.857613] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-22T17:50:30.857869] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-22T17:50:30.857925] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-22T17:50:31.220152] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:31.317741] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-22T17:50:31.775969] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-22T17:50:31.776857] [INFO ] [REMOTE ] CBNA: Full fetch complete (4312 records). [2025-10-22T17:50:31.776926] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-22T17:50:32.127028] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-22T17:50:32.134252] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-22T17:50:32.134328] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-22T17:50:32.135195] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-22T17:50:32.135253] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-22T17:50:32.135595] [DEBUG] [LOCAL ] CBNA: Trimmed 4312 records to 2864 (keeping 200 days of data) [2025-10-22T17:50:32.153224] [DEBUG] [LOCAL ] CBNA: Primary data saved (2864 records). [2025-10-22T17:50:32.153317] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-22T17:50:32.153391] [INFO ] [MAIN ] Update Progress: 403/2367 symbols completed. CBNA took 24.3s. Estimated remaining: 4h 5m 54s. Rate: 8.0 symbols/min [2025-10-22T17:50:32.323134] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:32.378425] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T17:50:32.403532] [DEBUG] [LOCAL ] CBU: Loaded 22773 existing records from primary storage. [2025-10-22T17:50:32.403799] [INFO ] [MAIN ] CBU: Loaded 22773 existing records. [2025-10-22T17:50:32.581568] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:32.581863] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-22T17:50:32.581950] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-22T17:50:32.582179] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-22T17:50:32.582233] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-22T17:50:32.923374] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-22T17:50:32.928825] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:33.564975] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T17:50:33.677101] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T17:50:33.679959] [INFO ] [REMOTE ] CBL: Full fetch complete (24793 records). [2025-10-22T17:50:33.680029] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-22T17:50:33.722877] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-22T17:50:34.046349] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-22T17:50:34.046470] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-22T17:50:34.046939] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-22T17:50:34.047002] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-22T17:50:34.047822] [DEBUG] [LOCAL ] CBL: Trimmed 24793 records to 16048 (keeping 200 days of data) [2025-10-22T17:50:34.144142] [DEBUG] [LOCAL ] CBL: Primary data saved (16048 records). [2025-10-22T17:50:34.144285] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-22T17:50:34.144356] [INFO ] [MAIN ] Update Progress: 404/2367 symbols completed. CBL took 26.3s. Estimated remaining: 4h 5m 20s. Rate: 8.0 symbols/min [2025-10-22T17:50:34.314230] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:34.314423] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-22T17:50:34.314462] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-22T17:50:34.314575] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-22T17:50:34.314617] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-22T17:50:34.314696] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-22T17:50:34.314746] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-22T17:50:34.522915] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-22T17:50:34.677423] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:35.317681] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-22T17:50:35.576982] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T17:50:35.945982] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:50:36.117702] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-22T17:50:36.484843] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:50:36.917720] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-22T17:50:37.368808] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T17:50:37.717681] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-22T17:50:38.034619] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T17:50:38.517706] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-22T17:50:38.926539] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T17:50:39.317706] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-22T17:50:40.117672] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-22T17:50:40.212720] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T17:50:40.221120] [INFO ] [REMOTE ] CBRE: Full fetch complete (73767 records). [2025-10-22T17:50:40.221273] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-22T17:50:40.617185] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T17:50:40.643771] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-22T17:50:40.643856] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-22T17:50:40.644973] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-22T17:50:40.645037] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-22T17:50:40.646304] [DEBUG] [LOCAL ] CBRE: Trimmed 73767 records to 50278 (keeping 200 days of data) [2025-10-22T17:50:40.922751] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-22T17:50:40.941406] [DEBUG] [LOCAL ] CBRE: Primary data saved (50278 records). [2025-10-22T17:50:40.941612] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-22T17:50:40.942286] [INFO ] [MAIN ] Update Progress: 405/2367 symbols completed. CBRE took 30.5s. Estimated remaining: 4h 5m 9s. Rate: 8.0 symbols/min [2025-10-22T17:50:41.108327] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:41.130491] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:50:41.139699] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-22T17:50:41.140690] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:50:41.140806] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-22T17:50:41.141348] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:50:41.141305] [DEBUG] [LOCAL ] CBZ: Loaded 34322 existing records from primary storage. [2025-10-22T17:50:41.141472] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-22T17:50:41.141703] [INFO ] [MAIN ] CBZ: Loaded 34322 existing records. [2025-10-22T17:50:41.141806] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-22T17:50:41.172925] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-22T17:50:41.209797] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-22T17:50:41.232032] [INFO ] [MAIN ] Update Progress: 406/2367 symbols completed. CBX took 7.1s. Estimated remaining: 4h 4m 27s. Rate: 8.0 symbols/min [2025-10-22T17:50:41.440556] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:41.464923] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-22T17:50:41.479611] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-22T17:50:41.500499] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:41.500603] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-22T17:50:41.501330] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-22T17:50:41.723256] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-22T17:50:41.815046] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T17:50:41.907518] [DEBUG] [LOCAL ] CC: Loaded 53021 existing records from primary storage. [2025-10-22T17:50:41.933766] [INFO ] [MAIN ] CC: Loaded 53021 existing records. [2025-10-22T17:50:41.976194] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:42.120755] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:42.121036] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-22T17:50:42.121090] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-22T17:50:42.121262] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-22T17:50:42.121299] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-22T17:50:42.469272] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:42.517693] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-22T17:50:42.986104] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T17:50:43.317676] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-22T17:50:44.117689] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-22T17:50:44.206190] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T17:50:44.373598] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T17:50:44.753943] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T17:50:44.917701] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-22T17:50:45.717726] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-22T17:50:46.023137] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T17:50:46.517733] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-22T17:50:47.317700] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-22T17:50:47.405458] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T17:50:47.641403] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T17:50:48.117703] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-22T17:50:48.191808] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:50:48.917685] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-22T17:50:49.239830] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T17:50:49.717710] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-22T17:50:50.522909] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-22T17:50:50.545434] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:50:50.796731] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T17:50:51.317747] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-22T17:50:51.394719] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T17:50:52.117687] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-22T17:50:52.917686] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-22T17:50:53.078744] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T17:50:53.144150] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:50:53.717764] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-22T17:50:54.069495] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T17:50:54.516372] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T17:50:54.523568] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-22T17:50:54.525858] [INFO ] [REMOTE ] CBU: Full fetch complete (32722 records). [2025-10-22T17:50:54.526028] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-22T17:50:54.920495] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-22T17:50:54.920598] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-22T17:50:54.921215] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-22T17:50:54.921276] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-22T17:50:54.922250] [DEBUG] [LOCAL ] CBU: Trimmed 32722 records to 22633 (keeping 200 days of data) [2025-10-22T17:50:55.061938] [DEBUG] [LOCAL ] CBU: Primary data saved (22633 records). [2025-10-22T17:50:55.062075] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-22T17:50:55.062153] [INFO ] [MAIN ] Update Progress: 407/2367 symbols completed. CBU took 22.9s. Estimated remaining: 4h 4m 50s. Rate: 8.0 symbols/min [2025-10-22T17:50:55.235048] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:55.284626] [DEBUG] [LOCAL ] CCI: Loaded 53111 existing records from primary storage. [2025-10-22T17:50:55.284977] [INFO ] [MAIN ] CCI: Loaded 53111 existing records. [2025-10-22T17:50:55.322866] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-22T17:50:55.486036] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:55.486262] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-22T17:50:55.486310] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-22T17:50:55.486497] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-22T17:50:55.486536] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-22T17:50:55.851583] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:56.117690] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-22T17:50:56.332284] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T17:50:56.917680] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-22T17:50:56.997143] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T17:50:57.533669] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T17:50:57.717701] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-22T17:50:58.053740] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:50:58.517710] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-22T17:50:59.076107] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T17:50:59.317699] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-22T17:51:00.099282] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T17:51:00.117682] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-22T17:51:00.327585] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T17:51:00.917712] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-22T17:51:01.556547] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T17:51:01.717779] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-22T17:51:02.517720] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-22T17:51:03.016129] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T17:51:03.048965] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T17:51:03.317727] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-22T17:51:03.933376] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T17:51:04.117698] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-22T17:51:04.759684] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T17:51:04.917759] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-22T17:51:05.603632] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T17:51:05.717700] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-22T17:51:06.493218] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T17:51:06.519686] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-22T17:51:06.866797] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T17:51:06.872169] [INFO ] [REMOTE ] CBT: Full fetch complete (45785 records). [2025-10-22T17:51:06.872278] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-22T17:51:07.251009] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-22T17:51:07.251087] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-22T17:51:07.251682] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-22T17:51:07.251743] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-22T17:51:07.252733] [DEBUG] [LOCAL ] CBT: Trimmed 45785 records to 30925 (keeping 200 days of data) [2025-10-22T17:51:07.341316] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-22T17:51:07.455518] [DEBUG] [LOCAL ] CBT: Primary data saved (30925 records). [2025-10-22T17:51:07.455618] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-22T17:51:07.455725] [INFO ] [MAIN ] Update Progress: 408/2367 symbols completed. CBT took 37.0s. Estimated remaining: 4h 5m 6s. Rate: 8.0 symbols/min [2025-10-22T17:51:07.623398] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:07.623768] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-22T17:51:07.623814] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-22T17:51:07.623921] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-22T17:51:07.623961] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-22T17:51:07.624002] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-22T17:51:07.624033] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-22T17:51:07.976175] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:08.034386] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T17:51:08.117705] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-22T17:51:08.917677] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-22T17:51:09.255986] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T17:51:09.717722] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-22T17:51:09.846677] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:51:10.076379] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T17:51:10.082558] [INFO ] [REMOTE ] CBZ: Full fetch complete (46368 records). [2025-10-22T17:51:10.082716] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-22T17:51:10.479688] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-22T17:51:10.479802] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-22T17:51:10.480545] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-22T17:51:10.480614] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-22T17:51:10.481966] [DEBUG] [LOCAL ] CBZ: Trimmed 46368 records to 34267 (keeping 200 days of data) [2025-10-22T17:51:10.536109] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-22T17:51:10.697176] [DEBUG] [LOCAL ] CBZ: Primary data saved (34267 records). [2025-10-22T17:51:10.697341] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-22T17:51:10.697445] [INFO ] [MAIN ] Update Progress: 409/2367 symbols completed. CBZ took 29.8s. Estimated remaining: 4h 4m 38s. Rate: 8.0 symbols/min [2025-10-22T17:51:10.890319] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:10.905329] [DEBUG] [LOCAL ] CCIF: Loaded 15216 existing records from primary storage. [2025-10-22T17:51:10.905563] [INFO ] [MAIN ] CCIF: Loaded 15216 existing records. [2025-10-22T17:51:11.093903] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:11.094122] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-22T17:51:11.094171] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-22T17:51:11.094378] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-22T17:51:11.094416] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-22T17:51:11.322793] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-22T17:51:11.506727] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:11.546635] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T17:51:11.888753] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T17:51:12.008700] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T17:51:12.117709] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-22T17:51:12.917709] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-22T17:51:13.717696] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-22T17:51:14.085851] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-22T17:51:14.137915] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T17:51:14.196718] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T17:51:14.205324] [INFO ] [REMOTE ] CC: Full fetch complete (76204 records). [2025-10-22T17:51:14.205449] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-22T17:51:14.522950] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-22T17:51:14.599595] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-22T17:51:14.599700] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-22T17:51:14.600515] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-22T17:51:14.600559] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-22T17:51:14.601983] [DEBUG] [LOCAL ] CC: Trimmed 76204 records to 53015 (keeping 200 days of data) [2025-10-22T17:51:14.919619] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T17:51:14.926953] [DEBUG] [LOCAL ] CC: Primary data saved (53015 records). [2025-10-22T17:51:14.927045] [INFO ] [MAIN ] CC: Full history saved. [2025-10-22T17:51:14.927114] [INFO ] [MAIN ] Update Progress: 410/2367 symbols completed. CC took 33.7s. Estimated remaining: 4h 4m 15s. Rate: 8.0 symbols/min [2025-10-22T17:51:15.100317] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:15.148111] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-22T17:51:15.148454] [INFO ] [MAIN ] CCJ: Loaded 53690 existing records. [2025-10-22T17:51:15.325803] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:15.322148] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-22T17:51:15.326122] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-22T17:51:15.327088] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-22T17:51:15.327315] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-22T17:51:15.327370] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-22T17:51:15.675252] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:16.117706] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-22T17:51:16.226395] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:51:16.528387] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-22T17:51:16.917732] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-22T17:51:17.717727] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-22T17:51:18.178189] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T17:51:18.517718] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-22T17:51:18.815914] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-22T17:51:18.942815] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T17:51:19.317702] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-22T17:51:19.673051] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-22T17:51:20.117688] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-22T17:51:20.917728] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-22T17:51:21.717719] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-22T17:51:21.919250] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T17:51:21.922083] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T17:51:22.112720] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-22T17:51:22.517674] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-22T17:51:22.963322] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-22T17:51:23.317702] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-22T17:51:24.117741] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-22T17:51:24.544138] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-22T17:51:24.917732] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-22T17:51:25.487455] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T17:51:25.488453] [INFO ] [REMOTE ] CCIA: Full fetch complete (2184 records). [2025-10-22T17:51:25.488522] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-22T17:51:25.675084] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T17:51:25.675306] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:51:25.675387] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:51:25.675469] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-22T17:51:25.675546] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-22T17:51:25.675596] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-22T17:51:25.675682] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-22T17:51:25.675775] [INFO ] [MAIN ] Update Progress: 411/2367 symbols completed. CCIA took 18.2s. Estimated remaining: 4h 4m 23s. Rate: 8.0 symbols/min [2025-10-22T17:51:25.718025] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-22T17:51:25.857748] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:25.901459] [DEBUG] [LOCAL ] CCK: Loaded 46497 existing records from primary storage. [2025-10-22T17:51:25.901839] [INFO ] [MAIN ] CCK: Loaded 46497 existing records. [2025-10-22T17:51:26.079181] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:26.079466] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-22T17:51:26.079532] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-22T17:51:26.079934] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-22T17:51:26.080008] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-22T17:51:26.308131] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-22T17:51:26.503969] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:26.517609] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-22T17:51:26.790946] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:51:27.317707] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-22T17:51:28.117672] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-22T17:51:28.219752] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T17:51:28.917691] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-22T17:51:29.029804] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T17:51:29.160873] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T17:51:29.717735] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-22T17:51:30.517680] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-22T17:51:30.757379] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T17:51:30.819046] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T17:51:31.317695] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-22T17:51:32.117736] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-22T17:51:32.656637] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T17:51:32.776990] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T17:51:32.917692] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-22T17:51:32.966537] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:51:33.717683] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-22T17:51:33.869088] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T17:51:34.517729] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-22T17:51:35.317815] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-22T17:51:35.442500] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T17:51:35.931966] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T17:51:36.117698] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-22T17:51:36.917785] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-22T17:51:37.551227] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-22T17:51:37.622411] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T17:51:37.717721] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-22T17:51:38.517690] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-22T17:51:38.576986] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:51:39.317726] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-22T17:51:39.642109] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T17:51:39.644742] [INFO ] [REMOTE ] CCIF: Full fetch complete (21887 records). [2025-10-22T17:51:39.644819] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-22T17:51:40.044662] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-22T17:51:40.104716] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-22T17:51:40.104806] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-22T17:51:40.105270] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-22T17:51:40.105689] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-22T17:51:40.106323] [DEBUG] [LOCAL ] CCIF: Trimmed 21887 records to 15143 (keeping 200 days of data) [2025-10-22T17:51:40.142893] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-22T17:51:40.200336] [DEBUG] [LOCAL ] CCIF: Primary data saved (15143 records). [2025-10-22T17:51:40.200509] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-22T17:51:40.200597] [INFO ] [MAIN ] Update Progress: 412/2367 symbols completed. CCIF took 29.5s. Estimated remaining: 4h 4m 49s. Rate: 8.0 symbols/min [2025-10-22T17:51:40.383450] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:40.383635] [DEBUG] [LOCAL ] CCL: No existing data file found in primary storage. [2025-10-22T17:51:40.383722] [WARN ] [MAIN ] CCL: No existing data found, performing full refresh instead. [2025-10-22T17:51:40.383855] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-22T17:51:40.383899] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-22T17:51:40.383943] [DEBUG] [LOCAL ] CCL: No primary data file found to delete. [2025-10-22T17:51:40.383978] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-22T17:51:40.789821] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:40.908923] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:51:40.918222] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-22T17:51:41.717932] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-22T17:51:42.341322] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-22T17:51:42.517663] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-22T17:51:42.997931] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T17:51:43.006794] [INFO ] [REMOTE ] CCI: Full fetch complete (77100 records). [2025-10-22T17:51:43.006959] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-22T17:51:43.318960] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-22T17:51:43.416601] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-22T17:51:43.416718] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-22T17:51:43.417715] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-22T17:51:43.417834] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-22T17:51:43.441739] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T17:51:43.450345] [DEBUG] [LOCAL ] CCI: Trimmed 77100 records to 53109 (keeping 200 days of data) [2025-10-22T17:51:43.792708] [DEBUG] [LOCAL ] CCI: Primary data saved (53109 records). [2025-10-22T17:51:43.792854] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-22T17:51:43.792960] [INFO ] [MAIN ] Update Progress: 413/2367 symbols completed. CCI took 48.7s. Estimated remaining: 4h 4m 23s. Rate: 8.0 symbols/min [2025-10-22T17:51:44.001320] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:44.044207] [DEBUG] [LOCAL ] CCO: Loaded 48523 existing records from primary storage. [2025-10-22T17:51:44.044520] [INFO ] [MAIN ] CCO: Loaded 48523 existing records. [2025-10-22T17:51:44.122723] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-22T17:51:44.244434] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:44.244661] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-22T17:51:44.244722] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-22T17:51:44.244900] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-22T17:51:44.244938] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-22T17:51:44.594979] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:44.858276] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-22T17:51:44.917713] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-22T17:51:45.676961] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-22T17:51:45.717677] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-22T17:51:45.829195] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T17:51:46.517706] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-22T17:51:47.273578] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:51:47.317673] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-22T17:51:47.369427] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-22T17:51:47.378242] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-22T17:51:47.378415] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-22T17:51:47.772929] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-22T17:51:47.773015] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-22T17:51:47.774024] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-22T17:51:47.774091] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-22T17:51:47.775545] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 53690 (keeping 200 days of data) [2025-10-22T17:51:48.093380] [DEBUG] [LOCAL ] CCJ: Primary data saved (53690 records). [2025-10-22T17:51:48.093692] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-22T17:51:48.093818] [INFO ] [MAIN ] Update Progress: 414/2367 symbols completed. CCJ took 33.2s. Estimated remaining: 4h 4m 0s. Rate: 8.0 symbols/min [2025-10-22T17:51:48.127365] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-22T17:51:48.307024] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:48.309785] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T17:51:48.329343] [DEBUG] [LOCAL ] CCRD: Loaded 9582 existing records from primary storage. [2025-10-22T17:51:48.329631] [INFO ] [MAIN ] CCRD: Loaded 9582 existing records. [2025-10-22T17:51:48.512767] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:48.513083] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-22T17:51:48.513150] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-22T17:51:48.513372] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-22T17:51:48.513418] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-22T17:51:48.892214] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:48.917676] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-22T17:51:49.424743] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-22T17:51:49.592551] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T17:51:49.592740] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-22T17:51:49.717674] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-22T17:51:50.517716] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-22T17:51:51.175257] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T17:51:51.317732] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-22T17:51:52.117700] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-22T17:51:52.916308] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T17:51:52.925446] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-22T17:51:53.286076] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T17:51:53.298574] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-22T17:51:53.514208] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T17:51:53.717715] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-22T17:51:54.517757] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-22T17:51:55.317674] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-22T17:51:55.372067] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T17:51:55.894715] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-22T17:51:56.117713] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-22T17:51:56.917722] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-22T17:51:56.969531] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-22T17:51:57.717698] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-22T17:51:57.763936] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-22T17:51:57.771786] [INFO ] [REMOTE ] CCK: Full fetch complete (68149 records). [2025-10-22T17:51:57.771900] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-22T17:51:58.162241] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-22T17:51:58.162385] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-22T17:51:58.163199] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-22T17:51:58.163264] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-22T17:51:58.165597] [DEBUG] [LOCAL ] CCK: Trimmed 68149 records to 46505 (keeping 200 days of data) [2025-10-22T17:51:58.415780] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:51:58.496083] [DEBUG] [LOCAL ] CCK: Primary data saved (46505 records). [2025-10-22T17:51:58.496256] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-22T17:51:58.496356] [INFO ] [MAIN ] Update Progress: 415/2367 symbols completed. CCK took 32.8s. Estimated remaining: 4h 4m 6s. Rate: 8.0 symbols/min [2025-10-22T17:51:58.527687] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-22T17:51:58.675587] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:58.705087] [DEBUG] [LOCAL ] CCS: Loaded 30011 existing records from primary storage. [2025-10-22T17:51:58.705362] [INFO ] [MAIN ] CCS: Loaded 30011 existing records. [2025-10-22T17:51:58.897677] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:58.897957] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-22T17:51:58.898006] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-22T17:51:58.898414] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-22T17:51:58.898474] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-22T17:51:59.243394] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T17:51:59.271490] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:59.317616] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-22T17:52:00.047249] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T17:52:00.121089] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-22T17:52:00.117749] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-22T17:52:00.917741] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-22T17:52:01.717741] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-22T17:52:01.755594] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:52:02.517698] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-22T17:52:02.577115] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T17:52:03.317698] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-22T17:52:04.089480] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-22T17:52:04.117667] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-22T17:52:04.202003] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T17:52:04.247372] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T17:52:04.917713] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-22T17:52:05.717697] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-22T17:52:06.460922] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-22T17:52:06.517702] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-22T17:52:06.747328] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T17:52:06.808102] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T17:52:07.317704] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-22T17:52:08.117693] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-22T17:52:08.180321] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T17:52:08.657215] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-22T17:52:08.917711] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-22T17:52:09.685158] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T17:52:09.693034] [INFO ] [REMOTE ] CCO: Full fetch complete (67295 records). [2025-10-22T17:52:09.693147] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-22T17:52:09.724036] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-22T17:52:10.073030] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-22T17:52:10.073104] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-22T17:52:10.073841] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-22T17:52:10.073903] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-22T17:52:10.075098] [DEBUG] [LOCAL ] CCO: Trimmed 67295 records to 48537 (keeping 200 days of data) [2025-10-22T17:52:10.333442] [DEBUG] [LOCAL ] CCO: Primary data saved (48537 records). [2025-10-22T17:52:10.333594] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-22T17:52:10.333693] [INFO ] [MAIN ] Update Progress: 416/2367 symbols completed. CCO took 26.5s. Estimated remaining: 4h 4m 19s. Rate: 8.0 symbols/min [2025-10-22T17:52:10.498399] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:10.519013] [DEBUG] [LOCAL ] CCU: Loaded 21804 existing records from primary storage. [2025-10-22T17:52:10.518619] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-22T17:52:10.519986] [INFO ] [MAIN ] CCU: Loaded 21804 existing records. [2025-10-22T17:52:10.693742] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:10.693929] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-22T17:52:10.693975] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-22T17:52:10.694160] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-22T17:52:10.694214] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-22T17:52:11.059914] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:11.200315] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T17:52:11.323096] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-22T17:52:11.341528] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-22T17:52:11.491991] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T17:52:12.117745] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-22T17:52:12.922841] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-22T17:52:12.932777] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T17:52:13.172963] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T17:52:13.174831] [INFO ] [REMOTE ] CCRD: Full fetch complete (11782 records). [2025-10-22T17:52:13.174900] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-22T17:52:13.522963] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-22T17:52:13.523063] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-22T17:52:13.523347] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-22T17:52:13.523399] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-22T17:52:13.523898] [DEBUG] [LOCAL ] CCRD: Trimmed 11782 records to 9562 (keeping 200 days of data) [2025-10-22T17:52:13.577090] [DEBUG] [LOCAL ] CCRD: Primary data saved (9562 records). [2025-10-22T17:52:13.577193] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-22T17:52:13.577270] [INFO ] [MAIN ] Update Progress: 417/2367 symbols completed. CCRD took 25.5s. Estimated remaining: 4h 3m 52s. Rate: 8.0 symbols/min [2025-10-22T17:52:13.725717] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-22T17:52:13.743220] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:13.743619] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-22T17:52:13.744914] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-22T17:52:13.745075] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-22T17:52:13.745122] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-22T17:52:13.745167] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-22T17:52:13.745200] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-22T17:52:14.093751] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:14.517699] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-22T17:52:14.880623] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-22T17:52:15.125911] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:52:15.225475] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-22T17:52:15.234563] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-22T17:52:15.234760] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-22T17:52:15.322895] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-22T17:52:15.623009] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-22T17:52:15.623118] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-22T17:52:15.623996] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-22T17:52:15.624060] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-22T17:52:15.625513] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-22T17:52:15.943414] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-22T17:52:15.943543] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-22T17:52:15.943611] [INFO ] [MAIN ] Update Progress: 418/2367 symbols completed. CCL took 35.7s. Estimated remaining: 4h 3m 20s. Rate: 8.0 symbols/min [2025-10-22T17:52:16.108028] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:16.117721] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-22T17:52:16.157986] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-22T17:52:16.158303] [INFO ] [MAIN ] CDE: Loaded 53644 existing records. [2025-10-22T17:52:16.336159] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:16.336461] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-22T17:52:16.336512] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-22T17:52:16.336786] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-22T17:52:16.336843] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-22T17:52:16.497499] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:52:16.704272] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:16.917673] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-22T17:52:17.133892] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-22T17:52:17.337404] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T17:52:17.717739] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-22T17:52:17.941455] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-22T17:52:18.517692] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-22T17:52:19.317709] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-22T17:52:19.628566] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-22T17:52:19.835183] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T17:52:20.117710] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-22T17:52:20.917687] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-22T17:52:21.384109] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T17:52:21.717925] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-22T17:52:21.894326] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T17:52:22.517725] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-22T17:52:23.317707] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-22T17:52:23.543968] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T17:52:23.821410] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T17:52:24.117713] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-22T17:52:24.283214] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T17:52:24.422749] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-22T17:52:24.917702] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-22T17:52:25.717709] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-22T17:52:26.229127] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T17:52:26.517688] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-22T17:52:27.317743] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-22T17:52:27.676279] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-22T17:52:27.687002] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:52:27.687547] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-22T17:52:27.687696] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:52:27.687788] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-22T17:52:27.687855] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:52:27.687925] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-22T17:52:27.687987] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-22T17:52:27.688023] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-22T17:52:27.688062] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-22T17:52:27.688105] [INFO ] [MAIN ] Update Progress: 419/2367 symbols completed. CCZ took 14.1s. Estimated remaining: 4h 3m 33s. Rate: 8.0 symbols/min [2025-10-22T17:52:27.857220] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:27.870867] [DEBUG] [LOCAL ] CDLR: Loaded 10233 existing records from primary storage. [2025-10-22T17:52:27.871121] [INFO ] [MAIN ] CDLR: Loaded 10233 existing records. [2025-10-22T17:52:27.996545] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T17:52:28.091296] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:28.091534] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-22T17:52:28.091612] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-22T17:52:28.091844] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-22T17:52:28.091891] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-22T17:52:28.122763] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-22T17:52:28.449867] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:28.917715] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-22T17:52:29.608248] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-22T17:52:29.717716] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-22T17:52:30.099057] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T17:52:30.360704] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T17:52:30.517719] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-22T17:52:31.317714] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-22T17:52:31.746457] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:52:32.117681] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-22T17:52:32.199426] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:52:32.917687] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-22T17:52:32.958172] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T17:52:33.655890] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-22T17:52:33.717672] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-22T17:52:34.503913] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T17:52:34.517614] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-22T17:52:35.318531] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-22T17:52:35.319417] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T17:52:36.117689] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-22T17:52:36.415922] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T17:52:36.917780] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-22T17:52:37.717704] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-22T17:52:38.119998] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T17:52:38.405237] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T17:52:38.409749] [INFO ] [REMOTE ] CCS: Full fetch complete (44700 records). [2025-10-22T17:52:38.409833] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-22T17:52:38.519580] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-22T17:52:38.576496] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T17:52:38.816781] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-22T17:52:38.816894] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-22T17:52:38.817521] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-22T17:52:38.817563] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-22T17:52:38.818788] [DEBUG] [LOCAL ] CCS: Trimmed 44700 records to 29903 (keeping 200 days of data) [2025-10-22T17:52:39.003407] [DEBUG] [LOCAL ] CCS: Primary data saved (29903 records). [2025-10-22T17:52:39.003552] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-22T17:52:39.003632] [INFO ] [MAIN ] Update Progress: 420/2367 symbols completed. CCS took 40.5s. Estimated remaining: 4h 3m 43s. Rate: 8.0 symbols/min [2025-10-22T17:52:39.168449] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:39.205918] [DEBUG] [LOCAL ] CDP: Loaded 42295 existing records from primary storage. [2025-10-22T17:52:39.206211] [INFO ] [MAIN ] CDP: Loaded 42295 existing records. [2025-10-22T17:52:39.322856] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-22T17:52:39.379504] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:39.379886] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-22T17:52:39.379935] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-22T17:52:39.380128] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-22T17:52:39.380213] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-22T17:52:39.727066] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:40.117760] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-22T17:52:40.564288] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T17:52:40.607713] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T17:52:40.731722] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T17:52:40.917723] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-22T17:52:41.717694] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-22T17:52:42.517740] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-22T17:52:42.661133] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:52:43.234987] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T17:52:43.287240] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:52:43.317611] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-22T17:52:44.117707] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-22T17:52:44.777241] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:52:44.917729] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-22T17:52:45.173905] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T17:52:45.177462] [INFO ] [REMOTE ] CCU: Full fetch complete (32429 records). [2025-10-22T17:52:45.177580] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-22T17:52:45.537458] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-22T17:52:45.537538] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-22T17:52:45.538154] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-22T17:52:45.538218] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-22T17:52:45.539008] [DEBUG] [LOCAL ] CCU: Trimmed 32429 records to 21640 (keeping 200 days of data) [2025-10-22T17:52:45.663566] [DEBUG] [LOCAL ] CCU: Primary data saved (21640 records). [2025-10-22T17:52:45.663723] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-22T17:52:45.663814] [INFO ] [MAIN ] Update Progress: 421/2367 symbols completed. CCU took 35.3s. Estimated remaining: 4h 3m 31s. Rate: 8.0 symbols/min [2025-10-22T17:52:45.728099] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-22T17:52:45.845489] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:45.847556] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T17:52:45.874035] [DEBUG] [LOCAL ] CDRE: Loaded 24817 existing records from primary storage. [2025-10-22T17:52:45.874323] [INFO ] [MAIN ] CDRE: Loaded 24817 existing records. [2025-10-22T17:52:46.046174] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:46.046423] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-22T17:52:46.046481] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-22T17:52:46.046714] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-22T17:52:46.046770] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-22T17:52:46.391052] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:46.517732] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-22T17:52:47.313119] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T17:52:47.321996] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-22T17:52:47.372881] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-22T17:52:48.117741] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-22T17:52:48.917773] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-22T17:52:48.953419] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T17:52:49.193757] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T17:52:49.717712] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-22T17:52:50.239436] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T17:52:50.517724] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-22T17:52:51.317670] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-22T17:52:51.635591] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T17:52:51.691357] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T17:52:52.117702] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-22T17:52:52.275399] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T17:52:52.278277] [INFO ] [REMOTE ] CDLR: Full fetch complete (14215 records). [2025-10-22T17:52:52.278347] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-22T17:52:52.681719] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-22T17:52:52.681841] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-22T17:52:52.682371] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-22T17:52:52.682447] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-22T17:52:52.683356] [DEBUG] [LOCAL ] CDLR: Trimmed 14215 records to 10195 (keeping 200 days of data) [2025-10-22T17:52:52.751001] [DEBUG] [LOCAL ] CDLR: Primary data saved (10195 records). [2025-10-22T17:52:52.751158] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-22T17:52:52.751244] [INFO ] [MAIN ] Update Progress: 422/2367 symbols completed. CDLR took 25.1s. Estimated remaining: 4h 3m 22s. Rate: 8.0 symbols/min [2025-10-22T17:52:52.920876] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-22T17:52:53.032176] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:53.100597] [DEBUG] [LOCAL ] CE: Loaded 51289 existing records from primary storage. [2025-10-22T17:52:53.101097] [INFO ] [MAIN ] CE: Loaded 51289 existing records. [2025-10-22T17:52:53.325180] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:53.325419] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-22T17:52:53.325468] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-22T17:52:53.325719] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-22T17:52:53.325780] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-22T17:52:53.726818] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-22T17:52:53.733417] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:53.759463] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T17:52:54.059394] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T17:52:54.517692] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-22T17:52:55.317732] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-22T17:52:55.893511] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T17:52:56.004077] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T17:52:56.117706] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-22T17:52:56.917724] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-22T17:52:57.105530] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T17:52:57.717764] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-22T17:52:58.329919] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-22T17:52:58.339020] [INFO ] [REMOTE ] CDE: Full fetch complete (77794 records). [2025-10-22T17:52:58.339141] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-22T17:52:58.521571] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-22T17:52:58.706884] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:52:58.813972] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-22T17:52:58.814077] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-22T17:52:58.814960] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-22T17:52:58.815027] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-22T17:52:58.816480] [DEBUG] [LOCAL ] CDE: Trimmed 77794 records to 53644 (keeping 200 days of data) [2025-10-22T17:52:59.138373] [DEBUG] [LOCAL ] CDE: Primary data saved (53644 records). [2025-10-22T17:52:59.138634] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-22T17:52:59.139346] [INFO ] [MAIN ] Update Progress: 423/2367 symbols completed. CDE took 43.2s. Estimated remaining: 4h 3m 9s. Rate: 8.0 symbols/min [2025-10-22T17:52:59.282770] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:52:59.328573] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-22T17:52:59.388584] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:59.396474] [DEBUG] [LOCAL ] CEE: Loaded 5247 existing records from primary storage. [2025-10-22T17:52:59.396706] [INFO ] [MAIN ] CEE: Loaded 5247 existing records. [2025-10-22T17:52:59.577239] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:59.577588] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-22T17:52:59.577763] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-22T17:52:59.578028] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-22T17:52:59.578167] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-22T17:52:59.736166] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T17:52:59.999220] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:00.117709] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-22T17:53:00.598330] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T17:53:00.899188] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T17:53:00.917667] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-22T17:53:01.717699] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-22T17:53:01.821721] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:53:02.517711] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-22T17:53:03.045691] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T17:53:03.317697] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-22T17:53:04.117719] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-22T17:53:04.463935] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T17:53:04.552889] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T17:53:04.917683] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-22T17:53:05.147539] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T17:53:05.717695] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-22T17:53:06.400811] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-22T17:53:06.517687] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-22T17:53:06.662313] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:53:07.116870] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T17:53:07.317708] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-22T17:53:08.117694] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-22T17:53:08.380993] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T17:53:08.917698] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-22T17:53:09.717683] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-22T17:53:09.810311] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T17:53:09.817437] [INFO ] [REMOTE ] CDP: Full fetch complete (62082 records). [2025-10-22T17:53:09.817573] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-22T17:53:10.210573] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-22T17:53:10.224813] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:53:10.224172] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-22T17:53:10.230996] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-22T17:53:10.231474] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-22T17:53:10.232634] [DEBUG] [LOCAL ] CDP: Trimmed 62082 records to 42262 (keeping 200 days of data) [2025-10-22T17:53:10.351459] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-22T17:53:10.498423] [DEBUG] [LOCAL ] CDP: Primary data saved (42262 records). [2025-10-22T17:53:10.498565] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-22T17:53:10.498684] [INFO ] [MAIN ] Update Progress: 424/2367 symbols completed. CDP took 31.5s. Estimated remaining: 4h 3m 19s. Rate: 8.0 symbols/min [2025-10-22T17:53:10.527926] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-22T17:53:10.666735] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:10.692821] [DEBUG] [LOCAL ] CEPU: Loaded 27014 existing records from primary storage. [2025-10-22T17:53:10.693084] [INFO ] [MAIN ] CEPU: Loaded 27014 existing records. [2025-10-22T17:53:10.862614] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:10.862863] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-22T17:53:10.862909] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-22T17:53:10.863081] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-22T17:53:10.863119] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-22T17:53:11.206907] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:11.317753] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-22T17:53:12.117701] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-22T17:53:12.409941] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:53:12.519438] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T17:53:12.829631] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T17:53:12.917731] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-22T17:53:13.717695] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-22T17:53:14.518960] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-22T17:53:14.535496] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:53:14.542715] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T17:53:15.317711] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-22T17:53:16.045398] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-22T17:53:16.117712] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-22T17:53:16.250755] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T17:53:16.610614] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-22T17:53:16.611733] [INFO ] [REMOTE ] CEE: Full fetch complete (10154 records). [2025-10-22T17:53:16.611802] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-22T17:53:16.612160] [FATAL] [VALIDATOR ] CEE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:53:16.612240] [FATAL] [MAIN ] CEE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:53:16.612307] [WARN ] [MAIN ] CEE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:53:16.612379] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-22T17:53:16.612440] [DEBUG] [LOCAL ] CEE: No primary data file found to delete. [2025-10-22T17:53:16.612476] [INFO ] [LOCAL ] CEE: Starting deletion of derivative data. [2025-10-22T17:53:16.612628] [DEBUG] [LOCAL ] CEE: Deleted derivative data file. [2025-10-22T17:53:16.612736] [INFO ] [MAIN ] Update Progress: 425/2367 symbols completed. CEE took 17.5s. Estimated remaining: 4h 3m 6s. Rate: 8.0 symbols/min [2025-10-22T17:53:16.777918] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:16.829375] [DEBUG] [LOCAL ] CF: Loaded 52111 existing records from primary storage. [2025-10-22T17:53:16.829802] [INFO ] [MAIN ] CF: Loaded 52111 existing records. [2025-10-22T17:53:16.924609] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-22T17:53:17.005214] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:17.005442] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-22T17:53:17.005521] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-22T17:53:17.005793] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-22T17:53:17.005854] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-22T17:53:17.361288] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:17.717722] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-22T17:53:18.131914] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T17:53:18.136590] [INFO ] [REMOTE ] CDRE: Full fetch complete (35019 records). [2025-10-22T17:53:18.136726] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-22T17:53:18.514949] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-22T17:53:18.515106] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-22T17:53:18.516051] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-22T17:53:18.516118] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-22T17:53:18.517318] [DEBUG] [LOCAL ] CDRE: Trimmed 35019 records to 24728 (keeping 200 days of data) [2025-10-22T17:53:18.517833] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-22T17:53:18.682307] [DEBUG] [LOCAL ] CDRE: Primary data saved (24728 records). [2025-10-22T17:53:18.682567] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-22T17:53:18.682712] [INFO ] [MAIN ] Update Progress: 426/2367 symbols completed. CDRE took 33.0s. Estimated remaining: 4h 2m 33s. Rate: 8.0 symbols/min [2025-10-22T17:53:18.860669] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:18.913559] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-22T17:53:18.914037] [INFO ] [MAIN ] CFG: Loaded 53623 existing records. [2025-10-22T17:53:19.096077] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:19.096460] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-22T17:53:19.096516] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-22T17:53:19.096942] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-22T17:53:19.097004] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-22T17:53:19.318603] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-22T17:53:19.485238] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:19.524708] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T17:53:20.117716] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-22T17:53:20.193775] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T17:53:20.243491] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T17:53:20.917681] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-22T17:53:21.717749] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-22T17:53:21.772759] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T17:53:22.025116] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T17:53:22.517685] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-22T17:53:23.317699] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-22T17:53:23.482951] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:53:24.117675] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-22T17:53:24.436492] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T17:53:24.463195] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T17:53:24.917726] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-22T17:53:25.717705] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-22T17:53:25.859145] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T17:53:26.378589] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:53:26.517714] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-22T17:53:27.192113] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T17:53:27.317708] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-22T17:53:28.117707] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-22T17:53:28.568027] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T17:53:28.579809] [INFO ] [REMOTE ] CE: Full fetch complete (74805 records). [2025-10-22T17:53:28.580000] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-22T17:53:28.928155] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-22T17:53:28.976542] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-22T17:53:28.976848] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-22T17:53:28.977829] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-22T17:53:28.977970] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-22T17:53:28.979415] [DEBUG] [LOCAL ] CE: Trimmed 74805 records to 51253 (keeping 200 days of data) [2025-10-22T17:53:29.102546] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T17:53:29.312428] [DEBUG] [LOCAL ] CE: Primary data saved (51253 records). [2025-10-22T17:53:29.312562] [INFO ] [MAIN ] CE: Full history saved. [2025-10-22T17:53:29.312660] [INFO ] [MAIN ] Update Progress: 427/2367 symbols completed. CE took 36.6s. Estimated remaining: 4h 2m 40s. Rate: 8.0 symbols/min [2025-10-22T17:53:29.477357] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:29.477499] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-22T17:53:29.477537] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-22T17:53:29.477682] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-22T17:53:29.477734] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-22T17:53:29.477776] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-22T17:53:29.477808] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-22T17:53:29.720562] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-22T17:53:29.830086] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:30.038306] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T17:53:30.382528] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T17:53:30.517733] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-22T17:53:31.317685] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-22T17:53:31.464210] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-22T17:53:31.464512] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-22T17:53:31.464598] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:53:31.464691] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-22T17:53:31.464769] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:53:31.464852] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-22T17:53:31.464932] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-22T17:53:31.464980] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-22T17:53:31.465037] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-22T17:53:31.465100] [INFO ] [MAIN ] Update Progress: 428/2367 symbols completed. CFND took 2.2s. Estimated remaining: 4h 2m 8s. Rate: 8.0 symbols/min [2025-10-22T17:53:31.644940] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:31.678926] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T17:53:31.723008] [DEBUG] [LOCAL ] CFR: Loaded 32535 existing records from primary storage. [2025-10-22T17:53:31.723435] [INFO ] [MAIN ] CFR: Loaded 32535 existing records. [2025-10-22T17:53:31.918842] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:31.919264] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-22T17:53:31.919331] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-22T17:53:31.919527] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-22T17:53:31.919589] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-22T17:53:32.125332] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-22T17:53:32.317902] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:32.320002] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T17:53:32.917699] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-22T17:53:33.186838] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T17:53:33.717700] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-22T17:53:34.457510] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T17:53:34.517671] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-22T17:53:35.123033] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T17:53:35.317692] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-22T17:53:36.055471] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T17:53:36.117614] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-22T17:53:36.674314] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T17:53:36.917725] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-22T17:53:37.717710] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-22T17:53:37.844245] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T17:53:38.517671] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-22T17:53:38.733292] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T17:53:39.205792] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T17:53:39.317674] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-22T17:53:40.036814] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T17:53:40.117698] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-22T17:53:40.758371] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T17:53:40.917690] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-22T17:53:41.717615] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-22T17:53:41.822068] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:53:42.517693] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-22T17:53:42.811623] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T17:53:42.869020] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T17:53:43.317700] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-22T17:53:44.117707] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-22T17:53:44.335666] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:53:44.557340] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:53:44.917785] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-22T17:53:45.440477] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T17:53:45.717754] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-22T17:53:46.517736] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-22T17:53:46.995099] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T17:53:47.004091] [INFO ] [REMOTE ] CFG: Full fetch complete (77775 records). [2025-10-22T17:53:47.004240] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-22T17:53:47.325832] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-22T17:53:47.431076] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-22T17:53:47.431421] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-22T17:53:47.432331] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-22T17:53:47.435093] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T17:53:47.433183] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-22T17:53:47.448050] [DEBUG] [LOCAL ] CFG: Trimmed 77775 records to 53623 (keeping 200 days of data) [2025-10-22T17:53:47.558496] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T17:53:47.782823] [DEBUG] [LOCAL ] CFG: Primary data saved (53623 records). [2025-10-22T17:53:47.782957] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-22T17:53:47.783033] [INFO ] [MAIN ] Update Progress: 429/2367 symbols completed. CFG took 29.1s. Estimated remaining: 4h 2m 41s. Rate: 8.0 symbols/min [2025-10-22T17:53:47.947234] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:47.984898] [DEBUG] [LOCAL ] CGAU: Loaded 43896 existing records from primary storage. [2025-10-22T17:53:47.985197] [INFO ] [MAIN ] CGAU: Loaded 43896 existing records. [2025-10-22T17:53:48.122779] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-22T17:53:48.159882] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:48.160236] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-22T17:53:48.160291] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-22T17:53:48.160493] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-22T17:53:48.160549] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-22T17:53:48.509635] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:48.917685] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-22T17:53:48.950136] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T17:53:49.543511] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T17:53:49.717702] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-22T17:53:50.517750] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-22T17:53:50.732137] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:53:50.740474] [INFO ] [REMOTE ] CF: Full fetch complete (75209 records). [2025-10-22T17:53:50.740678] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-22T17:53:50.741506] [FATAL] [VALIDATOR ] CF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:53:50.741603] [FATAL] [MAIN ] CF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:53:50.741683] [WARN ] [MAIN ] CF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:53:50.741762] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-22T17:53:50.741831] [DEBUG] [LOCAL ] CF: No primary data file found to delete. [2025-10-22T17:53:50.741869] [INFO ] [LOCAL ] CF: Starting deletion of derivative data. [2025-10-22T17:53:50.742059] [DEBUG] [LOCAL ] CF: Deleted derivative data file. [2025-10-22T17:53:50.742602] [INFO ] [MAIN ] Update Progress: 430/2367 symbols completed. CF took 34.1s. Estimated remaining: 4h 2m 13s. Rate: 8.0 symbols/min [2025-10-22T17:53:50.919281] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:50.923265] [DEBUG] [LOCAL ] CGV: Loaded 1377 existing records from primary storage. [2025-10-22T17:53:50.923433] [INFO ] [MAIN ] CGV: Loaded 1377 existing records. [2025-10-22T17:53:51.105136] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:51.105355] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-22T17:53:51.105558] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-22T17:53:51.105728] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-22T17:53:51.105783] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-22T17:53:51.322946] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-22T17:53:51.351783] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T17:53:51.522695] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:51.904311] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T17:53:51.910199] [INFO ] [REMOTE ] CEPU: Full fetch complete (39731 records). [2025-10-22T17:53:51.910330] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-22T17:53:52.130096] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-22T17:53:52.311826] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-22T17:53:52.311908] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-22T17:53:52.312469] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-22T17:53:52.312512] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-22T17:53:52.313503] [DEBUG] [LOCAL ] CEPU: Trimmed 39731 records to 27008 (keeping 200 days of data) [2025-10-22T17:53:52.467459] [DEBUG] [LOCAL ] CEPU: Primary data saved (27008 records). [2025-10-22T17:53:52.467586] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-22T17:53:52.471400] [INFO ] [MAIN ] Update Progress: 431/2367 symbols completed. CEPU took 42.0s. Estimated remaining: 4h 1m 39s. Rate: 8.0 symbols/min [2025-10-22T17:53:52.645163] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:52.670195] [DEBUG] [LOCAL ] CHCT: Loaded 24339 existing records from primary storage. [2025-10-22T17:53:52.670468] [INFO ] [MAIN ] CHCT: Loaded 24339 existing records. [2025-10-22T17:53:52.851610] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:52.852102] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-22T17:53:52.852181] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-22T17:53:52.852478] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-22T17:53:52.852624] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-22T17:53:52.921547] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-22T17:53:53.014348] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T17:53:53.293592] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:53.539312] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T17:53:53.634272] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T17:53:53.717670] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-22T17:53:54.517735] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-22T17:53:55.168425] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T17:53:55.317672] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-22T17:53:55.600415] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T17:53:56.117700] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-22T17:53:56.551940] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T17:53:56.767023] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:53:56.917738] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-22T17:53:57.717712] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-22T17:53:58.416424] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T17:53:58.517662] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-22T17:53:58.870263] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T17:53:59.317720] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-22T17:53:59.841920] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T17:54:00.117699] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-22T17:54:00.563400] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T17:54:00.734082] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:54:00.917712] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-22T17:54:01.717672] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-22T17:54:02.162031] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T17:54:02.517701] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-22T17:54:02.776238] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-22T17:54:02.873862] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T17:54:02.878836] [INFO ] [REMOTE ] CFR: Full fetch complete (48373 records). [2025-10-22T17:54:02.878961] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-22T17:54:02.879596] [FATAL] [VALIDATOR ] CFR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:54:02.879723] [FATAL] [MAIN ] CFR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:54:02.879798] [WARN ] [MAIN ] CFR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:54:02.879901] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-22T17:54:02.879986] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-22T17:54:02.880035] [INFO ] [LOCAL ] CFR: Starting deletion of derivative data. [2025-10-22T17:54:02.880183] [DEBUG] [LOCAL ] CFR: Deleted derivative data file. [2025-10-22T17:54:02.880278] [INFO ] [MAIN ] Update Progress: 432/2367 symbols completed. CFR took 31.4s. Estimated remaining: 4h 1m 45s. Rate: 8.0 symbols/min [2025-10-22T17:54:03.077686] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:54:03.125170] [DEBUG] [LOCAL ] CHD: Loaded 52328 existing records from primary storage. [2025-10-22T17:54:03.125468] [INFO ] [MAIN ] CHD: Loaded 52328 existing records. [2025-10-22T17:54:03.300893] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:54:03.301115] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-22T17:54:03.301192] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-22T17:54:03.301395] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-22T17:54:03.301453] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-22T17:54:03.323061] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-22T17:54:03.660781] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:54:04.117701] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-22T17:54:04.917710] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-22T17:54:05.075488] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T17:54:05.300434] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T17:54:05.717671] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-22T17:54:06.149795] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T17:54:06.347291] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T17:54:06.517702] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-22T17:54:07.317697] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-22T17:54:08.032765] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T17:54:08.117674] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-22T17:54:08.509993] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T17:54:08.917688] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-22T17:54:09.355911] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T17:54:09.726226] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-22T17:54:09.732356] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T17:54:10.159233] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T17:54:10.517714] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-22T17:54:10.884436] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-22T17:54:11.317721] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-22T17:54:12.117732] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-22T17:54:12.854861] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T17:54:12.917609] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-22T17:54:13.717753] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-22T17:54:14.021355] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T17:54:14.029580] [INFO ] [REMOTE ] CGAU: Full fetch complete (62121 records). [2025-10-22T17:54:14.029727] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-22T17:54:14.413884] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-22T17:54:14.414016] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-22T17:54:14.414799] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-22T17:54:14.414862] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-22T17:54:14.416082] [DEBUG] [LOCAL ] CGAU: Trimmed 62121 records to 43921 (keeping 200 days of data) [2025-10-22T17:54:14.533562] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-22T17:54:14.680428] [DEBUG] [LOCAL ] CGAU: Primary data saved (43921 records). [2025-10-22T17:54:14.680626] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-22T17:54:14.680860] [INFO ] [MAIN ] Update Progress: 433/2367 symbols completed. CGAU took 26.9s. Estimated remaining: 4h 1m 56s. Rate: 8.0 symbols/min [2025-10-22T17:54:14.826838] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T17:54:14.912629] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:54:14.929303] [DEBUG] [LOCAL ] CHE: Loaded 15306 existing records from primary storage. [2025-10-22T17:54:14.929551] [INFO ] [MAIN ] CHE: Loaded 15306 existing records. [2025-10-22T17:54:15.025696] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T17:54:15.083914] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T17:54:15.148500] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:54:15.149124] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-22T17:54:15.149258] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-22T17:54:15.149570] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-22T17:54:15.149630] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-22T17:54:15.328936] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-22T17:54:15.536976] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:54:16.117728] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-22T17:54:16.652591] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T17:54:16.917691] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-22T17:54:17.095798] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T17:54:17.717671] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-22T17:54:17.987426] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T17:54:18.308192] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T17:54:18.309036] [INFO ] [REMOTE ] CGV: Full fetch complete (2227 records). [2025-10-22T17:54:18.309105] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-22T17:54:18.524170] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-22T17:54:18.675297] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-22T17:54:18.675380] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-22T17:54:18.675485] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-22T17:54:18.675526] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-22T17:54:18.675878] [DEBUG] [LOCAL ] CGV: Trimmed 2227 records to 1359 (keeping 200 days of data) [2025-10-22T17:54:18.684900] [DEBUG] [LOCAL ] CGV: Primary data saved (1359 records). [2025-10-22T17:54:18.684959] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-22T17:54:18.685024] [INFO ] [MAIN ] Update Progress: 434/2367 symbols completed. CGV took 27.9s. Estimated remaining: 4h 1m 33s. Rate: 8.0 symbols/min [2025-10-22T17:54:18.861272] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:54:18.861705] [DEBUG] [LOCAL ] CHGG: No existing data file found in primary storage. [2025-10-22T17:54:18.861756] [WARN ] [MAIN ] CHGG: No existing data found, performing full refresh instead. [2025-10-22T17:54:18.861895] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-22T17:54:18.861938] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-22T17:54:18.861980] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-22T17:54:18.862012] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-22T17:54:19.221631] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:54:19.317685] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-22T17:54:19.593987] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T17:54:20.117699] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-22T17:54:20.917704] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-22T17:54:21.088582] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T17:54:21.379441] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T17:54:21.384112] [INFO ] [REMOTE ] CHCT: Full fetch complete (34774 records). [2025-10-22T17:54:21.384261] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-22T17:54:21.722827] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-22T17:54:21.784248] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-22T17:54:21.784328] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-22T17:54:21.784849] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-22T17:54:21.784910] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-22T17:54:21.785842] [DEBUG] [LOCAL ] CHCT: Trimmed 34774 records to 24266 (keeping 200 days of data) [2025-10-22T17:54:21.931206] [DEBUG] [LOCAL ] CHCT: Primary data saved (24266 records). [2025-10-22T17:54:21.931350] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-22T17:54:21.931435] [INFO ] [MAIN ] Update Progress: 435/2367 symbols completed. CHCT took 29.5s. Estimated remaining: 4h 1m 7s. Rate: 8.0 symbols/min [2025-10-22T17:54:22.099190] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:54:22.132273] [DEBUG] [LOCAL ] CHH: Loaded 32272 existing records from primary storage. [2025-10-22T17:54:22.132539] [INFO ] [MAIN ] CHH: Loaded 32272 existing records. [2025-10-22T17:54:22.312232] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:54:22.312471] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-22T17:54:22.312519] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-22T17:54:22.312794] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-22T17:54:22.312851] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-22T17:54:22.529846] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-22T17:54:22.686757] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:54:22.780700] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T17:54:22.815227] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T17:54:23.317706] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-22T17:54:24.117666] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-22T17:54:24.181261] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T17:54:24.754103] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-22T17:54:24.917680] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-22T17:54:25.717676] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-22T17:54:25.769542] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T17:54:25.785317] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T17:54:26.517744] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-22T17:54:27.317686] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-22T17:54:27.583877] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:54:28.117751] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-22T17:54:28.409997] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-22T17:54:28.917685] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-22T17:54:29.033737] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T17:54:29.072225] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T17:54:29.717751] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-22T17:54:30.517740] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-22T17:54:31.126343] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-22T17:54:31.324473] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-22T17:54:31.341983] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T17:54:31.830283] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:54:32.033845] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T17:54:32.117695] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-22T17:54:32.917683] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-22T17:54:33.542622] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T17:54:33.717675] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-22T17:54:33.933250] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T17:54:34.517700] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-22T17:54:34.995585] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T17:54:35.317691] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-22T17:54:36.118185] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-22T17:54:36.125507] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T17:54:36.376216] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T17:54:36.917738] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-22T17:54:37.717751] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-22T17:54:37.882836] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T17:54:38.168147] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:54:38.517688] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-22T17:54:38.845029] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T17:54:39.317747] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-22T17:54:39.886477] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T17:54:40.117746] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-22T17:54:40.917746] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-22T17:54:41.046894] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T17:54:41.695436] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T17:54:41.717673] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-22T17:54:42.241519] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T17:54:42.517713] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-22T17:54:43.317727] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-22T17:54:43.399044] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T17:54:44.117666] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-22T17:54:44.394611] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:54:44.397827] [INFO ] [REMOTE ] CHE: Full fetch complete (20480 records). [2025-10-22T17:54:44.397903] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-22T17:54:44.794018] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-22T17:54:44.841711] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-22T17:54:44.841796] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-22T17:54:44.842225] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-22T17:54:44.842266] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-22T17:54:44.842928] [DEBUG] [LOCAL ] CHE: Trimmed 20480 records to 15327 (keeping 200 days of data) [2025-10-22T17:54:44.917794] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-22T17:54:44.946582] [DEBUG] [LOCAL ] CHE: Primary data saved (15327 records). [2025-10-22T17:54:44.946741] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-22T17:54:44.946840] [INFO ] [MAIN ] Update Progress: 436/2367 symbols completed. CHE took 30.3s. Estimated remaining: 4h 2m 8s. Rate: 8.0 symbols/min [2025-10-22T17:54:45.124275] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:54:45.144262] [DEBUG] [LOCAL ] CHMI: Loaded 21355 existing records from primary storage. [2025-10-22T17:54:45.144507] [INFO ] [MAIN ] CHMI: Loaded 21355 existing records. [2025-10-22T17:54:45.332490] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:54:45.332790] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-22T17:54:45.332864] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-22T17:54:45.333061] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-22T17:54:45.333118] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-22T17:54:45.616399] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T17:54:45.726381] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:54:45.722603] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-22T17:54:46.517685] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-22T17:54:47.293714] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-22T17:54:47.302195] [INFO ] [REMOTE ] CHD: Full fetch complete (75002 records). [2025-10-22T17:54:47.302317] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-22T17:54:47.333807] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-22T17:54:47.700323] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-22T17:54:47.700441] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-22T17:54:47.701349] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-22T17:54:47.701430] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-22T17:54:47.702947] [DEBUG] [LOCAL ] CHD: Trimmed 75002 records to 52320 (keeping 200 days of data) [2025-10-22T17:54:48.026241] [DEBUG] [LOCAL ] CHD: Primary data saved (52320 records). [2025-10-22T17:54:48.026390] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-22T17:54:48.026471] [INFO ] [MAIN ] Update Progress: 437/2367 symbols completed. CHD took 45.1s. Estimated remaining: 4h 1m 41s. Rate: 8.0 symbols/min [2025-10-22T17:54:48.067735] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-22T17:54:48.117703] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-22T17:54:48.593895] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T17:54:48.917705] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-22T17:54:49.052929] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T17:54:49.060227] [INFO ] [REMOTE ] CHH: Full fetch complete (47525 records). [2025-10-22T17:54:49.060468] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-22T17:54:49.469937] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-22T17:54:49.470042] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-22T17:54:49.470907] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-22T17:54:49.470973] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-22T17:54:49.472314] [DEBUG] [LOCAL ] CHH: Trimmed 47525 records to 32225 (keeping 200 days of data) [2025-10-22T17:54:49.704124] [DEBUG] [LOCAL ] CHH: Primary data saved (32225 records). [2025-10-22T17:54:49.704462] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-22T17:54:49.704688] [INFO ] [MAIN ] Update Progress: 438/2367 symbols completed. CHH took 27.8s. Estimated remaining: 4h 1m 8s. Rate: 8.0 symbols/min [2025-10-22T17:54:49.779782] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:54:49.790584] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-22T17:54:49.856923] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T17:54:50.517687] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-22T17:54:51.581222] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T17:54:51.589081] [INFO ] [REMOTE ] CHGG: Full fetch complete (70042 records). [2025-10-22T17:54:51.589207] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-22T17:54:51.787145] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T17:54:51.878519] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-22T17:54:52.003353] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-22T17:54:52.003444] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-22T17:54:52.004292] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-22T17:54:52.004357] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-22T17:54:52.005764] [DEBUG] [LOCAL ] CHGG: Trimmed 70042 records to 47586 (keeping 200 days of data) [2025-10-22T17:54:52.271734] [DEBUG] [LOCAL ] CHGG: Primary data saved (47586 records). [2025-10-22T17:54:52.271885] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-22T17:54:52.271974] [INFO ] [MAIN ] Update Progress: 439/2367 symbols completed. CHGG took 33.6s. Estimated remaining: 4h 0m 39s. Rate: 8.0 symbols/min [2025-10-22T17:54:53.299406] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:54:53.305576] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-22T17:54:54.280165] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T17:54:54.284561] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-22T17:54:55.356468] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T17:54:55.361318] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-22T17:54:56.366160] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T17:54:56.373479] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-22T17:54:57.457319] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T17:54:57.461907] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-22T17:54:58.553322] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:54:58.558542] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-22T17:54:59.729173] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T17:54:59.732728] [INFO ] [REMOTE ] CHMI: Full fetch complete (31493 records). [2025-10-22T17:54:59.732810] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-22T17:55:00.100060] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-22T17:55:00.100147] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-22T17:55:00.100684] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-22T17:55:00.100746] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-22T17:55:00.101484] [DEBUG] [LOCAL ] CHMI: Trimmed 31493 records to 21188 (keeping 200 days of data) [2025-10-22T17:55:00.225661] [DEBUG] [LOCAL ] CHMI: Primary data saved (21188 records). [2025-10-22T17:55:00.225795] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-22T17:55:00.225874] [INFO ] [MAIN ] Update Progress: 440/2367 symbols completed. CHMI took 15.3s. Estimated remaining: 4h 0m 33s. Rate: 8.0 symbols/min [2025-10-22T17:55:00.822169] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:00.842624] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:00.883906] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:00.935192] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:00.940287] [DEBUG] [LOCAL ] CHN: Loaded 4994 existing records from primary storage. [2025-10-22T17:55:00.940675] [INFO ] [MAIN ] CHN: Loaded 4994 existing records. [2025-10-22T17:55:01.121831] [DEBUG] [LOCAL ] CHT: Loaded 19274 existing records from primary storage. [2025-10-22T17:55:01.176796] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:01.153260] [INFO ] [MAIN ] CHT: Loaded 19274 existing records. [2025-10-22T17:55:01.199780] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-22T17:55:01.189563] [DEBUG] [LOCAL ] CHPT: Loaded 47136 existing records from primary storage. [2025-10-22T17:55:01.219390] [INFO ] [MAIN ] CHPT: Loaded 47136 existing records. [2025-10-22T17:55:01.208712] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-22T17:55:01.259242] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-22T17:55:01.283191] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-22T17:55:01.374618] [DEBUG] [LOCAL ] CHWY: Loaded 53656 existing records from primary storage. [2025-10-22T17:55:01.457238] [INFO ] [MAIN ] CHWY: Loaded 53656 existing records. [2025-10-22T17:55:01.703926] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:01.827615] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-22T17:55:01.831757] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:01.831906] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-22T17:55:01.870240] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-22T17:55:01.918850] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-22T17:55:01.939547] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-22T17:55:01.939679] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-22T17:55:02.085386] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-22T17:55:02.094119] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:02.099735] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-22T17:55:02.128625] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-22T17:55:02.137673] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-22T17:55:02.264557] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-22T17:55:02.345852] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:02.313850] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-22T17:55:02.361794] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-22T17:55:03.049887] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:03.096467] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-22T17:55:03.306500] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:03.373616] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-22T17:55:03.381896] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:03.383838] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-22T17:55:03.391912] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-22T17:55:03.394515] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-22T17:55:04.033879] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T17:55:04.035774] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-22T17:55:04.536364] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T17:55:04.540408] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-22T17:55:04.639400] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T17:55:04.641425] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-22T17:55:05.278582] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T17:55:05.280426] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-22T17:55:05.419960] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T17:55:05.430544] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-22T17:55:05.515013] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T17:55:05.525447] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-22T17:55:05.565829] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T17:55:05.717638] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-22T17:55:05.896798] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T17:55:06.517713] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-22T17:55:06.763610] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T17:55:07.097823] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T17:55:07.324559] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-22T17:55:07.326456] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T17:55:07.533903] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-22T17:55:07.937491] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T17:55:08.117737] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-22T17:55:08.917749] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-22T17:55:09.717726] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-22T17:55:10.313553] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-22T17:55:10.422461] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T17:55:10.517697] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-22T17:55:10.767338] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:55:11.317699] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-22T17:55:12.117613] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-22T17:55:12.211027] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T17:55:12.455254] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T17:55:12.822583] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T17:55:12.917711] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-22T17:55:13.675725] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-22T17:55:13.717693] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-22T17:55:14.517704] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-22T17:55:14.580133] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T17:55:14.581561] [INFO ] [REMOTE ] CHN: Full fetch complete (7542 records). [2025-10-22T17:55:14.581638] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-22T17:55:14.941618] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-22T17:55:14.941735] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-22T17:55:14.941960] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-22T17:55:14.942003] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-22T17:55:14.942504] [DEBUG] [LOCAL ] CHN: Trimmed 7542 records to 4983 (keeping 200 days of data) [2025-10-22T17:55:14.975078] [DEBUG] [LOCAL ] CHN: Primary data saved (4983 records). [2025-10-22T17:55:14.975244] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-22T17:55:14.975379] [INFO ] [MAIN ] Update Progress: 441/2367 symbols completed. CHN took 14.7s. Estimated remaining: 4h 0m 57s. Rate: 8.0 symbols/min [2025-10-22T17:55:15.160921] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:15.207191] [DEBUG] [LOCAL ] CI: Loaded 49617 existing records from primary storage. [2025-10-22T17:55:15.207503] [INFO ] [MAIN ] CI: Loaded 49617 existing records. [2025-10-22T17:55:15.322987] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-22T17:55:15.414493] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:15.414744] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-22T17:55:15.414800] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-22T17:55:15.414992] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-22T17:55:15.415032] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-22T17:55:15.811863] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:16.117693] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-22T17:55:16.473461] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T17:55:16.812137] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-22T17:55:16.917688] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-22T17:55:17.717685] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-22T17:55:17.935871] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T17:55:18.119040] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T17:55:18.517712] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-22T17:55:19.317639] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-22T17:55:19.689562] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T17:55:19.996537] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-22T17:55:20.117615] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-22T17:55:20.917787] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-22T17:55:21.200630] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T17:55:21.717779] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-22T17:55:21.836525] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T17:55:22.373557] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-22T17:55:22.517697] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-22T17:55:23.317688] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-22T17:55:23.686312] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T17:55:24.117681] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-22T17:55:24.311939] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T17:55:24.630925] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:55:24.634185] [INFO ] [REMOTE ] CHT: Full fetch complete (27549 records). [2025-10-22T17:55:24.634272] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-22T17:55:24.634832] [FATAL] [VALIDATOR ] CHT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:55:24.634916] [FATAL] [MAIN ] CHT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:55:24.634960] [WARN ] [MAIN ] CHT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:55:24.635047] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-22T17:55:24.635127] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-22T17:55:24.635164] [INFO ] [LOCAL ] CHT: Starting deletion of derivative data. [2025-10-22T17:55:24.635309] [DEBUG] [LOCAL ] CHT: Deleted derivative data file. [2025-10-22T17:55:24.635395] [INFO ] [MAIN ] Update Progress: 442/2367 symbols completed. CHT took 24.4s. Estimated remaining: 4h 0m 59s. Rate: 8.0 symbols/min [2025-10-22T17:55:24.807183] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:24.822903] [DEBUG] [LOCAL ] CIA: Loaded 16533 existing records from primary storage. [2025-10-22T17:55:24.823143] [INFO ] [MAIN ] CIA: Loaded 16533 existing records. [2025-10-22T17:55:24.926297] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-22T17:55:25.008624] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:25.008883] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-22T17:55:25.008935] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-22T17:55:25.009087] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-22T17:55:25.009123] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-22T17:55:25.356467] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:25.717677] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-22T17:55:26.018306] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T17:55:26.517697] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-22T17:55:26.609987] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T17:55:26.923590] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T17:55:27.317716] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-22T17:55:28.117669] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-22T17:55:28.171373] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T17:55:28.362537] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T17:55:28.917758] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-22T17:55:29.717722] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-22T17:55:29.907276] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T17:55:30.517811] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-22T17:55:30.659522] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T17:55:30.699840] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T17:55:31.317703] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-22T17:55:32.117699] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-22T17:55:32.363801] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T17:55:32.917730] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-22T17:55:32.954853] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-22T17:55:32.963791] [INFO ] [REMOTE ] CHPT: Full fetch complete (71128 records). [2025-10-22T17:55:32.963965] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-22T17:55:33.377608] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-22T17:55:33.377764] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-22T17:55:33.378629] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-22T17:55:33.378718] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-22T17:55:33.380118] [DEBUG] [LOCAL ] CHPT: Trimmed 71128 records to 47004 (keeping 200 days of data) [2025-10-22T17:55:33.662082] [DEBUG] [LOCAL ] CHPT: Primary data saved (47004 records). [2025-10-22T17:55:33.662215] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-22T17:55:33.662298] [INFO ] [MAIN ] Update Progress: 443/2367 symbols completed. CHPT took 33.4s. Estimated remaining: 4h 0m 58s. Rate: 8.0 symbols/min [2025-10-22T17:55:33.721705] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-22T17:55:33.789565] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T17:55:33.862958] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:33.863226] [DEBUG] [LOCAL ] CIB: No existing data file found in primary storage. [2025-10-22T17:55:33.863290] [WARN ] [MAIN ] CIB: No existing data found, performing full refresh instead. [2025-10-22T17:55:33.863433] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-22T17:55:33.863489] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-22T17:55:33.863534] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-22T17:55:33.863567] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-22T17:55:34.241788] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:34.272578] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-22T17:55:34.517719] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-22T17:55:35.317692] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-22T17:55:35.391104] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T17:55:36.117732] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-22T17:55:36.318809] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:55:36.917711] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-22T17:55:37.230000] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T17:55:37.238263] [INFO ] [REMOTE ] CHWY: Full fetch complete (77391 records). [2025-10-22T17:55:37.238387] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-22T17:55:37.239201] [FATAL] [VALIDATOR ] CHWY: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:55:37.239294] [FATAL] [MAIN ] CHWY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:55:37.239336] [WARN ] [MAIN ] CHWY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:55:37.239377] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-22T17:55:37.239435] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-10-22T17:55:37.239470] [INFO ] [LOCAL ] CHWY: Starting deletion of derivative data. [2025-10-22T17:55:37.239596] [DEBUG] [LOCAL ] CHWY: Deleted derivative data file. [2025-10-22T17:55:37.239711] [INFO ] [MAIN ] Update Progress: 444/2367 symbols completed. CHWY took 37.0s. Estimated remaining: 4h 0m 34s. Rate: 8.0 symbols/min [2025-10-22T17:55:37.405296] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:37.405461] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-22T17:55:37.405498] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-22T17:55:37.405604] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-22T17:55:37.405665] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-22T17:55:37.405745] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-22T17:55:37.405797] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-22T17:55:37.723687] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-22T17:55:37.756854] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:38.207847] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T17:55:38.283054] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-22T17:55:38.517691] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-22T17:55:39.117608] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T17:55:39.118637] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:55:39.317669] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-22T17:55:40.117696] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-22T17:55:40.309160] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T17:55:40.917699] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-22T17:55:41.300267] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T17:55:41.717743] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-22T17:55:41.890720] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T17:55:42.517775] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-22T17:55:43.162756] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:55:43.317714] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-22T17:55:43.723921] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-22T17:55:43.952739] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T17:55:44.117736] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-22T17:55:44.917740] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-22T17:55:45.033465] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T17:55:45.717732] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-22T17:55:46.409249] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T17:55:46.517696] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-22T17:55:46.758767] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T17:55:46.761413] [INFO ] [REMOTE ] CIA: Full fetch complete (23386 records). [2025-10-22T17:55:46.761491] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-22T17:55:47.007893] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T17:55:47.124951] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-22T17:55:47.125023] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-22T17:55:47.125463] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-22T17:55:47.125504] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-22T17:55:47.126108] [DEBUG] [LOCAL ] CIA: Trimmed 23386 records to 16492 (keeping 200 days of data) [2025-10-22T17:55:47.212854] [DEBUG] [LOCAL ] CIA: Primary data saved (16492 records). [2025-10-22T17:55:47.212988] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-22T17:55:47.213067] [INFO ] [MAIN ] Update Progress: 445/2367 symbols completed. CIA took 22.6s. Estimated remaining: 4h 0m 37s. Rate: 8.0 symbols/min [2025-10-22T17:55:47.322822] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-22T17:55:47.379761] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:47.428221] [DEBUG] [LOCAL ] CIEN: Loaded 52126 existing records from primary storage. [2025-10-22T17:55:47.428501] [INFO ] [MAIN ] CIEN: Loaded 52126 existing records. [2025-10-22T17:55:47.603358] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:47.603545] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-22T17:55:47.603591] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-22T17:55:47.603791] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-22T17:55:47.603876] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-22T17:55:47.949527] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:48.117686] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-22T17:55:48.753110] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T17:55:48.917706] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-22T17:55:49.494180] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T17:55:49.717670] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-22T17:55:50.070468] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T17:55:50.517692] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-22T17:55:51.033559] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T17:55:51.317698] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-22T17:55:51.676770] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-22T17:55:52.117681] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-22T17:55:52.238474] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T17:55:52.917712] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-22T17:55:53.207829] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-22T17:55:53.233775] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T17:55:53.717702] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-22T17:55:54.215091] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T17:55:54.517692] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-22T17:55:54.846330] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-22T17:55:55.317693] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-22T17:55:55.666397] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-22T17:55:56.117721] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-22T17:55:56.585717] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-22T17:55:56.586464] [INFO ] [REMOTE ] CICB: Full fetch complete (1947 records). [2025-10-22T17:55:56.586531] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-22T17:55:56.771422] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-22T17:55:56.771664] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:55:56.771735] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:55:56.771811] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-22T17:55:56.771884] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-22T17:55:56.771937] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-22T17:55:56.771980] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-22T17:55:56.772036] [INFO ] [MAIN ] Update Progress: 446/2367 symbols completed. CICB took 19.5s. Estimated remaining: 4h 0m 38s. Rate: 8.0 symbols/min [2025-10-22T17:55:56.921575] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-22T17:55:56.939804] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:56.940762] [DEBUG] [LOCAL ] CIF: No existing data file found in primary storage. [2025-10-22T17:55:56.940805] [WARN ] [MAIN ] CIF: No existing data found, performing full refresh instead. [2025-10-22T17:55:56.940914] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-22T17:55:56.940954] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-22T17:55:56.940997] [DEBUG] [LOCAL ] CIF: No primary data file found to delete. [2025-10-22T17:55:56.941028] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-22T17:55:57.293515] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:57.717723] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-22T17:55:58.517717] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-22T17:55:58.682836] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T17:55:59.180376] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-22T17:55:59.317722] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-22T17:55:59.866857] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-22T17:56:00.117699] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-22T17:56:00.821709] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T17:56:00.917700] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-22T17:56:01.717727] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-22T17:56:01.747360] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T17:56:02.088888] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T17:56:02.517685] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-22T17:56:02.788128] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T17:56:02.795419] [INFO ] [REMOTE ] CI: Full fetch complete (71709 records). [2025-10-22T17:56:02.795525] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-22T17:56:02.796167] [FATAL] [VALIDATOR ] CI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:56:02.796270] [FATAL] [MAIN ] CI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:56:02.796346] [WARN ] [MAIN ] CI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:56:02.796443] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-22T17:56:02.796523] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-22T17:56:02.796561] [INFO ] [LOCAL ] CI: Starting deletion of derivative data. [2025-10-22T17:56:02.796721] [DEBUG] [LOCAL ] CI: Deleted derivative data file. [2025-10-22T17:56:02.796808] [INFO ] [MAIN ] Update Progress: 447/2367 symbols completed. CI took 47.8s. Estimated remaining: 4h 0m 24s. Rate: 8.0 symbols/min [2025-10-22T17:56:02.967152] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:03.005808] [DEBUG] [LOCAL ] CIG: Loaded 44458 existing records from primary storage. [2025-10-22T17:56:03.006093] [INFO ] [MAIN ] CIG: Loaded 44458 existing records. [2025-10-22T17:56:03.180038] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:03.180288] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-22T17:56:03.180342] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-22T17:56:03.180523] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-22T17:56:03.180560] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-22T17:56:03.327979] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-22T17:56:03.551224] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:03.854356] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T17:56:03.859712] [INFO ] [REMOTE ] CIB: Full fetch complete (45442 records). [2025-10-22T17:56:03.859828] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-22T17:56:04.122979] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-22T17:56:04.226908] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-22T17:56:04.226989] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-22T17:56:04.227554] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-22T17:56:04.227594] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-22T17:56:04.228587] [DEBUG] [LOCAL ] CIB: Trimmed 45442 records to 30292 (keeping 200 days of data) [2025-10-22T17:56:04.399695] [DEBUG] [LOCAL ] CIB: Primary data saved (30292 records). [2025-10-22T17:56:04.399875] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-22T17:56:04.399969] [INFO ] [MAIN ] Update Progress: 448/2367 symbols completed. CIB took 30.7s. Estimated remaining: 3h 59m 52s. Rate: 8.0 symbols/min [2025-10-22T17:56:04.607789] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:04.623932] [DEBUG] [LOCAL ] CII: Loaded 15235 existing records from primary storage. [2025-10-22T17:56:04.624175] [INFO ] [MAIN ] CII: Loaded 15235 existing records. [2025-10-22T17:56:04.821765] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:04.821998] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-22T17:56:04.822085] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-22T17:56:04.822256] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-22T17:56:04.822295] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-22T17:56:04.926987] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-22T17:56:05.204493] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:05.308911] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T17:56:05.565736] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T17:56:05.668992] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T17:56:05.717617] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-22T17:56:06.517690] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-22T17:56:07.197023] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T17:56:07.317726] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-22T17:56:08.117639] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-22T17:56:08.210487] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T17:56:08.487063] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:56:08.772627] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T17:56:08.917675] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-22T17:56:09.717695] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-22T17:56:09.877510] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T17:56:10.517734] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-22T17:56:11.281206] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T17:56:11.317617] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-22T17:56:12.117678] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-22T17:56:12.349992] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T17:56:12.807330] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T17:56:12.839427] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:56:12.917664] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-22T17:56:13.717709] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-22T17:56:14.452618] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T17:56:14.517614] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-22T17:56:14.922003] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T17:56:15.317710] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-22T17:56:15.590099] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-22T17:56:15.917715] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T17:56:16.117712] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-22T17:56:16.551984] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-22T17:56:16.917708] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-22T17:56:17.717691] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-22T17:56:17.830497] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T17:56:18.361435] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T17:56:18.517673] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-22T17:56:19.317702] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-22T17:56:19.517667] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T17:56:20.117734] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-22T17:56:20.917709] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-22T17:56:20.963451] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T17:56:21.722813] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-22T17:56:21.741992] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T17:56:21.835347] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T17:56:22.427872] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-22T17:56:22.517671] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-22T17:56:23.243198] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-22T17:56:23.317669] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-22T17:56:23.951571] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T17:56:23.952702] [INFO ] [REMOTE ] CIF: Full fetch complete (6565 records). [2025-10-22T17:56:23.952795] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-22T17:56:24.130218] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-22T17:56:24.317839] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-22T17:56:24.317914] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-22T17:56:24.318103] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-22T17:56:24.318142] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-22T17:56:24.318522] [DEBUG] [LOCAL ] CIF: Trimmed 6565 records to 3978 (keeping 200 days of data) [2025-10-22T17:56:24.341500] [DEBUG] [LOCAL ] CIF: Primary data saved (3978 records). [2025-10-22T17:56:24.341567] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-22T17:56:24.341632] [INFO ] [MAIN ] Update Progress: 449/2367 symbols completed. CIF took 27.6s. Estimated remaining: 4h 0m 37s. Rate: 8.0 symbols/min [2025-10-22T17:56:24.510028] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:24.548409] [DEBUG] [LOCAL ] CIM: Loaded 37513 existing records from primary storage. [2025-10-22T17:56:24.548712] [INFO ] [MAIN ] CIM: Loaded 37513 existing records. [2025-10-22T17:56:24.720248] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:24.720465] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-22T17:56:24.720513] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-22T17:56:24.720745] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-22T17:56:24.720802] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-22T17:56:24.928923] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-22T17:56:25.092536] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:25.717708] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-22T17:56:25.819364] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T17:56:26.517729] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-22T17:56:26.541950] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T17:56:26.890243] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T17:56:27.317733] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-22T17:56:28.058032] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:56:28.117721] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-22T17:56:28.917730] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-22T17:56:29.044472] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:56:29.112448] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T17:56:29.717665] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-22T17:56:30.134096] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T17:56:30.517725] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-22T17:56:31.317729] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-22T17:56:31.596357] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T17:56:32.112496] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T17:56:32.115990] [INFO ] [REMOTE ] CII: Full fetch complete (22886 records). [2025-10-22T17:56:32.116091] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-22T17:56:32.127822] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-22T17:56:32.409102] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T17:56:32.537840] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-22T17:56:32.537909] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-22T17:56:32.538296] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-22T17:56:32.538335] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-22T17:56:32.538978] [DEBUG] [LOCAL ] CII: Trimmed 22886 records to 15134 (keeping 200 days of data) [2025-10-22T17:56:32.628824] [DEBUG] [LOCAL ] CII: Primary data saved (15134 records). [2025-10-22T17:56:32.628960] [INFO ] [MAIN ] CII: Full history saved. [2025-10-22T17:56:32.629039] [INFO ] [MAIN ] Update Progress: 450/2367 symbols completed. CII took 28.2s. Estimated remaining: 4h 0m 33s. Rate: 8.0 symbols/min [2025-10-22T17:56:32.814811] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:32.820886] [DEBUG] [LOCAL ] CIMN: Loaded 2746 existing records from primary storage. [2025-10-22T17:56:32.821045] [INFO ] [MAIN ] CIMN: Loaded 2746 existing records. [2025-10-22T17:56:32.923712] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-22T17:56:33.031760] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:33.031982] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-22T17:56:33.032028] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-22T17:56:33.032183] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-22T17:56:33.032236] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-22T17:56:33.412728] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:33.717756] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-22T17:56:34.235250] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-22T17:56:34.244059] [INFO ] [REMOTE ] CIEN: Full fetch complete (75850 records). [2025-10-22T17:56:34.244197] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-22T17:56:34.519317] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-22T17:56:34.620888] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T17:56:34.678409] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-22T17:56:34.678482] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-22T17:56:34.679279] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-22T17:56:34.679343] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-22T17:56:34.680632] [DEBUG] [LOCAL ] CIEN: Trimmed 75850 records to 52121 (keeping 200 days of data) [2025-10-22T17:56:34.988035] [DEBUG] [LOCAL ] CIEN: Primary data saved (52121 records). [2025-10-22T17:56:34.988168] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-22T17:56:34.988777] [INFO ] [MAIN ] Update Progress: 451/2367 symbols completed. CIEN took 47.8s. Estimated remaining: 4h 0m 3s. Rate: 8.0 symbols/min [2025-10-22T17:56:35.162816] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:35.163357] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-22T17:56:35.163534] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-22T17:56:35.163790] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-22T17:56:35.163849] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-22T17:56:35.163894] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-22T17:56:35.163928] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-22T17:56:35.249608] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T17:56:35.324546] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-22T17:56:35.319257] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T17:56:35.577612] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:35.833676] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T17:56:36.117706] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-22T17:56:36.618769] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-22T17:56:36.917672] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-22T17:56:37.344164] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T17:56:37.717796] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-22T17:56:38.517724] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-22T17:56:38.980141] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T17:56:39.226446] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T17:56:39.317695] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-22T17:56:40.117754] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-22T17:56:40.917716] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-22T17:56:41.132384] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T17:56:41.162022] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T17:56:41.171278] [INFO ] [REMOTE ] CIG: Full fetch complete (62727 records). [2025-10-22T17:56:41.171387] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-22T17:56:41.456163] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T17:56:41.556489] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-22T17:56:41.556574] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-22T17:56:41.557281] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-22T17:56:41.557343] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-22T17:56:41.558620] [DEBUG] [LOCAL ] CIG: Trimmed 62727 records to 44526 (keeping 200 days of data) [2025-10-22T17:56:41.717960] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-22T17:56:41.819350] [DEBUG] [LOCAL ] CIG: Primary data saved (44526 records). [2025-10-22T17:56:41.819515] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-22T17:56:41.819615] [INFO ] [MAIN ] Update Progress: 452/2367 symbols completed. CIG took 39.0s. Estimated remaining: 3h 59m 53s. Rate: 8.0 symbols/min [2025-10-22T17:56:41.999992] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:42.000158] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-22T17:56:42.000195] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-22T17:56:42.000302] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-22T17:56:42.000343] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-22T17:56:42.000387] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-22T17:56:42.000445] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-22T17:56:42.344807] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:42.517683] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-22T17:56:42.590050] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T17:56:43.317733] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-22T17:56:43.722030] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T17:56:43.881774] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T17:56:44.117778] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-22T17:56:44.734340] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T17:56:44.917718] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-22T17:56:45.486702] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T17:56:45.717720] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-22T17:56:46.216304] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-22T17:56:46.517719] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-22T17:56:46.995129] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-22T17:56:47.317727] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-22T17:56:47.774735] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T17:56:48.117716] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-22T17:56:48.320833] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:56:48.321182] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-22T17:56:48.321307] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:56:48.321391] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-22T17:56:48.321469] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:56:48.321554] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-22T17:56:48.321630] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-22T17:56:48.321723] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-22T17:56:48.321786] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-22T17:56:48.321844] [INFO ] [MAIN ] Update Progress: 453/2367 symbols completed. CIMP took 6.5s. Estimated remaining: 3h 59m 41s. Rate: 8.0 symbols/min [2025-10-22T17:56:48.506122] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:48.525543] [DEBUG] [LOCAL ] CINT: Loaded 20318 existing records from primary storage. [2025-10-22T17:56:48.525818] [INFO ] [MAIN ] CINT: Loaded 20318 existing records. [2025-10-22T17:56:48.705575] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:48.705816] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-22T17:56:48.705864] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-22T17:56:48.706129] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-22T17:56:48.706184] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-22T17:56:48.922894] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-22T17:56:49.060063] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:49.717707] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-22T17:56:50.517690] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-22T17:56:50.549443] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:56:50.816895] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T17:56:50.954303] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T17:56:51.317713] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-22T17:56:51.801072] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-22T17:56:52.117719] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-22T17:56:52.554338] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T17:56:52.917740] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-22T17:56:53.554766] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T17:56:53.555814] [INFO ] [REMOTE ] CIMN: Full fetch complete (3914 records). [2025-10-22T17:56:53.555882] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-22T17:56:53.721023] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-22T17:56:53.922870] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-22T17:56:53.922945] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-22T17:56:53.923075] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-22T17:56:53.923114] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-22T17:56:53.923452] [DEBUG] [LOCAL ] CIMN: Trimmed 3914 records to 2705 (keeping 200 days of data) [2025-10-22T17:56:53.939761] [DEBUG] [LOCAL ] CIMN: Primary data saved (2705 records). [2025-10-22T17:56:53.939840] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-22T17:56:53.939909] [INFO ] [MAIN ] Update Progress: 454/2367 symbols completed. CIMN took 21.3s. Estimated remaining: 3h 59m 26s. Rate: 8.0 symbols/min [2025-10-22T17:56:54.111180] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:54.136055] [DEBUG] [LOCAL ] CIO: Loaded 21132 existing records from primary storage. [2025-10-22T17:56:54.136299] [INFO ] [MAIN ] CIO: Loaded 21132 existing records. [2025-10-22T17:56:54.312197] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:54.312439] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-22T17:56:54.312498] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-22T17:56:54.312711] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-22T17:56:54.312767] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-22T17:56:54.524631] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-22T17:56:54.676819] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:54.860604] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T17:56:54.969410] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T17:56:55.317743] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-22T17:56:56.117706] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-22T17:56:56.199303] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:56:56.804025] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T17:56:56.917679] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-22T17:56:57.639042] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T17:56:57.640143] [INFO ] [REMOTE ] CIMO: Full fetch complete (4559 records). [2025-10-22T17:56:57.640211] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-22T17:56:57.722874] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-22T17:56:57.818828] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T17:56:57.819044] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:56:57.819098] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:56:57.819138] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-22T17:56:57.819200] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-22T17:56:57.819236] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-22T17:56:57.819276] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-22T17:56:57.819330] [INFO ] [MAIN ] Update Progress: 455/2367 symbols completed. CIMO took 22.8s. Estimated remaining: 3h 59m 3s. Rate: 8.0 symbols/min [2025-10-22T17:56:57.987452] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:58.015090] [DEBUG] [LOCAL ] CION: Loaded 28277 existing records from primary storage. [2025-10-22T17:56:58.015331] [INFO ] [MAIN ] CION: Loaded 28277 existing records. [2025-10-22T17:56:58.193567] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:58.193822] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-22T17:56:58.193871] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-22T17:56:58.194061] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-22T17:56:58.194115] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-22T17:56:58.519356] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-22T17:56:58.540639] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:58.895266] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:56:59.317703] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-22T17:56:59.895759] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T17:57:00.117730] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-22T17:57:00.319926] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-22T17:57:00.917759] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-22T17:57:01.594213] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T17:57:01.717708] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-22T17:57:02.517683] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-22T17:57:02.829784] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T17:57:03.317696] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-22T17:57:03.456989] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-22T17:57:04.117739] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-22T17:57:04.655435] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T17:57:04.917725] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-22T17:57:05.370816] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-22T17:57:05.618998] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T17:57:05.650094] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T17:57:05.717678] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-22T17:57:06.517702] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-22T17:57:07.061490] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:57:07.317705] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-22T17:57:07.467046] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T17:57:08.117696] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-22T17:57:08.811093] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T17:57:08.917686] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-22T17:57:09.297964] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T17:57:09.717731] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-22T17:57:10.062731] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T17:57:10.517716] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-22T17:57:10.877718] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T17:57:11.317617] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-22T17:57:11.744100] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:57:12.117696] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-22T17:57:12.505932] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T17:57:12.511057] [INFO ] [REMOTE ] CINT: Full fetch complete (28413 records). [2025-10-22T17:57:12.511142] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-22T17:57:12.895879] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-22T17:57:12.895958] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-22T17:57:12.896466] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-22T17:57:12.896509] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-22T17:57:12.897261] [DEBUG] [LOCAL ] CINT: Trimmed 28413 records to 20384 (keeping 200 days of data) [2025-10-22T17:57:12.940158] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-22T17:57:13.011397] [DEBUG] [LOCAL ] CINT: Primary data saved (20384 records). [2025-10-22T17:57:13.011517] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-22T17:57:13.011594] [INFO ] [MAIN ] Update Progress: 456/2367 symbols completed. CINT took 24.7s. Estimated remaining: 3h 59m 28s. Rate: 8.0 symbols/min [2025-10-22T17:57:13.190231] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:13.238684] [DEBUG] [LOCAL ] CIVI: Loaded 52734 existing records from primary storage. [2025-10-22T17:57:13.239006] [INFO ] [MAIN ] CIVI: Loaded 52734 existing records. [2025-10-22T17:57:13.449369] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T17:57:13.448355] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:13.455901] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-22T17:57:13.456234] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-22T17:57:13.456434] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-22T17:57:13.456472] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-22T17:57:13.726570] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-22T17:57:13.814771] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:14.451346] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T17:57:14.458062] [INFO ] [REMOTE ] CIM: Full fetch complete (54834 records). [2025-10-22T17:57:14.458216] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-22T17:57:14.522768] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-22T17:57:14.838155] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-22T17:57:14.838254] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-22T17:57:14.838923] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-22T17:57:14.838984] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-22T17:57:14.840243] [DEBUG] [LOCAL ] CIM: Trimmed 54834 records to 37394 (keeping 200 days of data) [2025-10-22T17:57:15.058864] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T17:57:15.091246] [DEBUG] [LOCAL ] CIM: Primary data saved (37394 records). [2025-10-22T17:57:15.091370] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-22T17:57:15.091446] [INFO ] [MAIN ] Update Progress: 457/2367 symbols completed. CIM took 50.7s. Estimated remaining: 3h 58m 57s. Rate: 8.0 symbols/min [2025-10-22T17:57:15.262923] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:15.312333] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-22T17:57:15.312718] [INFO ] [MAIN ] CL: Loaded 53649 existing records. [2025-10-22T17:57:15.317674] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-22T17:57:15.498540] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:15.498816] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-22T17:57:15.498872] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-22T17:57:15.499083] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-22T17:57:15.499174] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-22T17:57:15.862737] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:16.117743] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-22T17:57:16.382094] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T17:57:16.512050] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T17:57:16.917715] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-22T17:57:17.661301] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:57:17.717682] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-22T17:57:17.788330] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T17:57:18.517740] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-22T17:57:19.308918] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T17:57:19.318630] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-22T17:57:20.117710] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-22T17:57:20.193147] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T17:57:20.218305] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-22T17:57:20.917711] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-22T17:57:21.674681] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T17:57:21.717737] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-22T17:57:22.517741] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-22T17:57:22.720989] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T17:57:23.002007] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T17:57:23.006590] [INFO ] [REMOTE ] CION: Full fetch complete (40618 records). [2025-10-22T17:57:23.006696] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-22T17:57:23.324637] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-22T17:57:23.374283] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-22T17:57:23.374369] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-22T17:57:23.374925] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-22T17:57:23.374986] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-22T17:57:23.375826] [DEBUG] [LOCAL ] CION: Trimmed 40618 records to 28073 (keeping 200 days of data) [2025-10-22T17:57:23.539528] [DEBUG] [LOCAL ] CION: Primary data saved (28073 records). [2025-10-22T17:57:23.539694] [INFO ] [MAIN ] CION: Full history saved. [2025-10-22T17:57:23.539786] [INFO ] [MAIN ] Update Progress: 458/2367 symbols completed. CION took 25.7s. Estimated remaining: 3h 58m 54s. Rate: 8.0 symbols/min [2025-10-22T17:57:23.705611] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:23.743064] [DEBUG] [LOCAL ] CLB: Loaded 33495 existing records from primary storage. [2025-10-22T17:57:23.743354] [INFO ] [MAIN ] CLB: Loaded 33495 existing records. [2025-10-22T17:57:23.916845] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:23.917067] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-22T17:57:23.917114] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-22T17:57:23.917318] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-22T17:57:23.917374] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-22T17:57:24.122757] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-22T17:57:24.273012] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:24.552701] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T17:57:24.781710] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-22T17:57:24.917667] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-22T17:57:25.717705] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-22T17:57:25.892362] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T17:57:25.949403] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-22T17:57:26.517718] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-22T17:57:26.936363] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T17:57:27.317691] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-22T17:57:28.117610] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-22T17:57:28.199249] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T17:57:28.565729] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T17:57:28.917714] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-22T17:57:29.694034] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T17:57:29.717724] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-22T17:57:30.096051] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T17:57:30.517757] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-22T17:57:31.317693] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-22T17:57:31.521592] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:57:31.586210] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T17:57:32.117731] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-22T17:57:32.917722] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-22T17:57:33.102204] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T17:57:33.236396] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T17:57:33.727281] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-22T17:57:33.728634] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T17:57:34.517718] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-22T17:57:35.317763] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-22T17:57:35.628315] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T17:57:35.766414] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T17:57:36.117763] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-22T17:57:36.856533] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:57:36.861806] [INFO ] [REMOTE ] CIO: Full fetch complete (29790 records). [2025-10-22T17:57:36.861901] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-22T17:57:36.925380] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-22T17:57:37.269951] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-22T17:57:37.270080] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-22T17:57:37.270616] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-22T17:57:37.270704] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-22T17:57:37.271499] [DEBUG] [LOCAL ] CIO: Trimmed 29790 records to 21207 (keeping 200 days of data) [2025-10-22T17:57:37.386127] [DEBUG] [LOCAL ] CIO: Primary data saved (21207 records). [2025-10-22T17:57:37.386250] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-22T17:57:37.386324] [INFO ] [MAIN ] Update Progress: 459/2367 symbols completed. CIO took 43.4s. Estimated remaining: 3h 59m 13s. Rate: 8.0 symbols/min [2025-10-22T17:57:37.555067] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:37.568534] [DEBUG] [LOCAL ] CLCO: Loaded 13154 existing records from primary storage. [2025-10-22T17:57:37.569039] [INFO ] [MAIN ] CLCO: Loaded 13154 existing records. [2025-10-22T17:57:37.722421] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-22T17:57:37.755414] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:37.756842] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-22T17:57:37.756963] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-22T17:57:37.757205] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-22T17:57:37.757353] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-22T17:57:38.190891] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:38.195815] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-22T17:57:38.517691] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-22T17:57:38.722271] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:57:39.179890] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T17:57:39.317721] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-22T17:57:40.117748] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-22T17:57:40.499762] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T17:57:40.917749] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-22T17:57:41.109207] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T17:57:41.368078] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:57:41.717702] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-22T17:57:42.517751] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-22T17:57:42.872150] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T17:57:42.881317] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-22T17:57:42.881471] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-22T17:57:43.259676] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T17:57:43.329587] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-22T17:57:43.334323] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-22T17:57:43.335266] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-22T17:57:43.336350] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-22T17:57:43.336533] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-22T17:57:43.338118] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 53649 (keeping 200 days of data) [2025-10-22T17:57:43.665994] [DEBUG] [LOCAL ] CL: Primary data saved (53649 records). [2025-10-22T17:57:43.666130] [INFO ] [MAIN ] CL: Full history saved. [2025-10-22T17:57:43.666252] [INFO ] [MAIN ] Update Progress: 460/2367 symbols completed. CL took 28.6s. Estimated remaining: 3h 58m 60s. Rate: 8.0 symbols/min [2025-10-22T17:57:43.831686] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:43.855302] [DEBUG] [LOCAL ] CLDT: Loaded 25283 existing records from primary storage. [2025-10-22T17:57:43.855539] [INFO ] [MAIN ] CLDT: Loaded 25283 existing records. [2025-10-22T17:57:44.048320] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:44.048593] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-22T17:57:44.048677] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-22T17:57:44.048874] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-22T17:57:44.048913] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-22T17:57:44.123570] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-22T17:57:44.448369] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:44.483397] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T17:57:44.484428] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T17:57:44.497716] [INFO ] [REMOTE ] CIVI: Full fetch complete (76084 records). [2025-10-22T17:57:44.497842] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-22T17:57:44.890423] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-22T17:57:44.890505] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-22T17:57:44.891360] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-22T17:57:44.891425] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-22T17:57:44.892813] [DEBUG] [LOCAL ] CIVI: Trimmed 76084 records to 52730 (keeping 200 days of data) [2025-10-22T17:57:44.950160] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-22T17:57:45.231811] [DEBUG] [LOCAL ] CIVI: Primary data saved (52730 records). [2025-10-22T17:57:45.232029] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-22T17:57:45.232224] [INFO ] [MAIN ] Update Progress: 461/2367 symbols completed. CIVI took 32.2s. Estimated remaining: 3h 58m 28s. Rate: 8.0 symbols/min [2025-10-22T17:57:45.405570] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:45.455472] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-22T17:57:45.455825] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-22T17:57:45.636935] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:45.637263] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-22T17:57:45.637455] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-22T17:57:45.644111] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-22T17:57:45.655169] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-22T17:57:45.720603] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-22T17:57:45.699619] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T17:57:46.033722] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:46.161146] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T17:57:46.503880] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T17:57:46.517616] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-22T17:57:47.317715] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-22T17:57:47.615613] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T17:57:48.107068] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T17:57:48.117613] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-22T17:57:48.917727] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-22T17:57:49.092038] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T17:57:49.717795] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-22T17:57:50.152448] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T17:57:50.517764] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-22T17:57:50.944711] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T17:57:51.317691] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-22T17:57:51.942389] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T17:57:51.948314] [INFO ] [REMOTE ] CLB: Full fetch complete (47321 records). [2025-10-22T17:57:51.948410] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-22T17:57:52.125510] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-22T17:57:52.324989] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-22T17:57:52.325073] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-22T17:57:52.325677] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-22T17:57:52.325738] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-22T17:57:52.326708] [DEBUG] [LOCAL ] CLB: Trimmed 47321 records to 33453 (keeping 200 days of data) [2025-10-22T17:57:52.520496] [DEBUG] [LOCAL ] CLB: Primary data saved (33453 records). [2025-10-22T17:57:52.520614] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-22T17:57:52.521216] [INFO ] [MAIN ] Update Progress: 462/2367 symbols completed. CLB took 29.0s. Estimated remaining: 3h 58m 19s. Rate: 8.0 symbols/min [2025-10-22T17:57:52.688639] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:52.715970] [DEBUG] [LOCAL ] CLH: Loaded 27711 existing records from primary storage. [2025-10-22T17:57:52.716221] [INFO ] [MAIN ] CLH: Loaded 27711 existing records. [2025-10-22T17:57:52.892481] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:52.892770] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-22T17:57:52.892851] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-22T17:57:52.893065] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-22T17:57:52.893132] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-22T17:57:52.923176] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-22T17:57:53.014543] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T17:57:53.267483] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:53.557768] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T17:57:53.717672] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-22T17:57:53.846375] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T17:57:54.517694] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-22T17:57:54.618863] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T17:57:55.317715] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-22T17:57:56.117729] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-22T17:57:56.431860] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T17:57:56.877809] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T17:57:56.914636] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:57:56.923463] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-22T17:57:57.717712] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-22T17:57:58.081825] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T17:57:58.517722] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-22T17:57:59.317697] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-22T17:57:59.483920] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:57:59.599812] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T17:58:00.117716] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-22T17:58:00.149933] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T17:58:00.917753] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-22T17:58:01.671758] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T17:58:01.717849] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-22T17:58:02.320169] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T17:58:02.517777] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-22T17:58:03.317743] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-22T17:58:03.972608] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T17:58:03.976349] [INFO ] [REMOTE ] CLCO: Full fetch complete (22657 records). [2025-10-22T17:58:03.976424] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-22T17:58:03.976899] [FATAL] [VALIDATOR ] CLCO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:58:03.976996] [FATAL] [MAIN ] CLCO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:58:03.977067] [WARN ] [MAIN ] CLCO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:58:03.977168] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-22T17:58:03.977247] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-22T17:58:03.977285] [INFO ] [LOCAL ] CLCO: Starting deletion of derivative data. [2025-10-22T17:58:03.977434] [DEBUG] [LOCAL ] CLCO: Deleted derivative data file. [2025-10-22T17:58:03.977518] [INFO ] [MAIN ] Update Progress: 463/2367 symbols completed. CLCO took 26.6s. Estimated remaining: 3h 58m 28s. Rate: 8.0 symbols/min [2025-10-22T17:58:04.123028] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-22T17:58:04.150891] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:04.165170] [DEBUG] [LOCAL ] CLPR: Loaded 10065 existing records from primary storage. [2025-10-22T17:58:04.165379] [INFO ] [MAIN ] CLPR: Loaded 10065 existing records. [2025-10-22T17:58:04.345705] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:04.346221] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-22T17:58:04.346320] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-22T17:58:04.357893] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-22T17:58:04.363114] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-22T17:58:04.444431] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-22T17:58:04.756530] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:04.773458] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:58:04.917684] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-22T17:58:05.717675] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-22T17:58:05.800604] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T17:58:05.848527] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T17:58:06.517717] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-22T17:58:07.076977] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T17:58:07.317695] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-22T17:58:07.609838] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:58:08.059754] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T17:58:08.117619] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-22T17:58:08.917751] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-22T17:58:09.127365] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T17:58:09.717713] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-22T17:58:10.188313] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T17:58:10.192946] [INFO ] [REMOTE ] CLDT: Full fetch complete (37642 records). [2025-10-22T17:58:10.193032] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-22T17:58:10.522812] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-22T17:58:10.596784] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-22T17:58:10.596866] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-22T17:58:10.597466] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-22T17:58:10.597508] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-22T17:58:10.598535] [DEBUG] [LOCAL ] CLDT: Trimmed 37642 records to 25165 (keeping 200 days of data) [2025-10-22T17:58:10.669167] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T17:58:10.762025] [DEBUG] [LOCAL ] CLDT: Primary data saved (25165 records). [2025-10-22T17:58:10.762172] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-22T17:58:10.762252] [INFO ] [MAIN ] Update Progress: 464/2367 symbols completed. CLDT took 27.1s. Estimated remaining: 3h 58m 18s. Rate: 8.0 symbols/min [2025-10-22T17:58:10.926324] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:10.975414] [DEBUG] [LOCAL ] CLS: Loaded 53563 existing records from primary storage. [2025-10-22T17:58:10.975762] [INFO ] [MAIN ] CLS: Loaded 53563 existing records. [2025-10-22T17:58:11.147796] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:11.147990] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-22T17:58:11.148035] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-22T17:58:11.148216] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-22T17:58:11.148252] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-22T17:58:11.320606] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-22T17:58:11.500021] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:12.008742] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T17:58:12.117681] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-22T17:58:12.161684] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T17:58:12.917709] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-22T17:58:13.717699] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-22T17:58:14.069834] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T17:58:14.254401] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T17:58:14.463609] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T17:58:14.517709] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-22T17:58:15.317713] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-22T17:58:15.723799] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T17:58:16.117676] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-22T17:58:16.267849] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T17:58:16.917729] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-22T17:58:17.717719] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-22T17:58:17.923269] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T17:58:18.029674] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T17:58:18.517678] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-22T17:58:18.526868] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T17:58:19.317677] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-22T17:58:20.117697] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-22T17:58:20.701502] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-22T17:58:20.775732] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T17:58:20.917712] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-22T17:58:21.606894] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-22T17:58:21.717697] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-22T17:58:22.137953] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T17:58:22.517725] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-22T17:58:23.317765] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-22T17:58:23.496961] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T17:58:24.117755] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-22T17:58:24.553909] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-22T17:58:24.554457] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T17:58:24.917735] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-22T17:58:25.717676] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-22T17:58:26.261370] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-22T17:58:26.286751] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T17:58:26.291915] [INFO ] [REMOTE ] CLH: Full fetch complete (42203 records). [2025-10-22T17:58:26.292001] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-22T17:58:26.524356] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-22T17:58:26.653875] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-22T17:58:26.653950] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-22T17:58:26.654468] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-22T17:58:26.654508] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-22T17:58:26.655352] [DEBUG] [LOCAL ] CLH: Trimmed 42203 records to 27584 (keeping 200 days of data) [2025-10-22T17:58:26.816790] [DEBUG] [LOCAL ] CLH: Primary data saved (27584 records). [2025-10-22T17:58:26.816923] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-22T17:58:26.817002] [INFO ] [MAIN ] Update Progress: 465/2367 symbols completed. CLH took 34.3s. Estimated remaining: 3h 58m 45s. Rate: 8.0 symbols/min [2025-10-22T17:58:26.980305] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:27.033541] [DEBUG] [LOCAL ] CLVT: Loaded 51913 existing records from primary storage. [2025-10-22T17:58:27.033903] [INFO ] [MAIN ] CLVT: Loaded 51913 existing records. [2025-10-22T17:58:27.205881] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:27.206064] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-22T17:58:27.206109] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-22T17:58:27.206293] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-22T17:58:27.206329] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-22T17:58:27.322843] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-22T17:58:27.581742] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:27.739091] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T17:58:28.117780] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-22T17:58:28.370352] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T17:58:28.372159] [INFO ] [REMOTE ] CLPR: Full fetch complete (15908 records). [2025-10-22T17:58:28.372258] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-22T17:58:28.754817] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-22T17:58:28.755008] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-22T17:58:28.755528] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-22T17:58:28.755629] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-22T17:58:28.756399] [DEBUG] [LOCAL ] CLPR: Trimmed 15908 records to 9996 (keeping 200 days of data) [2025-10-22T17:58:28.812717] [DEBUG] [LOCAL ] CLPR: Primary data saved (9996 records). [2025-10-22T17:58:28.812844] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-22T17:58:28.812920] [INFO ] [MAIN ] Update Progress: 466/2367 symbols completed. CLPR took 24.8s. Estimated remaining: 3h 58m 15s. Rate: 8.0 symbols/min [2025-10-22T17:58:28.917770] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-22T17:58:28.990939] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:29.017575] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-22T17:58:29.031675] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-22T17:58:29.031870] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-22T17:58:29.133582] [DEBUG] [LOCAL ] CLW: Loaded 21289 existing records from primary storage. [2025-10-22T17:58:29.144015] [INFO ] [MAIN ] CLW: Loaded 21289 existing records. [2025-10-22T17:58:29.498193] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:29.516311] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-22T17:58:29.524483] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-22T17:58:29.527138] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-22T17:58:29.527198] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-22T17:58:29.774897] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-22T17:58:29.810148] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-22T17:58:29.846257] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-22T17:58:29.858490] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-22T17:58:29.994246] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-22T17:58:30.039664] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:30.043195] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-22T17:58:30.047245] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T17:58:30.373958] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-22T17:58:30.374102] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-22T17:58:30.374182] [INFO ] [MAIN ] Update Progress: 467/2367 symbols completed. CLF took 45.1s. Estimated remaining: 3h 57m 43s. Rate: 8.0 symbols/min [2025-10-22T17:58:30.522742] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-22T17:58:30.604508] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:30.656264] [DEBUG] [LOCAL ] CLX: Loaded 51811 existing records from primary storage. [2025-10-22T17:58:30.656627] [INFO ] [MAIN ] CLX: Loaded 51811 existing records. [2025-10-22T17:58:30.843123] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:30.843394] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-22T17:58:30.843443] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-22T17:58:30.843685] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-22T17:58:30.843743] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-22T17:58:31.245896] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:31.285249] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-22T17:58:31.317714] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-22T17:58:31.457679] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T17:58:32.117688] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-22T17:58:32.189076] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:58:32.917673] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-22T17:58:32.951662] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T17:58:33.282605] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T17:58:33.717705] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-22T17:58:34.517713] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-22T17:58:34.725356] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:58:35.317691] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-22T17:58:35.478092] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T17:58:35.637175] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T17:58:36.117738] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-22T17:58:36.917739] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-22T17:58:36.970441] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T17:58:37.717745] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-22T17:58:37.854008] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T17:58:38.517733] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-22T17:58:38.953595] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T17:58:38.991316] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T17:58:39.317772] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-22T17:58:40.117688] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-22T17:58:40.222732] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T17:58:40.437683] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T17:58:40.921584] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-22T17:58:41.717789] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-22T17:58:42.070476] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T17:58:42.517699] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-22T17:58:42.801527] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T17:58:43.317712] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-22T17:58:43.576279] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T17:58:43.882166] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-22T17:58:44.117727] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-22T17:58:44.917734] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-22T17:58:45.679330] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-22T17:58:45.717694] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-22T17:58:45.914999] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:58:46.517695] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-22T17:58:46.651927] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T17:58:47.171607] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T17:58:47.317751] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-22T17:58:47.840560] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T17:58:48.117744] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-22T17:58:48.500493] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T17:58:48.917703] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-22T17:58:49.717695] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-22T17:58:49.949756] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:58:50.437370] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-22T17:58:50.517691] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-22T17:58:51.291397] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T17:58:51.317618] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-22T17:58:52.117747] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-22T17:58:52.707039] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T17:58:52.716157] [INFO ] [REMOTE ] CLS: Full fetch complete (77714 records). [2025-10-22T17:58:52.716309] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-22T17:58:52.924534] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-22T17:58:53.056865] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:58:53.135949] [INFO ] [REMOTE ] CLW: Full fetch complete (33622 records). [2025-10-22T17:58:53.157199] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-22T17:58:53.161195] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-22T17:58:53.161670] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-22T17:58:53.162859] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-22T17:58:53.162983] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-22T17:58:53.291565] [DEBUG] [LOCAL ] CLS: Trimmed 77714 records to 53563 (keeping 200 days of data) [2025-10-22T17:58:53.453470] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-22T17:58:53.760220] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-22T17:58:53.809414] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-22T17:58:53.810247] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-22T17:58:53.810791] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-22T17:58:53.811401] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-22T17:58:53.819724] [DEBUG] [LOCAL ] CLW: Trimmed 33622 records to 21127 (keeping 200 days of data) [2025-10-22T17:58:54.039387] [DEBUG] [LOCAL ] CLS: Primary data saved (53563 records). [2025-10-22T17:58:54.041009] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-22T17:58:54.041391] [INFO ] [MAIN ] Update Progress: 468/2367 symbols completed. CLS took 43.3s. Estimated remaining: 3h 58m 41s. Rate: 8.0 symbols/min [2025-10-22T17:58:54.164488] [DEBUG] [LOCAL ] CLW: Primary data saved (21127 records). [2025-10-22T17:58:54.170258] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-22T17:58:54.180667] [INFO ] [MAIN ] Update Progress: 469/2367 symbols completed. CLW took 25.4s. Estimated remaining: 3h 58m 4s. Rate: 8.0 symbols/min [2025-10-22T17:58:54.309907] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:54.408598] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:54.444679] [DEBUG] [LOCAL ] CM: Loaded 48468 existing records from primary storage. [2025-10-22T17:58:54.445063] [INFO ] [MAIN ] CM: Loaded 48468 existing records. [2025-10-22T17:58:54.645846] [DEBUG] [LOCAL ] CMA: Loaded 50177 existing records from primary storage. [2025-10-22T17:58:54.668067] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:54.668550] [INFO ] [MAIN ] CMA: Loaded 50177 existing records. [2025-10-22T17:58:54.701569] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-22T17:58:54.726982] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-22T17:58:54.764631] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-22T17:58:54.782092] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-22T17:58:54.997823] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:54.998387] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-22T17:58:54.998465] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-22T17:58:55.009851] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-22T17:58:55.015167] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-22T17:58:55.237534] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T17:58:55.337383] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-22T17:58:55.549890] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:55.594472] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-22T17:58:55.720494] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:55.752356] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T17:58:56.117709] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-22T17:58:56.917662] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-22T17:58:57.112666] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T17:58:57.121321] [INFO ] [REMOTE ] CLX: Full fetch complete (73878 records). [2025-10-22T17:58:57.121488] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-22T17:58:57.457026] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T17:58:57.564247] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-22T17:58:57.564359] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-22T17:58:57.565204] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-22T17:58:57.565383] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-22T17:58:57.566845] [DEBUG] [LOCAL ] CLX: Trimmed 73878 records to 51814 (keeping 200 days of data) [2025-10-22T17:58:57.682519] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-22T17:58:57.720682] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-22T17:58:57.934531] [DEBUG] [LOCAL ] CLX: Primary data saved (51814 records). [2025-10-22T17:58:57.934715] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-22T17:58:57.934810] [INFO ] [MAIN ] Update Progress: 470/2367 symbols completed. CLX took 27.6s. Estimated remaining: 3h 57m 41s. Rate: 8.0 symbols/min [2025-10-22T17:58:58.110458] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:58.138779] [DEBUG] [LOCAL ] CMBT: Loaded 27244 existing records from primary storage. [2025-10-22T17:58:58.139154] [INFO ] [MAIN ] CMBT: Loaded 27244 existing records. [2025-10-22T17:58:58.319172] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:58.319379] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-22T17:58:58.319427] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-22T17:58:58.319619] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-22T17:58:58.319706] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-22T17:58:58.523165] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-22T17:58:58.696925] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:58.728475] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T17:58:59.072191] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T17:58:59.317759] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-22T17:59:00.117702] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-22T17:59:00.180825] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:59:00.201974] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T17:59:00.917712] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-22T17:59:01.717705] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-22T17:59:02.007408] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T17:59:02.355001] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:59:02.517722] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-22T17:59:03.317734] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-22T17:59:04.117772] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-22T17:59:04.305881] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:59:04.917845] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-22T17:59:05.376970] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (3.66 seconds). [2025-10-22T17:59:05.385386] [INFO ] [REMOTE ] CLVT: Full fetch complete (75419 records). [2025-10-22T17:59:05.385540] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-22T17:59:05.789829] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-22T17:59:05.790301] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-22T17:59:05.815567] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-22T17:59:05.819234] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-22T17:59:05.822056] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-22T17:59:05.833294] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-22T17:59:05.845749] [DEBUG] [LOCAL ] CLVT: Trimmed 75419 records to 51912 (keeping 200 days of data) [2025-10-22T17:59:05.866341] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T17:59:06.084533] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T17:59:06.179529] [DEBUG] [LOCAL ] CLVT: Primary data saved (51912 records). [2025-10-22T17:59:06.179706] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-22T17:59:06.180389] [INFO ] [MAIN ] Update Progress: 471/2367 symbols completed. CLVT took 39.4s. Estimated remaining: 3h 57m 36s. Rate: 8.0 symbols/min [2025-10-22T17:59:06.345217] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:06.393351] [DEBUG] [LOCAL ] CMC: Loaded 45567 existing records from primary storage. [2025-10-22T17:59:06.393680] [INFO ] [MAIN ] CMC: Loaded 45567 existing records. [2025-10-22T17:59:06.533376] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-22T17:59:06.577824] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:59:06.578130] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-22T17:59:06.578199] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-22T17:59:06.578417] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-22T17:59:06.578472] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-22T17:59:06.926444] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:07.317720] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-22T17:59:07.683196] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:59:08.117745] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-22T17:59:08.408674] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T17:59:08.464019] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T17:59:08.917776] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-22T17:59:09.542507] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:59:09.717700] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-22T17:59:09.959703] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T17:59:10.517781] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-22T17:59:11.317724] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-22T17:59:11.395765] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:59:12.117718] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-22T17:59:12.282318] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T17:59:12.922752] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-22T17:59:12.941432] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T17:59:12.961900] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T17:59:13.717664] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-22T17:59:14.517733] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-22T17:59:14.569778] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:59:15.190156] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T17:59:15.317674] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-22T17:59:16.122854] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-22T17:59:16.146044] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T17:59:16.917693] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-22T17:59:17.096131] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T17:59:17.717681] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-22T17:59:17.834414] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T17:59:18.437577] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T17:59:18.517686] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-22T17:59:19.317689] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-22T17:59:19.620736] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T17:59:19.628822] [INFO ] [REMOTE ] CMBT: Full fetch complete (33874 records). [2025-10-22T17:59:19.628940] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-22T17:59:19.997327] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-22T17:59:19.997406] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-22T17:59:19.997944] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-22T17:59:19.998006] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-22T17:59:19.998856] [DEBUG] [LOCAL ] CMBT: Trimmed 33874 records to 27509 (keeping 200 days of data) [2025-10-22T17:59:20.117730] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-22T17:59:20.197038] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:59:20.211175] [DEBUG] [LOCAL ] CMBT: Primary data saved (27509 records). [2025-10-22T17:59:20.211299] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-22T17:59:20.211372] [INFO ] [MAIN ] Update Progress: 472/2367 symbols completed. CMBT took 22.3s. Estimated remaining: 3h 57m 55s. Rate: 8.0 symbols/min [2025-10-22T17:59:20.376298] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:20.382962] [DEBUG] [LOCAL ] CMCM: Loaded 4857 existing records from primary storage. [2025-10-22T17:59:20.383131] [INFO ] [MAIN ] CMCM: Loaded 4857 existing records. [2025-10-22T17:59:20.561680] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:59:20.561923] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-22T17:59:20.561976] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-22T17:59:20.562122] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-22T17:59:20.562471] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-22T17:59:20.926490] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:20.920868] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-22T17:59:20.954924] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T17:59:21.717683] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-22T17:59:22.219394] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T17:59:22.517705] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-22T17:59:22.618699] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T17:59:22.687608] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T17:59:23.317697] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-22T17:59:24.117734] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-22T17:59:24.435690] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T17:59:24.667770] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-22T17:59:24.917731] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-22T17:59:25.717735] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-22T17:59:25.865995] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T17:59:26.517671] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-22T17:59:26.801362] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T17:59:26.808956] [INFO ] [REMOTE ] CM: Full fetch complete (69861 records). [2025-10-22T17:59:26.809061] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-22T17:59:27.186017] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-22T17:59:27.186134] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-22T17:59:27.186995] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-22T17:59:27.187099] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-22T17:59:27.188437] [DEBUG] [LOCAL ] CM: Trimmed 69861 records to 48431 (keeping 200 days of data) [2025-10-22T17:59:27.362311] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-22T17:59:27.450791] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:59:27.522578] [DEBUG] [LOCAL ] CM: Primary data saved (48431 records). [2025-10-22T17:59:27.522729] [INFO ] [MAIN ] CM: Full history saved. [2025-10-22T17:59:27.522812] [INFO ] [MAIN ] Update Progress: 473/2367 symbols completed. CM took 33.5s. Estimated remaining: 3h 57m 47s. Rate: 8.0 symbols/min [2025-10-22T17:59:27.690745] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:27.690935] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-22T17:59:27.691073] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-22T17:59:27.691211] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-22T17:59:27.691313] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-22T17:59:27.691473] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-22T17:59:27.691537] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-22T17:59:27.961540] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T17:59:28.087419] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:28.088491] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T17:59:28.117611] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-22T17:59:28.917690] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-22T17:59:29.120478] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:59:29.120776] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-22T17:59:29.120865] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:59:29.120913] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-22T17:59:29.120955] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:59:29.120994] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-22T17:59:29.121052] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-22T17:59:29.121090] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-22T17:59:29.121138] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-22T17:59:29.121185] [INFO ] [MAIN ] Update Progress: 474/2367 symbols completed. CMDB took 1.6s. Estimated remaining: 3h 57m 15s. Rate: 8.0 symbols/min [2025-10-22T17:59:29.313888] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:29.314251] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-10-22T17:59:29.314309] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-10-22T17:59:29.314420] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-22T17:59:29.314462] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-22T17:59:29.314506] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-22T17:59:29.314539] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-22T17:59:29.728993] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-22T17:59:29.737294] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:29.764271] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T17:59:30.517764] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-22T17:59:31.136667] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T17:59:31.317695] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-22T17:59:31.486079] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T17:59:31.495759] [INFO ] [REMOTE ] CMA: Full fetch complete (73522 records). [2025-10-22T17:59:31.495934] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-22T17:59:31.886274] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-22T17:59:31.886356] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-22T17:59:31.887146] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-22T17:59:31.887207] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-22T17:59:31.888868] [DEBUG] [LOCAL ] CMA: Trimmed 73522 records to 50170 (keeping 200 days of data) [2025-10-22T17:59:32.117767] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-22T17:59:32.202054] [DEBUG] [LOCAL ] CMA: Primary data saved (50170 records). [2025-10-22T17:59:32.202678] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-22T17:59:32.202782] [INFO ] [MAIN ] Update Progress: 475/2367 symbols completed. CMA took 38.0s. Estimated remaining: 3h 56m 50s. Rate: 8.0 symbols/min [2025-10-22T17:59:32.366171] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:32.403083] [DEBUG] [LOCAL ] CMI: Loaded 41706 existing records from primary storage. [2025-10-22T17:59:32.403410] [INFO ] [MAIN ] CMI: Loaded 41706 existing records. [2025-10-22T17:59:32.585830] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:59:32.586189] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-22T17:59:32.586335] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-22T17:59:32.586720] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-22T17:59:32.586874] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-22T17:59:32.689739] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-22T17:59:32.927123] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T17:59:32.918351] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-22T17:59:33.007352] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:33.717703] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-22T17:59:34.517733] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-22T17:59:35.134291] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T17:59:35.171919] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T17:59:35.199945] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T17:59:35.208203] [INFO ] [REMOTE ] CMC: Full fetch complete (67264 records). [2025-10-22T17:59:35.208369] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-22T17:59:35.322779] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-22T17:59:35.592123] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-22T17:59:35.592199] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-22T17:59:35.592988] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-22T17:59:35.593050] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-22T17:59:35.594268] [DEBUG] [LOCAL ] CMC: Trimmed 67264 records to 45548 (keeping 200 days of data) [2025-10-22T17:59:35.854135] [DEBUG] [LOCAL ] CMC: Primary data saved (45548 records). [2025-10-22T17:59:35.854259] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-22T17:59:35.854873] [INFO ] [MAIN ] Update Progress: 476/2367 symbols completed. CMC took 29.7s. Estimated remaining: 3h 56m 27s. Rate: 8.0 symbols/min [2025-10-22T17:59:36.019557] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:36.051954] [DEBUG] [LOCAL ] CMP: Loaded 35783 existing records from primary storage. [2025-10-22T17:59:36.052245] [INFO ] [MAIN ] CMP: Loaded 35783 existing records. [2025-10-22T17:59:36.124420] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-22T17:59:36.226573] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:59:36.226797] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-22T17:59:36.226845] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-22T17:59:36.227056] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-22T17:59:36.227094] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-22T17:59:36.573214] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:36.735841] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T17:59:36.917687] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-22T17:59:37.152820] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T17:59:37.563716] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T17:59:37.717731] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-22T17:59:38.517733] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-22T17:59:39.122440] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T17:59:39.187881] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T17:59:39.317637] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-22T17:59:40.098700] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T17:59:40.117612] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-22T17:59:40.917716] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-22T17:59:41.641521] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T17:59:41.659768] [INFO ] [REMOTE ] CMCM: Full fetch complete (7086 records). [2025-10-22T17:59:41.660300] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-22T17:59:41.660954] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:59:41.722889] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-22T17:59:42.018198] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-22T17:59:42.018270] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-22T17:59:42.018447] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-22T17:59:42.018486] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-22T17:59:42.018881] [DEBUG] [LOCAL ] CMCM: Trimmed 7086 records to 4828 (keeping 200 days of data) [2025-10-22T17:59:42.044432] [DEBUG] [LOCAL ] CMCM: Primary data saved (4828 records). [2025-10-22T17:59:42.044506] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-22T17:59:42.044574] [INFO ] [MAIN ] Update Progress: 477/2367 symbols completed. CMCM took 21.8s. Estimated remaining: 3h 56m 15s. Rate: 8.0 symbols/min [2025-10-22T17:59:42.517719] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-22T17:59:42.962398] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T17:59:43.317686] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-22T17:59:44.047758] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:59:44.117675] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-22T17:59:44.917719] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-22T17:59:45.574251] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-22T17:59:45.717717] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-22T17:59:45.995086] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T17:59:46.317877] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T17:59:46.517694] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-22T17:59:47.317717] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-22T17:59:48.189264] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T17:59:48.199317] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-22T17:59:48.671832] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T17:59:48.917776] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-22T17:59:49.944538] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T17:59:49.953494] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-22T17:59:50.740697] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T17:59:50.750000] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-22T17:59:51.406931] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T17:59:51.415102] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-22T17:59:51.552206] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (5.83 seconds). [2025-10-22T17:59:52.117669] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-22T17:59:52.208002] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T17:59:52.917747] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-22T17:59:52.999271] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T17:59:53.717669] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-22T17:59:54.215492] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T17:59:54.344514] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:59:54.517692] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-22T17:59:55.317703] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-22T17:59:55.373911] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T17:59:55.823235] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:59:56.117701] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-22T17:59:56.917766] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-22T17:59:57.489164] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T17:59:57.490115] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T17:59:57.717744] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-22T17:59:58.466961] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T17:59:58.517678] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-22T17:59:59.317713] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-22T17:59:59.996623] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-22T18:00:00.117619] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-22T18:00:00.413971] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T18:00:00.421445] [INFO ] [REMOTE ] CMI: Full fetch complete (61144 records). [2025-10-22T18:00:00.421673] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-22T18:00:00.535497] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T18:00:00.566765] [INFO ] [REMOTE ] CMP: Full fetch complete (51613 records). [2025-10-22T18:00:00.584329] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-22T18:00:01.154200] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-22T18:00:01.164526] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-22T18:00:01.170402] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-22T18:00:01.170492] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-22T18:00:01.237261] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-22T18:00:01.237675] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-22T18:00:01.238168] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-22T18:00:01.237587] [DEBUG] [LOCAL ] CMI: Trimmed 61144 records to 41637 (keeping 200 days of data) [2025-10-22T18:00:01.238295] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-22T18:00:01.240084] [DEBUG] [LOCAL ] CMP: Trimmed 51613 records to 35683 (keeping 200 days of data) [2025-10-22T18:00:01.573006] [DEBUG] [LOCAL ] CMP: Primary data saved (35683 records). [2025-10-22T18:00:01.624303] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-22T18:00:01.634123] [INFO ] [MAIN ] Update Progress: 478/2367 symbols completed. CMP took 25.8s. Estimated remaining: 3h 56m 55s. Rate: 8.0 symbols/min [2025-10-22T18:00:01.703435] [DEBUG] [LOCAL ] CMI: Primary data saved (41637 records). [2025-10-22T18:00:01.703564] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-22T18:00:01.703639] [INFO ] [MAIN ] Update Progress: 479/2367 symbols completed. CMI took 29.5s. Estimated remaining: 3h 56m 18s. Rate: 8.0 symbols/min [2025-10-22T18:00:03.166325] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-22T18:00:03.178484] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-22T18:00:06.726472] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (3.55 seconds). [2025-10-22T18:00:06.737615] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-22T18:00:07.938248] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T18:00:07.946460] [INFO ] [REMOTE ] CMG: Full fetch complete (77503 records). [2025-10-22T18:00:07.946600] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-22T18:00:07.947402] [FATAL] [VALIDATOR ] CMG: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:00:07.947496] [FATAL] [MAIN ] CMG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:00:07.947539] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:00:07.947578] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-22T18:00:07.947679] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-22T18:00:07.947734] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-10-22T18:00:07.947777] [DEBUG] [LOCAL ] CMG: No derivative data file found to delete. [2025-10-22T18:00:07.947835] [INFO ] [MAIN ] Update Progress: 480/2367 symbols completed. CMG took 38.8s. Estimated remaining: 3h 56m 6s. Rate: 8.0 symbols/min [2025-10-22T18:00:08.594403] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:08.567545] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:08.600870] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-10-22T18:00:08.595147] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:08.606099] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-10-22T18:00:08.651770] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:08.618886] [DEBUG] [LOCAL ] CMRE: No existing data file found in primary storage. [2025-10-22T18:00:08.652337] [WARN ] [MAIN ] CMRE: No existing data found, performing full refresh instead. [2025-10-22T18:00:08.648189] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-22T18:00:08.652750] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-22T18:00:08.652628] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-22T18:00:08.652842] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-22T18:00:08.652939] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-22T18:00:08.653078] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-22T18:00:08.653035] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-22T18:00:08.653192] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-22T18:00:08.855057] [DEBUG] [LOCAL ] CMSA: Loaded 3497 existing records from primary storage. [2025-10-22T18:00:08.874870] [INFO ] [MAIN ] CMSA: Loaded 3497 existing records. [2025-10-22T18:00:09.020898] [DEBUG] [LOCAL ] CMPO: Loaded 38539 existing records from primary storage. [2025-10-22T18:00:09.109299] [INFO ] [MAIN ] CMPO: Loaded 38539 existing records. [2025-10-22T18:00:09.602953] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:09.660484] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-22T18:00:09.665816] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-22T18:00:09.713456] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:09.743905] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-22T18:00:09.797688] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:09.797932] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-22T18:00:09.818222] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-22T18:00:09.818002] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:09.818374] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-22T18:00:09.818559] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-22T18:00:09.824073] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-22T18:00:09.824146] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-22T18:00:09.857148] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-22T18:00:10.525949] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:10.545373] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-22T18:00:10.545143] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:10.546336] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-22T18:00:11.334870] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T18:00:11.336286] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-22T18:00:11.704076] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T18:00:11.714557] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-22T18:00:11.809331] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T18:00:11.818167] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-22T18:00:11.831070] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T18:00:11.832380] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-22T18:00:12.230062] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T18:00:12.231874] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-22T18:00:12.668314] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-22T18:00:12.670729] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-22T18:00:13.298075] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T18:00:13.308097] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-22T18:00:13.405812] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T18:00:13.407320] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-22T18:00:13.456590] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T18:00:13.464964] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-22T18:00:13.950369] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (4.13 seconds). [2025-10-22T18:00:13.956859] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-22T18:00:14.029360] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T18:00:14.030853] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-22T18:00:14.589544] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T18:00:14.591030] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-22T18:00:15.049901] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T18:00:15.075193] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-22T18:00:15.101534] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:00:15.317670] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-22T18:00:15.394418] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T18:00:16.117703] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-22T18:00:16.498209] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T18:00:16.917691] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-22T18:00:17.717637] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-22T18:00:18.010284] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T18:00:18.288707] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T18:00:18.517719] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-22T18:00:19.029624] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T18:00:19.121636] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:00:19.317690] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-22T18:00:19.991387] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-22T18:00:19.992773] [INFO ] [REMOTE ] CMSA: Full fetch complete (4827 records). [2025-10-22T18:00:19.992860] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-22T18:00:20.122810] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-22T18:00:20.358864] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-22T18:00:20.358939] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-22T18:00:20.359079] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-22T18:00:20.359119] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-22T18:00:20.359472] [DEBUG] [LOCAL ] CMSA: Trimmed 4827 records to 3471 (keeping 200 days of data) [2025-10-22T18:00:20.379907] [DEBUG] [LOCAL ] CMSA: Primary data saved (3471 records). [2025-10-22T18:00:20.379983] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-22T18:00:20.380053] [INFO ] [MAIN ] Update Progress: 481/2367 symbols completed. CMSA took 12.4s. Estimated remaining: 3h 56m 17s. Rate: 8.0 symbols/min [2025-10-22T18:00:20.542014] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:20.548500] [DEBUG] [LOCAL ] CMSC: Loaded 4835 existing records from primary storage. [2025-10-22T18:00:20.548679] [INFO ] [MAIN ] CMSC: Loaded 4835 existing records. [2025-10-22T18:00:20.723081] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:20.723281] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-22T18:00:20.723327] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-22T18:00:20.723459] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-22T18:00:20.723509] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-22T18:00:20.923707] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-22T18:00:21.092485] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:21.391278] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T18:00:21.717711] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-22T18:00:22.517913] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-22T18:00:23.317730] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-22T18:00:23.411041] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T18:00:23.611111] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-22T18:00:23.859175] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-22T18:00:24.091356] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T18:00:24.117665] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-22T18:00:24.917704] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-22T18:00:25.724342] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-22T18:00:25.729774] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T18:00:26.220320] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T18:00:26.428181] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:00:26.517730] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-22T18:00:27.317736] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-22T18:00:28.117721] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-22T18:00:28.537349] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-22T18:00:28.917700] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-22T18:00:29.333213] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T18:00:29.717678] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-22T18:00:29.815001] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T18:00:30.517687] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-22T18:00:30.579133] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:00:31.317676] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-22T18:00:31.604388] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T18:00:32.117704] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-22T18:00:32.142912] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:00:32.601111] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T18:00:32.606929] [INFO ] [REMOTE ] CMPO: Full fetch complete (58144 records). [2025-10-22T18:00:32.607042] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-22T18:00:32.922878] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-22T18:00:32.987123] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-22T18:00:32.987195] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-22T18:00:32.987900] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-22T18:00:32.987962] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-22T18:00:32.989031] [DEBUG] [LOCAL ] CMPO: Trimmed 58144 records to 38424 (keeping 200 days of data) [2025-10-22T18:00:33.202629] [DEBUG] [LOCAL ] CMPO: Primary data saved (38424 records). [2025-10-22T18:00:33.202801] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-22T18:00:33.202880] [INFO ] [MAIN ] Update Progress: 482/2367 symbols completed. CMPO took 25.3s. Estimated remaining: 3h 56m 31s. Rate: 8.0 symbols/min [2025-10-22T18:00:33.370018] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:33.379093] [DEBUG] [LOCAL ] CMSD: Loaded 7668 existing records from primary storage. [2025-10-22T18:00:33.379274] [INFO ] [MAIN ] CMSD: Loaded 7668 existing records. [2025-10-22T18:00:33.554003] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:33.554236] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-22T18:00:33.554304] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-22T18:00:33.554477] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-22T18:00:33.554531] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-22T18:00:33.720685] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-22T18:00:33.922552] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:34.102487] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T18:00:34.170429] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:00:34.517675] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-22T18:00:34.537727] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T18:00:35.171305] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T18:00:35.317704] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-22T18:00:36.079672] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T18:00:36.117673] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-22T18:00:36.699605] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-22T18:00:36.917702] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-22T18:00:37.574477] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T18:00:37.717711] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-22T18:00:38.517749] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-22T18:00:39.317704] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-22T18:00:39.501591] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:00:39.507911] [INFO ] [REMOTE ] CMRE: Full fetch complete (51260 records). [2025-10-22T18:00:39.508059] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-22T18:00:39.880770] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-22T18:00:39.880845] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-22T18:00:39.881457] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-22T18:00:39.881498] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-22T18:00:39.882476] [DEBUG] [LOCAL ] CMRE: Trimmed 51260 records to 35651 (keeping 200 days of data) [2025-10-22T18:00:40.098249] [DEBUG] [LOCAL ] CMRE: Primary data saved (35651 records). [2025-10-22T18:00:40.098432] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-22T18:00:40.099205] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T18:00:40.101502] [INFO ] [MAIN ] Update Progress: 483/2367 symbols completed. CMRE took 32.1s. Estimated remaining: 3h 56m 21s. Rate: 8.0 symbols/min [2025-10-22T18:00:40.122705] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-22T18:00:40.294783] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:40.325123] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T18:00:40.360750] [DEBUG] [LOCAL ] CMTG: Loaded 35328 existing records from primary storage. [2025-10-22T18:00:40.361009] [INFO ] [MAIN ] CMTG: Loaded 35328 existing records. [2025-10-22T18:00:40.535736] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:40.535895] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-22T18:00:40.535943] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-22T18:00:40.536113] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-22T18:00:40.536152] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-22T18:00:40.890942] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:40.917642] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-22T18:00:40.983464] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-22T18:00:41.717710] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-22T18:00:42.114772] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T18:00:42.517766] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-22T18:00:42.657874] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T18:00:42.666729] [INFO ] [REMOTE ] CMS: Full fetch complete (76248 records). [2025-10-22T18:00:42.666852] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-22T18:00:43.047020] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-22T18:00:43.047101] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-22T18:00:43.047948] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-22T18:00:43.048013] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-22T18:00:43.049484] [DEBUG] [LOCAL ] CMS: Trimmed 76248 records to 52551 (keeping 200 days of data) [2025-10-22T18:00:43.321491] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-22T18:00:43.359673] [DEBUG] [LOCAL ] CMS: Primary data saved (52551 records). [2025-10-22T18:00:43.359778] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-22T18:00:43.359850] [INFO ] [MAIN ] Update Progress: 484/2367 symbols completed. CMS took 35.4s. Estimated remaining: 3h 55m 56s. Rate: 8.0 symbols/min [2025-10-22T18:00:43.526589] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:43.526749] [DEBUG] [LOCAL ] CMU: No existing data file found in primary storage. [2025-10-22T18:00:43.526794] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-10-22T18:00:43.526898] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-22T18:00:43.526938] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-22T18:00:43.526997] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-22T18:00:43.527066] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-22T18:00:43.900272] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:43.921051] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T18:00:44.124239] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-22T18:00:44.126024] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T18:00:44.849730] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T18:00:44.917670] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-22T18:00:45.478498] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T18:00:45.717714] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-22T18:00:46.496940] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T18:00:46.517607] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-22T18:00:47.317690] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-22T18:00:47.672600] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T18:00:48.053533] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T18:00:48.117669] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-22T18:00:48.741512] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T18:00:48.917694] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-22T18:00:49.521199] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T18:00:49.717730] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-22T18:00:50.517724] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-22T18:00:51.119911] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T18:00:51.260436] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T18:00:51.317703] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-22T18:00:52.060062] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T18:00:52.117743] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-22T18:00:52.917712] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-22T18:00:53.548862] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T18:00:53.717691] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-22T18:00:53.826298] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T18:00:54.314162] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:00:54.517755] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-22T18:00:55.150074] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T18:00:55.317685] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-22T18:00:56.107616] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T18:00:56.117599] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-22T18:00:56.621973] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-22T18:00:56.917706] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-22T18:00:57.717716] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-22T18:00:57.735044] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T18:00:57.736573] [INFO ] [REMOTE ] CMSD: Full fetch complete (11464 records). [2025-10-22T18:00:57.736674] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-22T18:00:58.097249] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-22T18:00:58.097324] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-22T18:00:58.097599] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-22T18:00:58.097702] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-22T18:00:58.098140] [DEBUG] [LOCAL ] CMSD: Trimmed 11464 records to 7603 (keeping 200 days of data) [2025-10-22T18:00:58.142502] [DEBUG] [LOCAL ] CMSD: Primary data saved (7603 records). [2025-10-22T18:00:58.142610] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-22T18:00:58.142719] [INFO ] [MAIN ] Update Progress: 485/2367 symbols completed. CMSD took 24.9s. Estimated remaining: 3h 56m 17s. Rate: 8.0 symbols/min [2025-10-22T18:00:58.317841] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:58.349699] [DEBUG] [LOCAL ] CNA: Loaded 32604 existing records from primary storage. [2025-10-22T18:00:58.349980] [INFO ] [MAIN ] CNA: Loaded 32604 existing records. [2025-10-22T18:00:58.522064] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-22T18:00:58.526550] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T18:00:58.533548] [INFO ] [REMOTE ] CMSC: Full fetch complete (6926 records). [2025-10-22T18:00:58.531333] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:58.533668] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-22T18:00:58.545715] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-22T18:00:58.555426] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-22T18:00:58.610814] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-22T18:00:58.627020] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-22T18:00:59.189398] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-22T18:00:59.189718] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-22T18:00:59.200325] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-22T18:00:59.205519] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-22T18:00:59.233436] [DEBUG] [LOCAL ] CMSC: Trimmed 6926 records to 4809 (keeping 200 days of data) [2025-10-22T18:00:59.288283] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:59.296475] [DEBUG] [LOCAL ] CMSC: Primary data saved (4809 records). [2025-10-22T18:00:59.296541] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-22T18:00:59.296607] [INFO ] [MAIN ] Update Progress: 486/2367 symbols completed. CMSC took 38.9s. Estimated remaining: 3h 55m 45s. Rate: 8.0 symbols/min [2025-10-22T18:00:59.326360] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-22T18:00:59.463684] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:59.512842] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-22T18:00:59.513144] [INFO ] [MAIN ] CNC: Loaded 53779 existing records. [2025-10-22T18:00:59.686757] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:59.687017] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-22T18:00:59.687067] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-22T18:00:59.687326] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-22T18:00:59.687381] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-22T18:01:00.038255] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:00.067700] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T18:01:00.117615] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-22T18:01:00.188968] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T18:01:00.917706] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-22T18:01:01.722709] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-22T18:01:01.736638] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:01:01.840145] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T18:01:02.517777] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-22T18:01:03.317702] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-22T18:01:03.431380] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T18:01:03.660527] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T18:01:04.117724] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-22T18:01:04.573836] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:01:04.917820] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-22T18:01:05.717767] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-22T18:01:05.827585] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T18:01:06.158867] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T18:01:06.517713] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-22T18:01:07.046521] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T18:01:07.317706] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-22T18:01:08.117859] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-22T18:01:08.360301] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T18:01:08.720567] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T18:01:08.917696] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-22T18:01:09.260635] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T18:01:09.717705] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-22T18:01:10.517731] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-22T18:01:10.769603] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T18:01:10.806224] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T18:01:10.811252] [INFO ] [REMOTE ] CMTG: Full fetch complete (52953 records). [2025-10-22T18:01:10.811380] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-22T18:01:11.195176] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-22T18:01:11.195263] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-22T18:01:11.195923] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-22T18:01:11.195987] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-22T18:01:11.197125] [DEBUG] [LOCAL ] CMTG: Trimmed 52953 records to 35217 (keeping 200 days of data) [2025-10-22T18:01:11.338156] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-22T18:01:11.395714] [DEBUG] [LOCAL ] CMTG: Primary data saved (35217 records). [2025-10-22T18:01:11.396797] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-22T18:01:11.396932] [INFO ] [MAIN ] Update Progress: 487/2367 symbols completed. CMTG took 31.3s. Estimated remaining: 3h 55m 55s. Rate: 8.0 symbols/min [2025-10-22T18:01:11.566249] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:11.576264] [DEBUG] [LOCAL ] CNF: Loaded 10592 existing records from primary storage. [2025-10-22T18:01:11.576463] [INFO ] [MAIN ] CNF: Loaded 10592 existing records. [2025-10-22T18:01:11.751760] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:11.751985] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-22T18:01:11.752033] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-22T18:01:11.752243] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-22T18:01:11.752299] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-22T18:01:12.122875] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:12.119036] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-22T18:01:12.278793] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T18:01:12.279962] [INFO ] [REMOTE ] CMU: Full fetch complete (9483 records). [2025-10-22T18:01:12.280029] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-22T18:01:12.639677] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-22T18:01:12.640009] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-22T18:01:12.640277] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-22T18:01:12.640319] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-22T18:01:12.640784] [DEBUG] [LOCAL ] CMU: Trimmed 9483 records to 6348 (keeping 200 days of data) [2025-10-22T18:01:12.696952] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-22T18:01:12.718701] [DEBUG] [LOCAL ] CMU: Primary data saved (6348 records). [2025-10-22T18:01:12.718814] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-22T18:01:12.718896] [INFO ] [MAIN ] Update Progress: 488/2367 symbols completed. CMU took 29.4s. Estimated remaining: 3h 55m 24s. Rate: 8.0 symbols/min [2025-10-22T18:01:12.886488] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:12.917713] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-22T18:01:12.939606] [DEBUG] [LOCAL ] CNH: Loaded 53547 existing records from primary storage. [2025-10-22T18:01:12.939945] [INFO ] [MAIN ] CNH: Loaded 53547 existing records. [2025-10-22T18:01:13.119335] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:13.119585] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-22T18:01:13.119632] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-22T18:01:13.120045] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-22T18:01:13.120108] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-22T18:01:13.476188] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:13.717683] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-22T18:01:13.895604] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T18:01:14.517762] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-22T18:01:15.241522] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T18:01:15.245362] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-22T18:01:15.317742] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-22T18:01:15.399876] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T18:01:16.117708] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-22T18:01:16.917687] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-22T18:01:17.326283] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T18:01:17.571413] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:01:17.717674] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-22T18:01:18.439828] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T18:01:18.517617] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-22T18:01:19.317705] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-22T18:01:19.431509] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T18:01:19.670908] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-22T18:01:20.074496] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:01:20.117690] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-22T18:01:20.917721] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-22T18:01:21.566947] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:01:21.717706] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-22T18:01:22.517731] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-22T18:01:23.300339] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T18:01:23.317677] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-22T18:01:23.564468] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-22T18:01:23.597488] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T18:01:23.706519] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-22T18:01:24.117719] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-22T18:01:24.917718] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-22T18:01:25.717734] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-22T18:01:25.901384] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T18:01:25.947359] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T18:01:26.517709] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-22T18:01:27.317708] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-22T18:01:27.945876] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T18:01:28.034343] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-22T18:01:28.117716] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-22T18:01:28.917667] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-22T18:01:29.116563] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T18:01:29.419952] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T18:01:29.717712] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-22T18:01:30.517776] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-22T18:01:31.186629] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-22T18:01:31.317689] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-22T18:01:31.518461] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T18:01:31.655831] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-22T18:01:31.664398] [INFO ] [REMOTE ] CNA: Full fetch complete (46142 records). [2025-10-22T18:01:31.664597] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-22T18:01:32.082813] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-22T18:01:32.082932] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-22T18:01:32.083553] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-22T18:01:32.083616] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-22T18:01:32.084693] [DEBUG] [LOCAL ] CNA: Trimmed 46142 records to 32534 (keeping 200 days of data) [2025-10-22T18:01:32.136260] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-22T18:01:32.206960] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T18:01:32.227833] [INFO ] [REMOTE ] CNC: Full fetch complete (77861 records). [2025-10-22T18:01:32.230301] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-22T18:01:32.732595] [DEBUG] [LOCAL ] CNA: Primary data saved (32534 records). [2025-10-22T18:01:32.752947] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-22T18:01:32.772479] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-22T18:01:32.772565] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-22T18:01:32.773628] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-22T18:01:32.773730] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-22T18:01:32.772723] [INFO ] [MAIN ] Update Progress: 489/2367 symbols completed. CNA took 34.6s. Estimated remaining: 3h 56m 4s. Rate: 8.0 symbols/min [2025-10-22T18:01:32.879850] [DEBUG] [LOCAL ] CNC: Trimmed 77861 records to 53779 (keeping 200 days of data) [2025-10-22T18:01:32.922564] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-22T18:01:33.099021] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:33.292977] [DEBUG] [LOCAL ] CNI: Loaded 51658 existing records from primary storage. [2025-10-22T18:01:33.337480] [INFO ] [MAIN ] CNI: Loaded 51658 existing records. [2025-10-22T18:01:33.594218] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:33.596083] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-22T18:01:33.596532] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-22T18:01:33.597496] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-22T18:01:33.597909] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-22T18:01:33.721538] [DEBUG] [LOCAL ] CNC: Primary data saved (53779 records). [2025-10-22T18:01:33.737274] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-22T18:01:33.762443] [INFO ] [MAIN ] Update Progress: 490/2367 symbols completed. CNC took 34.5s. Estimated remaining: 3h 55m 32s. Rate: 8.0 symbols/min [2025-10-22T18:01:34.169397] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:34.180146] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:34.180966] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-22T18:01:34.183199] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:01:34.220557] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T18:01:34.268759] [DEBUG] [LOCAL ] CNK: Loaded 52908 existing records from primary storage. [2025-10-22T18:01:34.269071] [INFO ] [MAIN ] CNK: Loaded 52908 existing records. [2025-10-22T18:01:34.444179] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:34.444392] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-22T18:01:34.444439] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-22T18:01:34.444886] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-22T18:01:34.444941] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-22T18:01:34.522851] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-22T18:01:34.801020] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:35.317732] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-22T18:01:36.072316] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:01:36.117676] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-22T18:01:36.319109] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T18:01:36.352238] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T18:01:36.917732] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-22T18:01:37.717752] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-22T18:01:37.801354] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:01:38.517675] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-22T18:01:38.733365] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T18:01:39.317767] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-22T18:01:39.483260] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:01:40.117691] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-22T18:01:40.276750] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T18:01:40.526907] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-22T18:01:40.917741] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-22T18:01:41.717686] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-22T18:01:41.880029] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T18:01:42.517726] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-22T18:01:42.790613] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T18:01:42.807445] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T18:01:42.809459] [INFO ] [REMOTE ] CNF: Full fetch complete (12986 records). [2025-10-22T18:01:42.809530] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-22T18:01:42.809976] [FATAL] [VALIDATOR ] CNF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:01:42.810059] [FATAL] [MAIN ] CNF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:01:42.810104] [WARN ] [MAIN ] CNF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:01:42.810146] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-22T18:01:42.810202] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-22T18:01:42.810238] [INFO ] [LOCAL ] CNF: Starting deletion of derivative data. [2025-10-22T18:01:42.810382] [DEBUG] [LOCAL ] CNF: Deleted derivative data file. [2025-10-22T18:01:42.810469] [INFO ] [MAIN ] Update Progress: 491/2367 symbols completed. CNF took 31.4s. Estimated remaining: 3h 55m 30s. Rate: 8.0 symbols/min [2025-10-22T18:01:43.007953] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:43.057803] [DEBUG] [LOCAL ] CNM: Loaded 51017 existing records from primary storage. [2025-10-22T18:01:43.058143] [INFO ] [MAIN ] CNM: Loaded 51017 existing records. [2025-10-22T18:01:43.236888] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:43.237126] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-22T18:01:43.237172] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-22T18:01:43.237443] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-22T18:01:43.237480] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-22T18:01:43.322868] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-22T18:01:43.602387] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:44.117697] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-22T18:01:44.410260] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T18:01:44.917713] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-22T18:01:45.214752] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T18:01:45.717699] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-22T18:01:46.175277] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T18:01:46.188690] [INFO ] [REMOTE ] CNH: Full fetch complete (77315 records). [2025-10-22T18:01:46.188876] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-22T18:01:46.189852] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:01:46.189961] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:01:46.190016] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:01:46.190094] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-22T18:01:46.190187] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-22T18:01:46.190255] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-22T18:01:46.190420] [DEBUG] [LOCAL ] CNH: Deleted derivative data file. [2025-10-22T18:01:46.190526] [INFO ] [MAIN ] Update Progress: 492/2367 symbols completed. CNH took 33.5s. Estimated remaining: 3h 55m 7s. Rate: 8.0 symbols/min [2025-10-22T18:01:46.383078] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:46.416707] [DEBUG] [LOCAL ] CNMD: Loaded 32081 existing records from primary storage. [2025-10-22T18:01:46.417248] [INFO ] [MAIN ] CNMD: Loaded 32081 existing records. [2025-10-22T18:01:46.518549] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-22T18:01:46.616757] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:46.617347] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-22T18:01:46.617417] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-22T18:01:46.617796] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-22T18:01:46.617856] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-22T18:01:46.870588] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T18:01:47.026906] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:47.317763] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-22T18:01:47.432761] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:01:48.117718] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-22T18:01:48.335177] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T18:01:48.807188] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T18:01:48.917688] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-22T18:01:49.551615] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:01:49.717699] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-22T18:01:49.887698] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T18:01:50.517711] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-22T18:01:51.317696] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-22T18:01:51.558624] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:01:52.041823] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T18:01:52.117719] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-22T18:01:52.695589] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T18:01:52.917719] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-22T18:01:53.644872] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:01:53.717691] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-22T18:01:54.517723] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-22T18:01:54.612947] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T18:01:54.672946] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T18:01:55.317722] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-22T18:01:56.117698] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-22T18:01:56.406742] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T18:01:56.917702] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-22T18:01:57.042044] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:01:57.470748] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:01:57.717698] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-22T18:01:58.517722] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-22T18:01:58.656841] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T18:01:59.278680] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:01:59.317673] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-22T18:02:00.117726] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-22T18:02:00.377337] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T18:02:00.917694] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-22T18:02:01.458659] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-22T18:02:01.650735] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T18:02:01.717692] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-22T18:02:02.517754] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-22T18:02:02.909973] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T18:02:03.317668] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-22T18:02:03.636409] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T18:02:03.918908] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T18:02:04.117682] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-22T18:02:04.917725] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-22T18:02:05.288907] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T18:02:05.297126] [INFO ] [REMOTE ] CNI: Full fetch complete (74858 records). [2025-10-22T18:02:05.297236] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-22T18:02:05.682451] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-22T18:02:05.682566] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-22T18:02:05.683409] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-22T18:02:05.683473] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-22T18:02:05.684945] [DEBUG] [LOCAL ] CNI: Trimmed 74858 records to 51658 (keeping 200 days of data) [2025-10-22T18:02:05.748269] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-22T18:02:06.033221] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T18:02:06.061337] [DEBUG] [LOCAL ] CNI: Primary data saved (51658 records). [2025-10-22T18:02:06.061488] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-22T18:02:06.061572] [INFO ] [MAIN ] Update Progress: 493/2367 symbols completed. CNI took 33.3s. Estimated remaining: 3h 55m 46s. Rate: 7.9 symbols/min [2025-10-22T18:02:06.232382] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:06.272978] [DEBUG] [LOCAL ] CNNE: Loaded 35869 existing records from primary storage. [2025-10-22T18:02:06.273283] [INFO ] [MAIN ] CNNE: Loaded 35869 existing records. [2025-10-22T18:02:06.531237] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:02:06.531524] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-22T18:02:06.527000] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-22T18:02:06.531609] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-22T18:02:06.532171] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-22T18:02:06.532255] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-22T18:02:06.930138] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:02:06.946569] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T18:02:07.168958] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:07.317715] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-22T18:02:08.122712] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-22T18:02:08.138810] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T18:02:08.149557] [INFO ] [REMOTE ] CNK: Full fetch complete (76278 records). [2025-10-22T18:02:08.149724] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-22T18:02:08.533600] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-22T18:02:08.533706] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-22T18:02:08.534524] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-22T18:02:08.534585] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-22T18:02:08.536010] [DEBUG] [LOCAL ] CNK: Trimmed 76278 records to 52908 (keeping 200 days of data) [2025-10-22T18:02:08.853043] [DEBUG] [LOCAL ] CNK: Primary data saved (52908 records). [2025-10-22T18:02:08.853256] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-22T18:02:08.853345] [INFO ] [MAIN ] Update Progress: 494/2367 symbols completed. CNK took 35.1s. Estimated remaining: 3h 55m 20s. Rate: 8.0 symbols/min [2025-10-22T18:02:08.927228] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-22T18:02:09.024717] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:09.054687] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T18:02:09.097223] [DEBUG] [LOCAL ] CNO: Loaded 40420 existing records from primary storage. [2025-10-22T18:02:09.097495] [INFO ] [MAIN ] CNO: Loaded 40420 existing records. [2025-10-22T18:02:09.271515] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:02:09.271765] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-22T18:02:09.271814] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-22T18:02:09.271999] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-22T18:02:09.272037] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-22T18:02:09.631815] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T18:02:09.636684] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:09.717615] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-22T18:02:10.503605] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T18:02:10.508758] [INFO ] [REMOTE ] CNMD: Full fetch complete (47370 records). [2025-10-22T18:02:10.508853] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-22T18:02:10.522850] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-22T18:02:10.888541] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-22T18:02:10.888662] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-22T18:02:10.889442] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-22T18:02:10.889545] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-22T18:02:10.890625] [DEBUG] [LOCAL ] CNMD: Trimmed 47370 records to 32058 (keeping 200 days of data) [2025-10-22T18:02:11.096771] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T18:02:11.124586] [DEBUG] [LOCAL ] CNMD: Primary data saved (32058 records). [2025-10-22T18:02:11.124791] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-22T18:02:11.124875] [INFO ] [MAIN ] Update Progress: 495/2367 symbols completed. CNMD took 24.9s. Estimated remaining: 3h 54m 53s. Rate: 8.0 symbols/min [2025-10-22T18:02:11.292689] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:11.292880] [DEBUG] [LOCAL ] CNP: No existing data file found in primary storage. [2025-10-22T18:02:11.292918] [WARN ] [MAIN ] CNP: No existing data found, performing full refresh instead. [2025-10-22T18:02:11.293028] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-22T18:02:11.293068] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-22T18:02:11.293109] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-10-22T18:02:11.293139] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-22T18:02:11.323907] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-22T18:02:11.646900] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:12.117721] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-22T18:02:12.298840] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T18:02:12.569303] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T18:02:12.917847] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-22T18:02:13.717784] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-22T18:02:13.805442] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T18:02:14.479136] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T18:02:14.517761] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-22T18:02:15.090768] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T18:02:15.317747] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-22T18:02:15.896979] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T18:02:16.117707] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-22T18:02:16.917881] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-22T18:02:17.163034] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T18:02:17.171294] [INFO ] [REMOTE ] CNM: Full fetch complete (73397 records). [2025-10-22T18:02:17.171446] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-22T18:02:17.172290] [FATAL] [VALIDATOR ] CNM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:02:17.172385] [FATAL] [MAIN ] CNM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:02:17.172462] [WARN ] [MAIN ] CNM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:02:17.172548] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-22T18:02:17.172630] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-10-22T18:02:17.172724] [INFO ] [LOCAL ] CNM: Starting deletion of derivative data. [2025-10-22T18:02:17.172932] [DEBUG] [LOCAL ] CNM: Deleted derivative data file. [2025-10-22T18:02:17.173631] [INFO ] [MAIN ] Update Progress: 496/2367 symbols completed. CNM took 34.4s. Estimated remaining: 3h 54m 40s. Rate: 8.0 symbols/min [2025-10-22T18:02:17.359268] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:17.414122] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-10-22T18:02:17.414450] [INFO ] [MAIN ] CNQ: Loaded 53582 existing records. [2025-10-22T18:02:17.616240] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:02:17.616441] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-22T18:02:17.616489] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-22T18:02:17.616721] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-22T18:02:17.616778] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-22T18:02:17.722761] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-22T18:02:18.037494] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:18.098410] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T18:02:18.101389] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T18:02:18.517736] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-22T18:02:19.317720] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-22T18:02:19.473828] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T18:02:19.924529] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T18:02:20.117745] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-22T18:02:20.917988] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-22T18:02:21.156559] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T18:02:21.717907] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-22T18:02:21.984216] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T18:02:22.354906] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T18:02:22.517743] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-22T18:02:23.317716] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-22T18:02:23.422185] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:02:24.117686] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-22T18:02:24.484202] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T18:02:24.930066] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-22T18:02:24.935144] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T18:02:25.717712] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-22T18:02:25.930821] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T18:02:26.517726] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-22T18:02:26.790574] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T18:02:27.317709] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-22T18:02:27.422484] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T18:02:28.117724] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-22T18:02:28.422009] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T18:02:28.917742] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-22T18:02:29.058100] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:02:29.628387] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T18:02:29.717701] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-22T18:02:30.517686] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-22T18:02:30.939129] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-22T18:02:31.133701] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T18:02:31.317708] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-22T18:02:31.964173] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T18:02:32.117689] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-22T18:02:32.844299] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:02:32.849976] [INFO ] [REMOTE ] CNNE: Full fetch complete (50332 records). [2025-10-22T18:02:32.850126] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-22T18:02:32.850801] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:02:32.850890] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:02:32.850946] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:02:32.851034] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-22T18:02:32.851113] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-22T18:02:32.851163] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-10-22T18:02:32.851312] [DEBUG] [LOCAL ] CNNE: Deleted derivative data file. [2025-10-22T18:02:32.851410] [INFO ] [MAIN ] Update Progress: 497/2367 symbols completed. CNNE took 26.8s. Estimated remaining: 3h 55m 3s. Rate: 8.0 symbols/min [2025-10-22T18:02:32.922830] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-22T18:02:33.047039] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:33.047274] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-22T18:02:33.047329] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-22T18:02:33.047441] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-22T18:02:33.047484] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-22T18:02:33.047526] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-22T18:02:33.047558] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-22T18:02:33.396235] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:33.636909] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T18:02:33.717728] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-22T18:02:34.522746] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-22T18:02:34.538917] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T18:02:35.317760] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-22T18:02:35.640796] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T18:02:35.679489] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T18:02:36.117715] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-22T18:02:36.917698] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-22T18:02:37.288899] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T18:02:37.493281] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T18:02:37.717683] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-22T18:02:38.472395] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:02:38.517676] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-22T18:02:39.317695] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-22T18:02:39.544398] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T18:02:40.117712] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-22T18:02:40.569912] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-22T18:02:40.917706] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-22T18:02:41.206927] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T18:02:41.567721] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:02:41.717730] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-22T18:02:42.517757] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-22T18:02:42.812440] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T18:02:42.822574] [INFO ] [REMOTE ] CNP: Full fetch complete (77549 records). [2025-10-22T18:02:42.822786] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-22T18:02:43.169620] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T18:02:43.283362] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-22T18:02:43.283462] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-22T18:02:43.284489] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-22T18:02:43.284560] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-22T18:02:43.286148] [DEBUG] [LOCAL ] CNP: Trimmed 77549 records to 53475 (keeping 200 days of data) [2025-10-22T18:02:43.342043] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-22T18:02:43.631195] [DEBUG] [LOCAL ] CNP: Primary data saved (53475 records). [2025-10-22T18:02:43.631341] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-22T18:02:43.631420] [INFO ] [MAIN ] Update Progress: 498/2367 symbols completed. CNP took 32.5s. Estimated remaining: 3h 55m 8s. Rate: 7.9 symbols/min [2025-10-22T18:02:43.813815] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:43.814066] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-22T18:02:43.814121] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-22T18:02:43.814427] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-22T18:02:43.814490] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-22T18:02:43.814533] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-22T18:02:43.814565] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-22T18:02:44.117898] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-22T18:02:44.200542] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:44.225990] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T18:02:44.707679] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T18:02:44.714354] [INFO ] [REMOTE ] CNO: Full fetch complete (60821 records). [2025-10-22T18:02:44.714514] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-22T18:02:44.930261] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-22T18:02:45.151892] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-22T18:02:45.151972] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-22T18:02:45.152700] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-22T18:02:45.152767] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-22T18:02:45.154041] [DEBUG] [LOCAL ] CNO: Trimmed 60821 records to 40344 (keeping 200 days of data) [2025-10-22T18:02:45.403521] [DEBUG] [LOCAL ] CNO: Primary data saved (40344 records). [2025-10-22T18:02:45.403680] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-22T18:02:45.403774] [INFO ] [MAIN ] Update Progress: 499/2367 symbols completed. CNO took 36.6s. Estimated remaining: 3h 54m 38s. Rate: 8.0 symbols/min [2025-10-22T18:02:45.588129] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:45.639922] [DEBUG] [LOCAL ] CNX: Loaded 51346 existing records from primary storage. [2025-10-22T18:02:45.640304] [INFO ] [MAIN ] CNX: Loaded 51346 existing records. [2025-10-22T18:02:45.723117] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-22T18:02:45.843176] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:02:45.843565] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-22T18:02:45.843759] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-22T18:02:45.844118] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-22T18:02:45.844164] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-22T18:02:46.002968] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T18:02:46.275145] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:46.517720] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-22T18:02:46.769805] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:02:47.078725] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T18:02:47.317711] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-22T18:02:48.130597] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-22T18:02:48.136736] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T18:02:48.917682] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-22T18:02:48.952235] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T18:02:49.717727] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-22T18:02:49.995352] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T18:02:50.021438] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T18:02:50.030791] [INFO ] [REMOTE ] CNQ: Full fetch complete (77741 records). [2025-10-22T18:02:50.030912] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-22T18:02:50.442821] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-22T18:02:50.442890] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-22T18:02:50.443847] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-22T18:02:50.443924] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-22T18:02:50.445470] [DEBUG] [LOCAL ] CNQ: Trimmed 77741 records to 53582 (keeping 200 days of data) [2025-10-22T18:02:50.534772] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-22T18:02:50.769941] [DEBUG] [LOCAL ] CNQ: Primary data saved (53582 records). [2025-10-22T18:02:50.770068] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-22T18:02:50.770725] [INFO ] [MAIN ] Update Progress: 500/2367 symbols completed. CNQ took 33.6s. Estimated remaining: 3h 54m 23s. Rate: 8.0 symbols/min [2025-10-22T18:02:50.944034] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:51.015748] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T18:02:51.040175] [DEBUG] [LOCAL ] CODI: Loaded 41906 existing records from primary storage. [2025-10-22T18:02:51.040467] [INFO ] [MAIN ] CODI: Loaded 41906 existing records. [2025-10-22T18:02:51.220132] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:02:51.220351] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-22T18:02:51.220414] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-22T18:02:51.220705] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-22T18:02:51.220777] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-22T18:02:51.321205] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-22T18:02:51.578031] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:51.679285] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T18:02:52.117712] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-22T18:02:52.917699] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-22T18:02:52.998519] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:02:53.364046] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T18:02:53.717639] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-22T18:02:54.114028] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T18:02:54.517695] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-22T18:02:54.777544] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T18:02:55.317696] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-22T18:02:55.935592] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T18:02:56.117751] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-22T18:02:56.587076] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T18:02:56.917754] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-22T18:02:57.717707] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-22T18:02:57.788138] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T18:02:57.920956] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T18:02:58.517733] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-22T18:02:59.317691] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-22T18:02:59.361883] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:02:59.504262] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T18:03:00.117725] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-22T18:03:00.917678] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-22T18:03:01.168956] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:03:01.462956] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T18:03:01.717714] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-22T18:03:02.387320] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T18:03:02.517736] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-22T18:03:03.317729] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-22T18:03:03.534141] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T18:03:04.117735] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-22T18:03:04.248135] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T18:03:04.255431] [INFO ] [REMOTE ] CNR: Full fetch complete (62554 records). [2025-10-22T18:03:04.255611] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-22T18:03:04.256450] [FATAL] [VALIDATOR ] CNR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:03:04.256535] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:03:04.256602] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:03:04.256782] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-22T18:03:04.256862] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-22T18:03:04.256901] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-22T18:03:04.256941] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-22T18:03:04.256998] [INFO ] [MAIN ] Update Progress: 501/2367 symbols completed. CNR took 31.4s. Estimated remaining: 3h 54m 37s. Rate: 8.0 symbols/min [2025-10-22T18:03:04.425505] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:04.425695] [DEBUG] [LOCAL ] COF: No existing data file found in primary storage. [2025-10-22T18:03:04.425748] [WARN ] [MAIN ] COF: No existing data found, performing full refresh instead. [2025-10-22T18:03:04.425865] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-22T18:03:04.425906] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-22T18:03:04.425948] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-10-22T18:03:04.425981] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-22T18:03:04.785921] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:04.808370] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T18:03:04.917710] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-22T18:03:05.180086] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T18:03:05.717713] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-22T18:03:06.517677] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-22T18:03:06.767043] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T18:03:06.875212] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T18:03:07.317718] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-22T18:03:08.117690] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-22T18:03:08.360635] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T18:03:08.537518] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:03:08.917716] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-22T18:03:09.717744] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-22T18:03:09.782165] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T18:03:10.517765] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-22T18:03:10.663681] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T18:03:11.317687] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-22T18:03:11.635097] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T18:03:11.893328] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T18:03:11.899926] [INFO ] [REMOTE ] CNS: Full fetch complete (31113 records). [2025-10-22T18:03:11.900057] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-22T18:03:11.900757] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:03:11.900862] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:03:11.900925] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:03:11.900980] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-22T18:03:11.901053] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-22T18:03:11.901101] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-22T18:03:11.901158] [DEBUG] [LOCAL ] CNS: No derivative data file found to delete. [2025-10-22T18:03:11.901233] [INFO ] [MAIN ] Update Progress: 502/2367 symbols completed. CNS took 28.3s. Estimated remaining: 3h 54m 30s. Rate: 8.0 symbols/min [2025-10-22T18:03:12.080742] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:12.128704] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-22T18:03:12.131599] [DEBUG] [LOCAL ] COHR: Loaded 53377 existing records from primary storage. [2025-10-22T18:03:12.132054] [INFO ] [MAIN ] COHR: Loaded 53377 existing records. [2025-10-22T18:03:12.307757] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:12.307973] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-22T18:03:12.308019] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-22T18:03:12.308209] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-22T18:03:12.308248] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-22T18:03:12.656508] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:12.925486] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-22T18:03:12.951709] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:03:13.717734] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-22T18:03:13.959033] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T18:03:14.517674] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-22T18:03:14.619792] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T18:03:15.317690] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-22T18:03:15.489482] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:03:16.117735] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-22T18:03:16.806510] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-22T18:03:16.917703] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-22T18:03:17.271081] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T18:03:17.717696] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-22T18:03:17.814144] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T18:03:17.822260] [INFO ] [REMOTE ] CNX: Full fetch complete (74571 records). [2025-10-22T18:03:17.822409] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-22T18:03:17.823235] [FATAL] [VALIDATOR ] CNX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:03:17.823355] [FATAL] [MAIN ] CNX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:03:17.823399] [WARN ] [MAIN ] CNX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:03:17.823438] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-22T18:03:17.823494] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-22T18:03:17.823528] [INFO ] [LOCAL ] CNX: Starting deletion of derivative data. [2025-10-22T18:03:17.823713] [DEBUG] [LOCAL ] CNX: Deleted derivative data file. [2025-10-22T18:03:17.823803] [INFO ] [MAIN ] Update Progress: 503/2367 symbols completed. CNX took 32.4s. Estimated remaining: 3h 54m 17s. Rate: 8.0 symbols/min [2025-10-22T18:03:18.002456] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:18.002743] [DEBUG] [LOCAL ] COLD: No existing data file found in primary storage. [2025-10-22T18:03:18.002803] [WARN ] [MAIN ] COLD: No existing data found, performing full refresh instead. [2025-10-22T18:03:18.002920] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-22T18:03:18.002963] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-22T18:03:18.003003] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-22T18:03:18.003078] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-22T18:03:18.380208] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:18.517741] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-22T18:03:18.887939] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T18:03:19.186466] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T18:03:19.317759] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-22T18:03:20.117731] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-22T18:03:20.513156] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T18:03:20.917683] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-22T18:03:21.392561] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T18:03:21.717705] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-22T18:03:22.117391] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T18:03:22.125613] [INFO ] [REMOTE ] CODI: Full fetch complete (53805 records). [2025-10-22T18:03:22.125856] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-22T18:03:22.525956] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-22T18:03:22.543850] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-22T18:03:22.544914] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-22T18:03:22.545706] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-22T18:03:22.545815] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-22T18:03:22.547149] [DEBUG] [LOCAL ] CODI: Trimmed 53805 records to 41954 (keeping 200 days of data) [2025-10-22T18:03:22.738831] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T18:03:22.827790] [DEBUG] [LOCAL ] CODI: Primary data saved (41954 records). [2025-10-22T18:03:22.827924] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-22T18:03:22.828494] [INFO ] [MAIN ] Update Progress: 504/2367 symbols completed. CODI took 32.1s. Estimated remaining: 3h 53m 60s. Rate: 8.0 symbols/min [2025-10-22T18:03:22.998005] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:23.048424] [DEBUG] [LOCAL ] COMP: Loaded 53404 existing records from primary storage. [2025-10-22T18:03:23.048775] [INFO ] [MAIN ] COMP: Loaded 53404 existing records. [2025-10-22T18:03:23.224228] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:23.224504] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-22T18:03:23.224578] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-22T18:03:23.225221] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-22T18:03:23.225290] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-22T18:03:23.325432] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-22T18:03:23.668142] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T18:03:23.719509] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:24.117707] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-22T18:03:24.521820] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-22T18:03:24.917707] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-22T18:03:25.010612] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T18:03:25.717763] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-22T18:03:26.082774] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T18:03:26.517761] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-22T18:03:26.911447] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T18:03:27.317694] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-22T18:03:27.469396] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:03:28.117707] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-22T18:03:28.310880] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T18:03:28.917717] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-22T18:03:29.169962] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T18:03:29.717735] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-22T18:03:30.171798] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-22T18:03:30.517729] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-22T18:03:30.749861] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T18:03:31.317732] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-22T18:03:31.392736] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:03:32.117781] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-22T18:03:32.280499] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T18:03:32.917677] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-22T18:03:33.316047] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T18:03:33.717748] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-22T18:03:34.109825] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T18:03:34.517708] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-22T18:03:34.864788] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T18:03:35.317693] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-22T18:03:35.655991] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T18:03:36.117727] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-22T18:03:36.379787] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T18:03:36.917749] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-22T18:03:37.557207] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-22T18:03:37.717700] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-22T18:03:37.905422] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T18:03:38.243014] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T18:03:38.517707] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-22T18:03:39.317747] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-22T18:03:39.659035] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T18:03:39.667262] [INFO ] [REMOTE ] COHR: Full fetch complete (77076 records). [2025-10-22T18:03:39.667432] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-22T18:03:39.668328] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:03:39.668434] [FATAL] [MAIN ] COHR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:03:39.668501] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:03:39.668575] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-22T18:03:39.668664] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-22T18:03:39.668723] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-22T18:03:39.668953] [DEBUG] [LOCAL ] COHR: Deleted derivative data file. [2025-10-22T18:03:39.669045] [INFO ] [MAIN ] Update Progress: 505/2367 symbols completed. COHR took 27.8s. Estimated remaining: 3h 54m 27s. Rate: 7.9 symbols/min [2025-10-22T18:03:39.833898] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:39.868319] [DEBUG] [LOCAL ] CON: Loaded 38811 existing records from primary storage. [2025-10-22T18:03:39.868590] [INFO ] [MAIN ] CON: Loaded 38811 existing records. [2025-10-22T18:03:40.041976] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:40.042205] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-22T18:03:40.042254] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-22T18:03:40.043160] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-22T18:03:40.043218] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-22T18:03:40.121704] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-22T18:03:40.421603] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:40.457276] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T18:03:40.917686] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-22T18:03:41.021312] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T18:03:41.141495] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T18:03:41.150264] [INFO ] [REMOTE ] COF: Full fetch complete (77705 records). [2025-10-22T18:03:41.150396] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-22T18:03:41.555430] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-22T18:03:41.555517] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-22T18:03:41.556357] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-22T18:03:41.556424] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-22T18:03:41.557924] [DEBUG] [LOCAL ] COF: Trimmed 77705 records to 53625 (keeping 200 days of data) [2025-10-22T18:03:41.737564] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-22T18:03:41.888908] [DEBUG] [LOCAL ] COF: Primary data saved (53625 records). [2025-10-22T18:03:41.889044] [INFO ] [MAIN ] COF: Full history saved. [2025-10-22T18:03:41.889114] [INFO ] [MAIN ] Update Progress: 506/2367 symbols completed. COF took 37.6s. Estimated remaining: 3h 53m 59s. Rate: 8.0 symbols/min [2025-10-22T18:03:42.057234] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:42.080185] [DEBUG] [LOCAL ] COOK: Loaded 24899 existing records from primary storage. [2025-10-22T18:03:42.080405] [INFO ] [MAIN ] COOK: Loaded 24899 existing records. [2025-10-22T18:03:42.254673] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:42.254911] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-22T18:03:42.254959] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-22T18:03:42.255123] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-22T18:03:42.255161] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-22T18:03:42.521364] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-22T18:03:42.619165] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:42.646548] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T18:03:43.317705] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-22T18:03:43.513238] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T18:03:44.117747] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-22T18:03:44.436576] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T18:03:44.917705] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-22T18:03:44.958126] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-22T18:03:45.463460] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T18:03:45.717673] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-22T18:03:45.772516] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T18:03:46.517752] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-22T18:03:47.247223] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:03:47.317710] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-22T18:03:48.107973] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T18:03:48.118834] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-22T18:03:48.796859] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T18:03:48.917715] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-22T18:03:49.185055] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T18:03:49.717701] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-22T18:03:50.517725] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-22T18:03:50.633124] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T18:03:50.642023] [INFO ] [REMOTE ] COLD: Full fetch complete (74866 records). [2025-10-22T18:03:50.642150] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-22T18:03:50.903031] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T18:03:51.105069] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-22T18:03:51.105153] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-22T18:03:51.105983] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-22T18:03:51.106043] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-22T18:03:51.107392] [DEBUG] [LOCAL ] COLD: Trimmed 74866 records to 52485 (keeping 200 days of data) [2025-10-22T18:03:51.317692] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-22T18:03:51.417949] [DEBUG] [LOCAL ] COLD: Primary data saved (52485 records). [2025-10-22T18:03:51.418080] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-22T18:03:51.418149] [INFO ] [MAIN ] Update Progress: 507/2367 symbols completed. COLD took 33.6s. Estimated remaining: 3h 53m 59s. Rate: 7.9 symbols/min [2025-10-22T18:03:51.583773] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:51.629758] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-22T18:03:51.630064] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-22T18:03:51.809143] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:51.809391] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-22T18:03:51.809461] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-22T18:03:51.809693] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-22T18:03:51.809748] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-22T18:03:52.121880] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-22T18:03:52.181779] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:52.216204] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T18:03:52.465445] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T18:03:52.917689] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-22T18:03:53.717742] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-22T18:03:53.740848] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T18:03:54.006870] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T18:03:54.517695] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-22T18:03:55.228737] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T18:03:55.317723] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-22T18:03:55.592553] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T18:03:56.117687] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-22T18:03:56.450692] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T18:03:56.917730] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-22T18:03:57.717636] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-22T18:03:58.056808] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T18:03:58.066533] [INFO ] [REMOTE ] COMP: Full fetch complete (77407 records). [2025-10-22T18:03:58.066779] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-22T18:03:58.401958] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T18:03:58.519108] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-22T18:03:58.539481] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-22T18:03:58.539559] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-22T18:03:58.540579] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-22T18:03:58.540777] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-22T18:03:58.542477] [DEBUG] [LOCAL ] COMP: Trimmed 77407 records to 53404 (keeping 200 days of data) [2025-10-22T18:03:58.842448] [DEBUG] [LOCAL ] COMP: Primary data saved (53404 records). [2025-10-22T18:03:58.842586] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-22T18:03:58.843205] [INFO ] [MAIN ] Update Progress: 508/2367 symbols completed. COMP took 36.0s. Estimated remaining: 3h 53m 51s. Rate: 7.9 symbols/min [2025-10-22T18:03:59.028715] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:59.029813] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T18:03:59.079619] [DEBUG] [LOCAL ] COR: Loaded 46340 existing records from primary storage. [2025-10-22T18:03:59.079970] [INFO ] [MAIN ] COR: Loaded 46340 existing records. [2025-10-22T18:03:59.250752] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:59.250961] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-22T18:03:59.251009] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-22T18:03:59.251201] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-22T18:03:59.251239] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-22T18:03:59.322814] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-22T18:03:59.596171] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:00.117714] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-22T18:04:00.672742] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-22T18:04:00.879404] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T18:04:00.917661] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-22T18:04:01.621038] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T18:04:01.717677] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-22T18:04:02.138438] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:04:02.517710] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-22T18:04:03.013887] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T18:04:03.018300] [INFO ] [REMOTE ] COOK: Full fetch complete (33095 records). [2025-10-22T18:04:03.018373] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-22T18:04:03.322795] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-22T18:04:03.384571] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-22T18:04:03.384681] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-22T18:04:03.385210] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-22T18:04:03.385253] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-22T18:04:03.386083] [DEBUG] [LOCAL ] COOK: Trimmed 33095 records to 24851 (keeping 200 days of data) [2025-10-22T18:04:03.519150] [DEBUG] [LOCAL ] COOK: Primary data saved (24851 records). [2025-10-22T18:04:03.519278] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-22T18:04:03.519356] [INFO ] [MAIN ] Update Progress: 509/2367 symbols completed. COOK took 21.6s. Estimated remaining: 3h 53m 33s. Rate: 8.0 symbols/min [2025-10-22T18:04:03.688736] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:03.688932] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-10-22T18:04:03.688978] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-10-22T18:04:03.689098] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-22T18:04:03.689138] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-22T18:04:03.689178] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-22T18:04:03.689210] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-22T18:04:04.058411] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T18:04:04.057396] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:04.064710] [INFO ] [REMOTE ] CON: Full fetch complete (56411 records). [2025-10-22T18:04:04.064789] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-22T18:04:04.065356] [FATAL] [VALIDATOR ] CON: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:04:04.065439] [FATAL] [MAIN ] CON: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:04:04.065481] [WARN ] [MAIN ] CON: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:04:04.065543] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-22T18:04:04.065612] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-22T18:04:04.065706] [INFO ] [LOCAL ] CON: Starting deletion of derivative data. [2025-10-22T18:04:04.065862] [DEBUG] [LOCAL ] CON: Deleted derivative data file. [2025-10-22T18:04:04.065947] [INFO ] [MAIN ] Update Progress: 510/2367 symbols completed. CON took 24.4s. Estimated remaining: 3h 53m 0s. Rate: 8.0 symbols/min [2025-10-22T18:04:04.128228] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-22T18:04:04.235053] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:04.235215] [DEBUG] [LOCAL ] COUR: No existing data file found in primary storage. [2025-10-22T18:04:04.235253] [WARN ] [MAIN ] COUR: No existing data found, performing full refresh instead. [2025-10-22T18:04:04.235361] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-22T18:04:04.235402] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-22T18:04:04.235445] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-22T18:04:04.235475] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-22T18:04:04.576954] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:04.917711] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-22T18:04:05.137361] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T18:04:05.717720] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-22T18:04:05.991443] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:04:06.517673] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-22T18:04:06.833728] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T18:04:07.317721] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-22T18:04:07.776446] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T18:04:08.117781] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-22T18:04:08.301435] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T18:04:08.424275] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T18:04:08.917743] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-22T18:04:09.717755] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-22T18:04:10.010438] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:04:10.517735] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-22T18:04:11.271958] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-22T18:04:11.317719] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-22T18:04:11.393693] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:04:12.117698] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-22T18:04:12.167988] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T18:04:12.917671] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-22T18:04:13.461888] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T18:04:13.717717] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-22T18:04:13.916710] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T18:04:14.443196] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:04:14.517614] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-22T18:04:15.317759] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-22T18:04:15.465145] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:04:16.117738] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-22T18:04:16.497539] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T18:04:16.917782] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-22T18:04:17.155704] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T18:04:17.717695] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-22T18:04:17.832169] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T18:04:18.212178] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T18:04:18.517752] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-22T18:04:19.317673] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-22T18:04:19.492267] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T18:04:20.119988] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-22T18:04:20.123115] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T18:04:20.579775] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:04:20.917798] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-22T18:04:21.717677] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-22T18:04:21.991499] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T18:04:22.517739] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-22T18:04:23.104134] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-22T18:04:23.317702] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-22T18:04:23.443150] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T18:04:24.117705] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-22T18:04:24.334062] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:04:24.917743] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-22T18:04:24.972668] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T18:04:25.717322] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T18:04:25.727614] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-22T18:04:26.517750] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-22T18:04:26.753686] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T18:04:27.317687] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-22T18:04:27.677563] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T18:04:28.115781] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T18:04:28.124503] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-22T18:04:28.917618] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-22T18:04:29.119214] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T18:04:29.638401] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T18:04:29.717716] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-22T18:04:30.517747] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-22T18:04:30.548545] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:04:31.317695] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-22T18:04:31.578073] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T18:04:31.586698] [INFO ] [REMOTE ] COTY: Full fetch complete (76906 records). [2025-10-22T18:04:31.586856] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-22T18:04:31.587711] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:04:31.587820] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:04:31.587896] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:04:31.587991] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-22T18:04:31.588077] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-22T18:04:31.588117] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-10-22T18:04:31.588158] [DEBUG] [LOCAL ] COTY: No derivative data file found to delete. [2025-10-22T18:04:31.588216] [INFO ] [MAIN ] Update Progress: 511/2367 symbols completed. COTY took 28.1s. Estimated remaining: 3h 54m 5s. Rate: 7.9 symbols/min [2025-10-22T18:04:31.755211] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:31.804311] [DEBUG] [LOCAL ] CP: Loaded 53233 existing records from primary storage. [2025-10-22T18:04:31.804670] [INFO ] [MAIN ] CP: Loaded 53233 existing records. [2025-10-22T18:04:31.980345] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:04:31.980566] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-22T18:04:31.980616] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-22T18:04:31.980859] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-22T18:04:31.980915] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-22T18:04:32.120535] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-22T18:04:32.330670] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:32.680110] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-22T18:04:32.917724] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-22T18:04:33.288269] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T18:04:33.717704] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-22T18:04:33.988949] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T18:04:33.996781] [INFO ] [REMOTE ] COR: Full fetch complete (68464 records). [2025-10-22T18:04:33.996981] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-22T18:04:34.388957] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-22T18:04:34.389063] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-22T18:04:34.389920] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-22T18:04:34.389987] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-22T18:04:34.391416] [DEBUG] [LOCAL ] COR: Trimmed 68464 records to 46258 (keeping 200 days of data) [2025-10-22T18:04:34.568470] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-22T18:04:34.679128] [DEBUG] [LOCAL ] COR: Primary data saved (46258 records). [2025-10-22T18:04:34.679338] [INFO ] [MAIN ] COR: Full history saved. [2025-10-22T18:04:34.679889] [INFO ] [MAIN ] Update Progress: 512/2367 symbols completed. COR took 35.8s. Estimated remaining: 3h 53m 41s. Rate: 7.9 symbols/min [2025-10-22T18:04:34.853795] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:34.854163] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-10-22T18:04:34.854323] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-10-22T18:04:34.870095] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-22T18:04:34.883143] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-22T18:04:34.883356] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-22T18:04:34.883446] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-22T18:04:34.929423] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T18:04:35.250277] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:35.317708] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-22T18:04:35.546130] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T18:04:35.554978] [INFO ] [REMOTE ] COUR: Full fetch complete (71181 records). [2025-10-22T18:04:35.555143] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-22T18:04:35.843598] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T18:04:35.892436] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-22T18:04:35.898385] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-22T18:04:36.097080] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-22T18:04:36.102320] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-22T18:04:36.108352] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-22T18:04:36.108443] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-22T18:04:36.126214] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-22T18:04:36.257994] [DEBUG] [LOCAL ] COUR: Trimmed 71181 records to 49401 (keeping 200 days of data) [2025-10-22T18:04:36.461177] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-22T18:04:36.465492] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-22T18:04:36.466464] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-22T18:04:36.475117] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-22T18:04:36.491332] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 53727 (keeping 200 days of data) [2025-10-22T18:04:36.786144] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:04:36.868501] [DEBUG] [LOCAL ] COUR: Primary data saved (49401 records). [2025-10-22T18:04:36.876150] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-22T18:04:36.903900] [INFO ] [MAIN ] Update Progress: 513/2367 symbols completed. COUR took 32.8s. Estimated remaining: 3h 53m 15s. Rate: 7.9 symbols/min [2025-10-22T18:04:36.925723] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-22T18:04:37.103694] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:37.108729] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-22T18:04:37.108792] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-22T18:04:37.108910] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-22T18:04:37.108952] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-22T18:04:37.108992] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-22T18:04:37.109023] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-22T18:04:37.334929] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-22T18:04:37.344162] [INFO ] [MAIN ] COP: Full history saved. [2025-10-22T18:04:37.359614] [INFO ] [MAIN ] Update Progress: 514/2367 symbols completed. COP took 45.9s. Estimated remaining: 3h 52m 41s. Rate: 8.0 symbols/min [2025-10-22T18:04:37.694269] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:37.720327] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-22T18:04:37.720017] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:37.751082] [DEBUG] [LOCAL ] CPAY: Loaded 30239 existing records from primary storage. [2025-10-22T18:04:37.751468] [INFO ] [MAIN ] CPAY: Loaded 30239 existing records. [2025-10-22T18:04:37.938014] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:04:37.953420] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-22T18:04:37.953582] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-22T18:04:37.954947] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-22T18:04:37.954905] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T18:04:37.955079] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-22T18:04:38.109619] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-22T18:04:38.337927] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:38.352793] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:04:38.517683] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-22T18:04:38.874807] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-22T18:04:39.317714] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-22T18:04:40.117713] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-22T18:04:40.701104] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T18:04:40.917735] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-22T18:04:41.195629] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T18:04:41.717729] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-22T18:04:42.251603] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T18:04:42.517717] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-22T18:04:43.115429] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T18:04:43.317684] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-22T18:04:43.745609] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T18:04:44.117708] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-22T18:04:44.288469] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:04:44.417125] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-22T18:04:44.917689] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-22T18:04:45.717736] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-22T18:04:46.517669] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-22T18:04:46.846612] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T18:04:47.083347] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T18:04:47.185503] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T18:04:47.317704] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-22T18:04:48.117698] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-22T18:04:48.478395] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-22T18:04:48.639011] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T18:04:48.917675] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-22T18:04:49.356518] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T18:04:49.717718] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-22T18:04:50.517667] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-22T18:04:50.948332] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T18:04:51.317683] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-22T18:04:52.117709] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-22T18:04:52.311462] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T18:04:52.828088] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T18:04:52.917674] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-22T18:04:53.032692] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T18:04:53.717704] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-22T18:04:54.080585] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-22T18:04:54.391572] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T18:04:54.517680] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-22T18:04:55.035797] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-22T18:04:55.317675] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-22T18:04:56.117731] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-22T18:04:56.627010] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T18:04:56.917720] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-22T18:04:57.129027] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T18:04:57.717716] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-22T18:04:58.360311] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T18:04:58.361350] [INFO ] [REMOTE ] CPAC: Full fetch complete (1790 records). [2025-10-22T18:04:58.361423] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-22T18:04:58.550431] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T18:04:58.550817] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:04:58.519451] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-22T18:04:58.551626] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:04:58.551723] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-22T18:04:58.551790] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-22T18:04:58.551941] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-22T18:04:58.552030] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-22T18:04:58.552123] [INFO ] [MAIN ] Update Progress: 515/2367 symbols completed. CPAC took 21.6s. Estimated remaining: 3h 53m 23s. Rate: 7.9 symbols/min [2025-10-22T18:04:58.729813] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:58.729982] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-10-22T18:04:58.730084] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-10-22T18:04:58.730314] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-22T18:04:58.730384] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-22T18:04:58.730546] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-22T18:04:58.730605] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-22T18:04:58.920107] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-22T18:04:59.133268] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:59.317691] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-22T18:04:59.766464] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T18:05:00.117752] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-22T18:05:00.917709] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-22T18:05:01.324303] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:05:01.364084] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T18:05:01.717729] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-22T18:05:02.297682] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T18:05:02.301888] [INFO ] [REMOTE ] CPA: Full fetch complete (41143 records). [2025-10-22T18:05:02.301990] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-22T18:05:02.527257] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-22T18:05:02.701532] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-22T18:05:02.701623] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-22T18:05:02.702217] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-22T18:05:02.702271] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-22T18:05:02.703341] [DEBUG] [LOCAL ] CPA: Trimmed 41143 records to 27769 (keeping 200 days of data) [2025-10-22T18:05:02.875861] [DEBUG] [LOCAL ] CPA: Primary data saved (27769 records). [2025-10-22T18:05:02.876004] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-22T18:05:02.876077] [INFO ] [MAIN ] Update Progress: 516/2367 symbols completed. CPA took 28.2s. Estimated remaining: 3h 53m 4s. Rate: 7.9 symbols/min [2025-10-22T18:05:03.041826] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:03.057171] [DEBUG] [LOCAL ] CPK: Loaded 13991 existing records from primary storage. [2025-10-22T18:05:03.057389] [INFO ] [MAIN ] CPK: Loaded 13991 existing records. [2025-10-22T18:05:03.232786] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:03.233004] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-22T18:05:03.233049] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-22T18:05:03.233200] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-22T18:05:03.233237] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-22T18:05:03.323577] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-22T18:05:03.590827] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:03.608110] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T18:05:04.117679] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-22T18:05:04.442899] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T18:05:04.450179] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T18:05:04.917706] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-22T18:05:05.011109] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T18:05:05.717696] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-22T18:05:05.898177] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T18:05:06.517722] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-22T18:05:07.155458] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T18:05:07.314376] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T18:05:07.317607] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-22T18:05:08.117712] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-22T18:05:08.236409] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T18:05:08.917748] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-22T18:05:09.468255] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T18:05:09.717722] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-22T18:05:10.517615] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-22T18:05:10.881690] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T18:05:10.990916] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T18:05:10.999576] [INFO ] [REMOTE ] CP: Full fetch complete (77304 records). [2025-10-22T18:05:10.999727] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-22T18:05:11.322741] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-22T18:05:11.402919] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-22T18:05:11.402995] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-22T18:05:11.403831] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-22T18:05:11.403893] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-22T18:05:11.405249] [DEBUG] [LOCAL ] CP: Trimmed 77304 records to 53228 (keeping 200 days of data) [2025-10-22T18:05:11.739277] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T18:05:11.752458] [DEBUG] [LOCAL ] CP: Primary data saved (53228 records). [2025-10-22T18:05:11.752622] [INFO ] [MAIN ] CP: Full history saved. [2025-10-22T18:05:11.752952] [INFO ] [MAIN ] Update Progress: 517/2367 symbols completed. CP took 40.2s. Estimated remaining: 3h 53m 1s. Rate: 7.9 symbols/min [2025-10-22T18:05:12.117691] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-22T18:05:12.917708] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-22T18:05:12.988716] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T18:05:12.994002] [INFO ] [REMOTE ] CPAY: Full fetch complete (44761 records). [2025-10-22T18:05:12.994136] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-22T18:05:13.356711] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T18:05:13.401022] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-22T18:05:13.401133] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-22T18:05:13.401895] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-22T18:05:13.401961] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-22T18:05:13.403008] [DEBUG] [LOCAL ] CPAY: Trimmed 44761 records to 30086 (keeping 200 days of data) [2025-10-22T18:05:13.592540] [DEBUG] [LOCAL ] CPAY: Primary data saved (30086 records). [2025-10-22T18:05:13.592715] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-22T18:05:13.592803] [INFO ] [MAIN ] Update Progress: 518/2367 symbols completed. CPAY took 36.2s. Estimated remaining: 3h 52m 33s. Rate: 8.0 symbols/min [2025-10-22T18:05:13.717689] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-22T18:05:13.950273] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:05:14.517711] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-22T18:05:14.644492] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-22T18:05:15.317752] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-22T18:05:15.645769] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T18:05:16.036576] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T18:05:16.117724] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-22T18:05:16.917710] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-22T18:05:17.119893] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T18:05:17.703784] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T18:05:17.717681] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-22T18:05:18.517686] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-22T18:05:18.554052] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T18:05:19.317670] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-22T18:05:19.780542] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T18:05:20.117688] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-22T18:05:20.186580] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T18:05:20.917680] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-22T18:05:21.139565] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T18:05:21.717996] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-22T18:05:21.783856] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T18:05:21.787135] [INFO ] [REMOTE ] CPK: Full fetch complete (18761 records). [2025-10-22T18:05:21.787211] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-22T18:05:22.178728] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-22T18:05:22.178828] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-22T18:05:22.179268] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-22T18:05:22.179309] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-22T18:05:22.179945] [DEBUG] [LOCAL ] CPK: Trimmed 18761 records to 13889 (keeping 200 days of data) [2025-10-22T18:05:22.264208] [DEBUG] [LOCAL ] CPK: Primary data saved (13889 records). [2025-10-22T18:05:22.264335] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-22T18:05:22.264413] [INFO ] [MAIN ] Update Progress: 519/2367 symbols completed. CPK took 19.4s. Estimated remaining: 3h 52m 30s. Rate: 7.9 symbols/min [2025-10-22T18:05:22.598023] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T18:05:22.601085] [INFO ] [REMOTE ] CPF: Full fetch complete (23317 records). [2025-10-22T18:05:22.601175] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-22T18:05:22.963316] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-22T18:05:22.963392] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-22T18:05:22.963833] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-22T18:05:22.963893] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-22T18:05:22.964748] [DEBUG] [LOCAL ] CPF: Trimmed 23317 records to 15178 (keeping 200 days of data) [2025-10-22T18:05:23.052386] [DEBUG] [LOCAL ] CPF: Primary data saved (15178 records). [2025-10-22T18:05:23.052517] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-22T18:05:23.052587] [INFO ] [MAIN ] Update Progress: 520/2367 symbols completed. CPF took 24.5s. Estimated remaining: 3h 51m 58s. Rate: 8.0 symbols/min [2025-10-22T18:05:23.689123] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:23.706362] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:23.753994] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:23.758059] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:23.784892] [DEBUG] [LOCAL ] CPS: Loaded 24974 existing records from primary storage. [2025-10-22T18:05:23.785463] [INFO ] [MAIN ] CPS: Loaded 24974 existing records. [2025-10-22T18:05:24.026334] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:24.027823] [DEBUG] [LOCAL ] CPRI: Loaded 52438 existing records from primary storage. [2025-10-22T18:05:24.041980] [INFO ] [MAIN ] CPRI: Loaded 52438 existing records. [2025-10-22T18:05:24.042138] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-22T18:05:24.053303] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-22T18:05:24.084879] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-22T18:05:24.084197] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-22T18:05:24.101242] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-22T18:05:24.085412] [DEBUG] [LOCAL ] CPT: Loaded 44521 existing records from primary storage. [2025-10-22T18:05:24.115760] [INFO ] [MAIN ] CPNG: Loaded 53679 existing records. [2025-10-22T18:05:24.131522] [INFO ] [MAIN ] CPT: Loaded 44521 existing records. [2025-10-22T18:05:24.673008] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:24.738197] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-22T18:05:24.741740] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-22T18:05:24.811396] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-22T18:05:24.826803] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:24.833765] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-22T18:05:24.842392] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:24.902556] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-22T18:05:24.918741] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-22T18:05:24.962194] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-22T18:05:24.962270] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-22T18:05:25.025342] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-22T18:05:25.034496] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-22T18:05:25.034319] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-22T18:05:25.086858] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-22T18:05:25.326240] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:25.429256] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-22T18:05:25.967158] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:26.017013] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-22T18:05:26.195774] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:26.198927] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:26.199258] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-22T18:05:26.200250] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-22T18:05:27.219562] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T18:05:27.224234] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-22T18:05:27.875006] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T18:05:27.883915] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-22T18:05:27.912554] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T18:05:27.923475] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-22T18:05:27.970938] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:05:28.011445] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T18:05:28.117671] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-22T18:05:28.917698] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-22T18:05:29.415115] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T18:05:29.506223] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:05:29.558159] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:05:29.717733] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-22T18:05:30.517781] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-22T18:05:31.068879] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-22T18:05:31.317702] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-22T18:05:31.405880] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:05:31.854503] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T18:05:32.117712] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-22T18:05:32.917715] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-22T18:05:33.530433] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-22T18:05:33.717687] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-22T18:05:34.001874] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T18:05:34.055509] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T18:05:34.517694] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-22T18:05:35.317693] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-22T18:05:35.710378] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T18:05:36.117695] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-22T18:05:36.360582] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:05:36.762539] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T18:05:36.917691] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-22T18:05:37.717727] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-22T18:05:38.231897] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T18:05:38.517778] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-22T18:05:38.740463] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T18:05:38.741636] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T18:05:39.317743] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-22T18:05:40.117734] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-22T18:05:40.234054] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:05:40.491993] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-22T18:05:40.917746] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-22T18:05:41.717702] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-22T18:05:42.315859] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-22T18:05:42.517714] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-22T18:05:42.736432] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:05:43.068319] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T18:05:43.317782] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-22T18:05:44.117696] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-22T18:05:44.917674] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-22T18:05:45.042885] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-22T18:05:45.045364] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T18:05:45.379308] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T18:05:45.702048] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T18:05:45.717693] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-22T18:05:46.517681] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-22T18:05:47.317723] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-22T18:05:48.116315] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:05:48.125822] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-22T18:05:48.178746] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-22T18:05:48.917664] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-22T18:05:49.110154] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:05:49.386566] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:05:49.717691] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-22T18:05:50.517728] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-22T18:05:50.656319] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T18:05:50.664256] [INFO ] [REMOTE ] CPT: Full fetch complete (64746 records). [2025-10-22T18:05:50.664455] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-22T18:05:51.039935] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-22T18:05:51.040033] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-22T18:05:51.040907] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-22T18:05:51.040982] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-22T18:05:51.042215] [DEBUG] [LOCAL ] CPT: Trimmed 64746 records to 44485 (keeping 200 days of data) [2025-10-22T18:05:51.316846] [DEBUG] [LOCAL ] CPT: Primary data saved (44485 records). [2025-10-22T18:05:51.316991] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-22T18:05:51.318108] [INFO ] [MAIN ] Update Progress: 521/2367 symbols completed. CPT took 28.2s. Estimated remaining: 3h 53m 4s. Rate: 7.9 symbols/min [2025-10-22T18:05:51.318198] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-22T18:05:51.489878] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:51.505405] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T18:05:51.526437] [DEBUG] [LOCAL ] CQP: Loaded 18719 existing records from primary storage. [2025-10-22T18:05:51.526697] [INFO ] [MAIN ] CQP: Loaded 18719 existing records. [2025-10-22T18:05:51.703240] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:51.703680] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-22T18:05:51.703798] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-22T18:05:51.704302] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-22T18:05:51.704396] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-22T18:05:52.021635] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-22T18:05:52.110209] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:52.117605] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-22T18:05:52.917883] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-22T18:05:53.157254] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:05:53.169924] [INFO ] [REMOTE ] CPRI: Full fetch complete (76231 records). [2025-10-22T18:05:53.170137] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-22T18:05:53.516252] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T18:05:53.720973] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-22T18:05:53.784107] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T18:05:53.894107] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-22T18:05:53.894233] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-22T18:05:53.895697] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-22T18:05:53.895781] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-22T18:05:53.897824] [DEBUG] [LOCAL ] CPRI: Trimmed 76231 records to 52430 (keeping 200 days of data) [2025-10-22T18:05:54.266341] [DEBUG] [LOCAL ] CPRI: Primary data saved (52430 records). [2025-10-22T18:05:54.266521] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-22T18:05:54.266675] [INFO ] [MAIN ] Update Progress: 522/2367 symbols completed. CPRI took 31.2s. Estimated remaining: 3h 52m 40s. Rate: 7.9 symbols/min [2025-10-22T18:05:54.472355] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:54.496240] [DEBUG] [LOCAL ] CR: Loaded 23996 existing records from primary storage. [2025-10-22T18:05:54.496495] [INFO ] [MAIN ] CR: Loaded 23996 existing records. [2025-10-22T18:05:54.525943] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-22T18:05:54.681272] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:54.681509] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-22T18:05:54.681559] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-22T18:05:54.681770] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-22T18:05:54.681827] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-22T18:05:55.060280] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:05:55.065707] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:55.317710] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-22T18:05:56.117700] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-22T18:05:56.478232] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T18:05:56.741511] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-22T18:05:56.749807] [INFO ] [REMOTE ] CPNG: Full fetch complete (77400 records). [2025-10-22T18:05:56.749928] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-22T18:05:56.750747] [FATAL] [VALIDATOR ] CPNG: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:05:56.750835] [FATAL] [MAIN ] CPNG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:05:56.750878] [WARN ] [MAIN ] CPNG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:05:56.750916] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-22T18:05:56.750985] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-22T18:05:56.751041] [INFO ] [LOCAL ] CPNG: Starting deletion of derivative data. [2025-10-22T18:05:56.751183] [DEBUG] [LOCAL ] CPNG: Deleted derivative data file. [2025-10-22T18:05:56.751285] [INFO ] [MAIN ] Update Progress: 523/2367 symbols completed. CPNG took 33.7s. Estimated remaining: 3h 52m 14s. Rate: 7.9 symbols/min [2025-10-22T18:05:56.917373] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:56.917562] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-10-22T18:05:56.917616] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-10-22T18:05:56.917979] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-22T18:05:56.918049] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-22T18:05:56.917715] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-22T18:05:56.918481] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-22T18:05:56.919279] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-22T18:05:57.272184] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:57.364026] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T18:05:57.717712] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-22T18:05:57.836998] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T18:05:58.517724] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-22T18:05:58.857421] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T18:05:59.317672] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-22T18:05:59.671299] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T18:06:00.117707] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-22T18:06:00.826200] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T18:06:00.830351] [INFO ] [REMOTE ] CPS: Full fetch complete (36557 records). [2025-10-22T18:06:00.830479] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-22T18:06:00.922718] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-22T18:06:00.960999] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T18:06:01.217115] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-22T18:06:01.217212] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-22T18:06:01.217851] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-22T18:06:01.217915] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-22T18:06:01.218889] [DEBUG] [LOCAL ] CPS: Trimmed 36557 records to 24879 (keeping 200 days of data) [2025-10-22T18:06:01.358670] [DEBUG] [LOCAL ] CPS: Primary data saved (24879 records). [2025-10-22T18:06:01.358804] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-22T18:06:01.358883] [INFO ] [MAIN ] Update Progress: 524/2367 symbols completed. CPS took 38.3s. Estimated remaining: 3h 51m 57s. Rate: 7.9 symbols/min [2025-10-22T18:06:01.530687] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:01.580020] [DEBUG] [LOCAL ] CRBG: Loaded 52602 existing records from primary storage. [2025-10-22T18:06:01.580382] [INFO ] [MAIN ] CRBG: Loaded 52602 existing records. [2025-10-22T18:06:01.722841] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-22T18:06:01.785101] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:01.785368] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-22T18:06:01.785418] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-22T18:06:01.785831] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-22T18:06:01.785890] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-22T18:06:02.131515] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T18:06:02.190126] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:02.517688] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-22T18:06:02.942548] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T18:06:03.317706] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-22T18:06:04.117693] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-22T18:06:04.358113] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T18:06:04.564506] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T18:06:04.917701] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-22T18:06:05.378781] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:06:05.717727] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-22T18:06:05.902775] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T18:06:06.517707] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-22T18:06:06.641112] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T18:06:07.317720] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-22T18:06:07.790953] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T18:06:08.117697] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-22T18:06:08.743965] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T18:06:08.917732] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-22T18:06:09.128064] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T18:06:09.717734] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-22T18:06:09.737840] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T18:06:10.517724] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-22T18:06:10.610172] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T18:06:11.317678] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-22T18:06:11.433676] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T18:06:11.436602] [INFO ] [REMOTE ] CQP: Full fetch complete (29693 records). [2025-10-22T18:06:11.436712] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-22T18:06:11.813875] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-22T18:06:11.813966] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-22T18:06:11.814850] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-22T18:06:11.814921] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-22T18:06:11.815866] [DEBUG] [LOCAL ] CQP: Trimmed 29693 records to 18676 (keeping 200 days of data) [2025-10-22T18:06:11.936963] [DEBUG] [LOCAL ] CQP: Primary data saved (18676 records). [2025-10-22T18:06:11.937116] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-22T18:06:11.937198] [INFO ] [MAIN ] Update Progress: 525/2367 symbols completed. CQP took 20.6s. Estimated remaining: 3h 51m 60s. Rate: 7.9 symbols/min [2025-10-22T18:06:12.095540] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T18:06:12.113555] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:12.117611] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-22T18:06:12.160135] [DEBUG] [LOCAL ] CRC: Loaded 44159 existing records from primary storage. [2025-10-22T18:06:12.160421] [INFO ] [MAIN ] CRC: Loaded 44159 existing records. [2025-10-22T18:06:12.331603] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:12.331872] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-22T18:06:12.331928] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-22T18:06:12.332293] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-22T18:06:12.332348] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-22T18:06:12.709900] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:12.870752] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T18:06:12.917701] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-22T18:06:13.710352] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T18:06:13.717612] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-22T18:06:14.479212] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T18:06:14.517692] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-22T18:06:15.317677] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-22T18:06:15.615440] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T18:06:16.117693] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-22T18:06:16.689019] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T18:06:16.917714] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-22T18:06:17.639996] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-22T18:06:17.717707] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-22T18:06:17.902973] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T18:06:18.503224] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T18:06:18.505696] [INFO ] [REMOTE ] CRBD: Full fetch complete (12984 records). [2025-10-22T18:06:18.505795] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-22T18:06:18.522889] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-22T18:06:18.882577] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-22T18:06:18.882676] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-22T18:06:18.882978] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-22T18:06:18.883018] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-22T18:06:18.883460] [DEBUG] [LOCAL ] CRBD: Trimmed 12984 records to 8761 (keeping 200 days of data) [2025-10-22T18:06:18.937963] [DEBUG] [LOCAL ] CRBD: Primary data saved (8761 records). [2025-10-22T18:06:18.938117] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-22T18:06:18.938192] [INFO ] [MAIN ] Update Progress: 526/2367 symbols completed. CRBD took 22.2s. Estimated remaining: 3h 51m 50s. Rate: 7.9 symbols/min [2025-10-22T18:06:19.111676] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:19.111823] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-22T18:06:19.111860] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-22T18:06:19.111966] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-22T18:06:19.112007] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-22T18:06:19.112048] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-22T18:06:19.112079] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-22T18:06:19.322735] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-22T18:06:19.467906] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:19.739783] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T18:06:20.117705] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-22T18:06:20.917675] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-22T18:06:21.091869] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T18:06:21.116392] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:06:21.117464] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T18:06:21.122433] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-22T18:06:21.123006] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:06:21.123090] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-22T18:06:21.123430] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:06:21.123504] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-22T18:06:21.123569] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-22T18:06:21.123605] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-22T18:06:21.123671] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-22T18:06:21.123738] [INFO ] [MAIN ] Update Progress: 527/2367 symbols completed. CRCL took 2.2s. Estimated remaining: 3h 51m 24s. Rate: 8.0 symbols/min [2025-10-22T18:06:21.290038] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:21.336351] [DEBUG] [LOCAL ] CRGY: Loaded 52503 existing records from primary storage. [2025-10-22T18:06:21.336724] [INFO ] [MAIN ] CRGY: Loaded 52503 existing records. [2025-10-22T18:06:21.513890] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:21.514157] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-22T18:06:21.514205] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-22T18:06:21.514516] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-22T18:06:21.514572] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-22T18:06:21.722937] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-22T18:06:21.876076] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:22.517709] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-22T18:06:23.188400] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T18:06:23.317700] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-22T18:06:24.117749] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-22T18:06:24.275596] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T18:06:24.917798] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-22T18:06:25.096304] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T18:06:25.252835] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T18:06:25.717695] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-22T18:06:26.333618] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T18:06:26.517741] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-22T18:06:26.712837] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T18:06:26.716795] [INFO ] [REMOTE ] CR: Full fetch complete (34779 records). [2025-10-22T18:06:26.716895] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-22T18:06:27.086882] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-22T18:06:27.086967] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-22T18:06:27.087472] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-22T18:06:27.087512] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-22T18:06:27.088292] [DEBUG] [LOCAL ] CR: Trimmed 34779 records to 23949 (keeping 200 days of data) [2025-10-22T18:06:27.232822] [DEBUG] [LOCAL ] CR: Primary data saved (23949 records). [2025-10-22T18:06:27.232950] [INFO ] [MAIN ] CR: Full history saved. [2025-10-22T18:06:27.233027] [INFO ] [MAIN ] Update Progress: 528/2367 symbols completed. CR took 33.0s. Estimated remaining: 3h 51m 11s. Rate: 8.0 symbols/min [2025-10-22T18:06:27.322810] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-22T18:06:27.400275] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:27.452254] [DEBUG] [LOCAL ] CRH: Loaded 53435 existing records from primary storage. [2025-10-22T18:06:27.452587] [INFO ] [MAIN ] CRH: Loaded 53435 existing records. [2025-10-22T18:06:27.641753] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:27.642393] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-22T18:06:27.642462] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-22T18:06:27.642739] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-22T18:06:27.642797] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-22T18:06:27.993080] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:28.117638] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-22T18:06:28.142498] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T18:06:28.917673] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-22T18:06:29.095895] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T18:06:29.717684] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-22T18:06:30.141257] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T18:06:30.517726] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-22T18:06:30.586117] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T18:06:31.317639] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-22T18:06:31.550176] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T18:06:32.118548] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T18:06:32.118712] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-22T18:06:32.710199] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T18:06:32.917715] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-22T18:06:33.717712] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-22T18:06:33.798049] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:06:34.323588] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T18:06:34.517714] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-22T18:06:35.077886] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T18:06:35.317728] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-22T18:06:36.102248] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T18:06:36.117679] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-22T18:06:36.917687] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-22T18:06:37.027546] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T18:06:37.717726] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-22T18:06:37.777166] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T18:06:38.517696] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-22T18:06:38.631688] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T18:06:39.317717] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-22T18:06:39.484500] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T18:06:40.117677] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-22T18:06:40.600998] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T18:06:40.815675] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T18:06:40.917696] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-22T18:06:41.717676] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-22T18:06:41.877973] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:06:42.517703] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-22T18:06:42.976839] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T18:06:42.985455] [INFO ] [REMOTE ] CRBG: Full fetch complete (76048 records). [2025-10-22T18:06:42.985575] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-22T18:06:43.319579] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-22T18:06:43.376820] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-22T18:06:43.377027] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-22T18:06:43.377921] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-22T18:06:43.392080] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-22T18:06:43.404312] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T18:06:43.413539] [DEBUG] [LOCAL ] CRBG: Trimmed 76048 records to 52600 (keeping 200 days of data) [2025-10-22T18:06:43.723660] [DEBUG] [LOCAL ] CRBG: Primary data saved (52600 records). [2025-10-22T18:06:43.723799] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-22T18:06:43.724425] [INFO ] [MAIN ] Update Progress: 529/2367 symbols completed. CRBG took 42.4s. Estimated remaining: 3h 51m 35s. Rate: 7.9 symbols/min [2025-10-22T18:06:43.898779] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:43.943683] [DEBUG] [LOCAL ] CRI: Loaded 49512 existing records from primary storage. [2025-10-22T18:06:43.944004] [INFO ] [MAIN ] CRI: Loaded 49512 existing records. [2025-10-22T18:06:44.122767] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:44.122996] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-22T18:06:44.119122] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-22T18:06:44.124059] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-22T18:06:44.124287] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-22T18:06:44.124344] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-22T18:06:44.486548] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:44.514299] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T18:06:44.917614] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-22T18:06:45.310582] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T18:06:45.717726] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-22T18:06:45.907502] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T18:06:45.914775] [INFO ] [REMOTE ] CRC: Full fetch complete (62997 records). [2025-10-22T18:06:45.914879] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-22T18:06:46.327603] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-22T18:06:46.327761] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-22T18:06:46.328503] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-22T18:06:46.328582] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-22T18:06:46.329932] [DEBUG] [LOCAL ] CRC: Trimmed 62997 records to 44118 (keeping 200 days of data) [2025-10-22T18:06:46.521709] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-22T18:06:46.473209] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T18:06:46.621720] [DEBUG] [LOCAL ] CRC: Primary data saved (44118 records). [2025-10-22T18:06:46.621891] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-22T18:06:46.621977] [INFO ] [MAIN ] Update Progress: 530/2367 symbols completed. CRC took 34.7s. Estimated remaining: 3h 51m 11s. Rate: 7.9 symbols/min [2025-10-22T18:06:46.787573] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:46.835536] [DEBUG] [LOCAL ] CRK: Loaded 52233 existing records from primary storage. [2025-10-22T18:06:46.835878] [INFO ] [MAIN ] CRK: Loaded 52233 existing records. [2025-10-22T18:06:47.018538] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:47.018899] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-22T18:06:47.018952] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-22T18:06:47.019186] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-22T18:06:47.019245] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-22T18:06:47.322851] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-22T18:06:47.390978] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:47.695973] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T18:06:48.117690] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-22T18:06:48.371593] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T18:06:48.874394] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:06:48.917680] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-22T18:06:49.717765] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-22T18:06:50.038376] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T18:06:50.517718] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-22T18:06:51.046774] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-22T18:06:51.056134] [INFO ] [REMOTE ] CRGY: Full fetch complete (76158 records). [2025-10-22T18:06:51.056294] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-22T18:06:51.317862] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-22T18:06:51.488232] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-22T18:06:51.488499] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-22T18:06:51.489434] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-22T18:06:51.489632] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-22T18:06:51.500693] [DEBUG] [LOCAL ] CRGY: Trimmed 76158 records to 52497 (keeping 200 days of data) [2025-10-22T18:06:51.520787] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T18:06:51.830322] [DEBUG] [LOCAL ] CRGY: Primary data saved (52497 records). [2025-10-22T18:06:51.830460] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-22T18:06:51.830540] [INFO ] [MAIN ] Update Progress: 531/2367 symbols completed. CRGY took 30.7s. Estimated remaining: 3h 50m 55s. Rate: 8.0 symbols/min [2025-10-22T18:06:51.995235] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:52.034565] [DEBUG] [LOCAL ] CRL: Loaded 42659 existing records from primary storage. [2025-10-22T18:06:52.034878] [INFO ] [MAIN ] CRL: Loaded 42659 existing records. [2025-10-22T18:06:52.123303] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-22T18:06:52.212241] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:52.212437] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-22T18:06:52.212484] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-22T18:06:52.212707] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-22T18:06:52.212762] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-22T18:06:52.563052] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:52.593404] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T18:06:52.917639] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-22T18:06:53.255344] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T18:06:53.717728] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-22T18:06:53.872739] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:06:54.517706] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-22T18:06:54.551493] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:06:55.317638] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-22T18:06:55.675677] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-22T18:06:56.124153] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-22T18:06:56.129368] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T18:06:56.870689] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:06:56.917708] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-22T18:06:57.717716] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-22T18:06:57.864867] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:06:58.464350] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T18:06:58.517615] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-22T18:06:59.317685] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-22T18:06:59.502173] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:07:00.117787] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-22T18:07:00.805796] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T18:07:00.816440] [INFO ] [REMOTE ] CRH: Full fetch complete (77541 records). [2025-10-22T18:07:00.816718] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-22T18:07:00.925018] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-22T18:07:01.144975] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T18:07:01.503585] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-22T18:07:01.503711] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-22T18:07:01.504601] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-22T18:07:01.504672] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-22T18:07:01.506296] [DEBUG] [LOCAL ] CRH: Trimmed 77541 records to 53422 (keeping 200 days of data) [2025-10-22T18:07:01.737171] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-22T18:07:01.791591] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:07:01.896037] [DEBUG] [LOCAL ] CRH: Primary data saved (53422 records). [2025-10-22T18:07:01.896184] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-22T18:07:01.896262] [INFO ] [MAIN ] Update Progress: 532/2367 symbols completed. CRH took 34.7s. Estimated remaining: 3h 50m 57s. Rate: 7.9 symbols/min [2025-10-22T18:07:02.062638] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:02.128327] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-22T18:07:02.128690] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-22T18:07:02.311666] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:02.311897] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-22T18:07:02.311964] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-22T18:07:02.312260] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-22T18:07:02.312417] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-22T18:07:02.524494] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-22T18:07:02.701588] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T18:07:02.705261] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:03.317613] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-22T18:07:03.667985] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T18:07:04.117710] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-22T18:07:04.390203] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:07:04.850215] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:07:04.917700] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-22T18:07:05.717707] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-22T18:07:06.014456] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T18:07:06.517680] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-22T18:07:06.701909] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T18:07:07.317755] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-22T18:07:07.469604] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T18:07:08.117745] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-22T18:07:08.917764] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-22T18:07:09.270866] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T18:07:09.327983] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-22T18:07:09.717710] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-22T18:07:09.958147] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:07:09.966152] [INFO ] [REMOTE ] CRI: Full fetch complete (70966 records). [2025-10-22T18:07:09.966356] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-22T18:07:10.367601] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-22T18:07:10.367721] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-22T18:07:10.368501] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-22T18:07:10.368543] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-22T18:07:10.369954] [DEBUG] [LOCAL ] CRI: Trimmed 70966 records to 49486 (keeping 200 days of data) [2025-10-22T18:07:10.568495] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-22T18:07:10.620573] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T18:07:10.712874] [DEBUG] [LOCAL ] CRI: Primary data saved (49486 records). [2025-10-22T18:07:10.713026] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-22T18:07:10.713701] [INFO ] [MAIN ] Update Progress: 533/2367 symbols completed. CRI took 27.0s. Estimated remaining: 3h 50m 53s. Rate: 7.9 symbols/min [2025-10-22T18:07:10.877051] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:10.917453] [DEBUG] [LOCAL ] CRS: Loaded 43115 existing records from primary storage. [2025-10-22T18:07:10.917819] [INFO ] [MAIN ] CRS: Loaded 43115 existing records. [2025-10-22T18:07:11.091121] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:11.091318] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-22T18:07:11.091368] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-22T18:07:11.091564] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-22T18:07:11.091619] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-22T18:07:11.324565] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-22T18:07:11.440451] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:11.562045] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T18:07:12.117771] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-22T18:07:12.848314] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-22T18:07:12.925250] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-22T18:07:12.943020] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T18:07:13.717716] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-22T18:07:13.873362] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T18:07:14.517719] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-22T18:07:15.057565] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T18:07:15.257457] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-22T18:07:15.317665] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-22T18:07:16.117706] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-22T18:07:16.548495] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T18:07:16.917722] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-22T18:07:17.717729] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-22T18:07:17.764576] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T18:07:17.839292] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-22T18:07:18.517775] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-22T18:07:18.615983] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T18:07:18.624866] [INFO ] [REMOTE ] CRK: Full fetch complete (75819 records). [2025-10-22T18:07:18.625021] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-22T18:07:19.016163] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-22T18:07:19.016298] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-22T18:07:19.017195] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-22T18:07:19.017310] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-22T18:07:19.026771] [DEBUG] [LOCAL ] CRK: Trimmed 75819 records to 52226 (keeping 200 days of data) [2025-10-22T18:07:19.042127] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T18:07:19.324977] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-22T18:07:19.347283] [DEBUG] [LOCAL ] CRK: Primary data saved (52226 records). [2025-10-22T18:07:19.347385] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-22T18:07:19.347474] [INFO ] [MAIN ] Update Progress: 534/2367 symbols completed. CRK took 32.7s. Estimated remaining: 3h 50m 50s. Rate: 7.9 symbols/min [2025-10-22T18:07:19.526759] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:19.532176] [DEBUG] [LOCAL ] CRT: Loaded 4791 existing records from primary storage. [2025-10-22T18:07:19.532324] [INFO ] [MAIN ] CRT: Loaded 4791 existing records. [2025-10-22T18:07:19.714727] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:19.714949] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-22T18:07:19.715003] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-22T18:07:19.715134] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-22T18:07:19.715172] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-22T18:07:20.079825] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:20.117615] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-22T18:07:20.912711] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T18:07:20.917602] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-22T18:07:21.082086] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T18:07:21.169674] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-22T18:07:21.556551] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T18:07:21.717738] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-22T18:07:22.389870] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T18:07:22.517731] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-22T18:07:23.317734] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-22T18:07:24.088127] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T18:07:24.117711] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-22T18:07:24.917756] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-22T18:07:25.611065] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T18:07:25.714309] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-22T18:07:25.724401] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-22T18:07:25.866330] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:07:25.874619] [INFO ] [REMOTE ] CRL: Full fetch complete (63654 records). [2025-10-22T18:07:25.874801] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-22T18:07:26.211043] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-22T18:07:26.306975] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-22T18:07:26.307079] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-22T18:07:26.307939] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-22T18:07:26.308005] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-22T18:07:26.309312] [DEBUG] [LOCAL ] CRL: Trimmed 63654 records to 42624 (keeping 200 days of data) [2025-10-22T18:07:26.520656] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-22T18:07:26.576714] [DEBUG] [LOCAL ] CRL: Primary data saved (42624 records). [2025-10-22T18:07:26.576840] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-22T18:07:26.576919] [INFO ] [MAIN ] Update Progress: 535/2367 symbols completed. CRL took 34.7s. Estimated remaining: 3h 50m 41s. Rate: 7.9 symbols/min [2025-10-22T18:07:26.772058] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:26.812553] [DEBUG] [LOCAL ] CSAN: Loaded 42270 existing records from primary storage. [2025-10-22T18:07:26.812879] [INFO ] [MAIN ] CSAN: Loaded 42270 existing records. [2025-10-22T18:07:27.003516] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:27.003829] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-22T18:07:27.003883] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-22T18:07:27.004182] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-22T18:07:27.004241] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-22T18:07:27.322858] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-22T18:07:27.389771] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:27.967876] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T18:07:28.117711] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-22T18:07:28.734300] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T18:07:28.917708] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-22T18:07:28.981057] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-22T18:07:29.649706] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T18:07:29.717721] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-22T18:07:30.517700] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-22T18:07:31.284687] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T18:07:31.314688] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T18:07:31.317600] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-22T18:07:32.002075] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T18:07:32.003368] [INFO ] [REMOTE ] CRT: Full fetch complete (7337 records). [2025-10-22T18:07:32.003434] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-22T18:07:32.122834] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-22T18:07:32.378808] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-22T18:07:32.378905] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-22T18:07:32.379106] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-22T18:07:32.379167] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-22T18:07:32.379577] [DEBUG] [LOCAL ] CRT: Trimmed 7337 records to 4763 (keeping 200 days of data) [2025-10-22T18:07:32.407270] [DEBUG] [LOCAL ] CRT: Primary data saved (4763 records). [2025-10-22T18:07:32.407397] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-22T18:07:32.407474] [INFO ] [MAIN ] Update Progress: 536/2367 symbols completed. CRT took 13.1s. Estimated remaining: 3h 50m 27s. Rate: 7.9 symbols/min [2025-10-22T18:07:32.572395] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:32.601692] [DEBUG] [LOCAL ] CSL: Loaded 31256 existing records from primary storage. [2025-10-22T18:07:32.601987] [INFO ] [MAIN ] CSL: Loaded 31256 existing records. [2025-10-22T18:07:32.772694] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:32.772885] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-22T18:07:32.772931] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-22T18:07:32.773144] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-22T18:07:32.773199] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-22T18:07:32.926313] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-22T18:07:33.126838] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:33.717704] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-22T18:07:34.044116] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T18:07:34.319204] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:07:34.517782] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-22T18:07:35.317729] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-22T18:07:35.653710] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T18:07:36.117734] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-22T18:07:36.235263] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-22T18:07:36.917689] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-22T18:07:37.100516] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T18:07:37.567861] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:07:37.717724] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-22T18:07:38.517736] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-22T18:07:39.267494] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:07:39.317609] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-22T18:07:39.393883] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-22T18:07:40.117703] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-22T18:07:40.207534] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T18:07:40.538176] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T18:07:40.824684] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T18:07:40.833382] [INFO ] [REMOTE ] CRM: Full fetch complete (77946 records). [2025-10-22T18:07:40.833526] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-22T18:07:40.922855] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-22T18:07:41.231156] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-22T18:07:41.231262] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-22T18:07:41.232245] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-22T18:07:41.232364] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-22T18:07:41.233941] [DEBUG] [LOCAL ] CRM: Trimmed 77946 records to 53770 (keeping 200 days of data) [2025-10-22T18:07:41.576757] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-22T18:07:41.576902] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-22T18:07:41.577002] [INFO ] [MAIN ] Update Progress: 537/2367 symbols completed. CRM took 39.7s. Estimated remaining: 3h 50m 25s. Rate: 7.9 symbols/min [2025-10-22T18:07:41.726858] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-22T18:07:41.747693] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:41.764283] [DEBUG] [LOCAL ] CSR: Loaded 13477 existing records from primary storage. [2025-10-22T18:07:41.764531] [INFO ] [MAIN ] CSR: Loaded 13477 existing records. [2025-10-22T18:07:41.943004] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:41.943235] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-22T18:07:41.943280] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-22T18:07:41.943532] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-22T18:07:41.943588] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-22T18:07:42.303082] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:42.384154] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T18:07:42.517691] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-22T18:07:43.282562] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T18:07:43.317663] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-22T18:07:44.117765] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-22T18:07:44.191230] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:07:44.853574] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T18:07:44.917699] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-22T18:07:45.717917] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-22T18:07:45.719534] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T18:07:46.308145] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T18:07:46.517709] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-22T18:07:47.319193] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T18:07:47.319384] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-22T18:07:48.122767] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-22T18:07:48.138104] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T18:07:48.235479] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T18:07:48.917715] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-22T18:07:49.618834] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T18:07:49.717679] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-22T18:07:49.999095] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T18:07:50.207913] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T18:07:50.517699] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-22T18:07:51.317725] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-22T18:07:52.117729] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-22T18:07:52.223378] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T18:07:52.230232] [INFO ] [REMOTE ] CRS: Full fetch complete (62638 records). [2025-10-22T18:07:52.230347] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-22T18:07:52.603253] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-22T18:07:52.603391] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-22T18:07:52.604157] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-22T18:07:52.604225] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-22T18:07:52.605491] [DEBUG] [LOCAL ] CRS: Trimmed 62638 records to 43101 (keeping 200 days of data) [2025-10-22T18:07:52.871683] [DEBUG] [LOCAL ] CRS: Primary data saved (43101 records). [2025-10-22T18:07:52.871808] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-22T18:07:52.872430] [INFO ] [MAIN ] Update Progress: 538/2367 symbols completed. CRS took 42.2s. Estimated remaining: 3h 50m 31s. Rate: 7.9 symbols/min [2025-10-22T18:07:52.925938] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-22T18:07:53.070211] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:53.089014] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:07:53.096284] [INFO ] [REMOTE ] CSAN: Full fetch complete (60263 records). [2025-10-22T18:07:53.096478] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-22T18:07:53.370688] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T18:07:53.377326] [DEBUG] [LOCAL ] CSTM: Loaded 47446 existing records from primary storage. [2025-10-22T18:07:53.405732] [INFO ] [MAIN ] CSTM: Loaded 47446 existing records. [2025-10-22T18:07:53.692935] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:53.724882] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-22T18:07:53.729747] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-22T18:07:53.730001] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-22T18:07:53.731096] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-22T18:07:53.731163] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-22T18:07:53.731313] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-22T18:07:53.731600] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-22T18:07:53.732107] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-22T18:07:53.732212] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-22T18:07:53.785526] [DEBUG] [LOCAL ] CSAN: Trimmed 60263 records to 42220 (keeping 200 days of data) [2025-10-22T18:07:53.969155] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T18:07:54.520368] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-22T18:07:54.663009] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:54.692763] [DEBUG] [LOCAL ] CSAN: Primary data saved (42220 records). [2025-10-22T18:07:54.692967] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-22T18:07:54.693071] [INFO ] [MAIN ] Update Progress: 539/2367 symbols completed. CSAN took 28.1s. Estimated remaining: 3h 50m 3s. Rate: 7.9 symbols/min [2025-10-22T18:07:54.896363] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:54.908171] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T18:07:54.926077] [DEBUG] [LOCAL ] CSV: Loaded 12501 existing records from primary storage. [2025-10-22T18:07:54.926342] [INFO ] [MAIN ] CSV: Loaded 12501 existing records. [2025-10-22T18:07:55.102725] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:55.102979] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-22T18:07:55.103036] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-22T18:07:55.103178] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-22T18:07:55.103217] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-22T18:07:55.320746] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-22T18:07:55.457799] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:55.589586] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-22T18:07:56.117713] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-22T18:07:56.917689] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-22T18:07:57.062494] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:07:57.113849] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T18:07:57.582495] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T18:07:57.717727] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-22T18:07:58.517637] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-22T18:07:58.590886] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T18:07:59.317697] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-22T18:07:59.999024] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T18:08:00.117716] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-22T18:08:00.717255] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-22T18:08:00.883992] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:08:00.917678] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-22T18:08:01.717741] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-22T18:08:02.517679] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-22T18:08:02.618665] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T18:08:02.730342] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T18:08:03.317747] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-22T18:08:03.670449] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T18:08:03.873785] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-22T18:08:04.117707] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-22T18:08:04.917707] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-22T18:08:05.198659] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T18:08:05.201498] [INFO ] [REMOTE ] CSR: Full fetch complete (17971 records). [2025-10-22T18:08:05.201567] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-22T18:08:05.568474] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-22T18:08:05.568556] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-22T18:08:05.569022] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-22T18:08:05.569085] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-22T18:08:05.569747] [DEBUG] [LOCAL ] CSR: Trimmed 17971 records to 13395 (keeping 200 days of data) [2025-10-22T18:08:05.656893] [DEBUG] [LOCAL ] CSR: Primary data saved (13395 records). [2025-10-22T18:08:05.657063] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-22T18:08:05.657171] [INFO ] [MAIN ] Update Progress: 540/2367 symbols completed. CSR took 24.1s. Estimated remaining: 3h 50m 7s. Rate: 7.9 symbols/min [2025-10-22T18:08:05.728342] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-22T18:08:05.845815] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:05.845982] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-22T18:08:05.846020] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-22T18:08:05.846136] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-22T18:08:05.846197] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-22T18:08:05.846247] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-22T18:08:05.846281] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-22T18:08:06.244158] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:06.350540] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T18:08:06.517730] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-22T18:08:07.317707] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-22T18:08:07.692257] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T18:08:08.117712] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-22T18:08:08.152718] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T18:08:08.158127] [INFO ] [REMOTE ] CSL: Full fetch complete (45708 records). [2025-10-22T18:08:08.158229] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-22T18:08:08.501521] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T18:08:08.557535] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-22T18:08:08.557669] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-22T18:08:08.558320] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-22T18:08:08.558363] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-22T18:08:08.559591] [DEBUG] [LOCAL ] CSL: Trimmed 45708 records to 31148 (keeping 200 days of data) [2025-10-22T18:08:08.753906] [DEBUG] [LOCAL ] CSL: Primary data saved (31148 records). [2025-10-22T18:08:08.754037] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-22T18:08:08.754112] [INFO ] [MAIN ] Update Progress: 541/2367 symbols completed. CSL took 36.3s. Estimated remaining: 3h 49m 45s. Rate: 7.9 symbols/min [2025-10-22T18:08:08.918708] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-22T18:08:08.928775] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:08.938501] [DEBUG] [LOCAL ] CTBB: Loaded 6539 existing records from primary storage. [2025-10-22T18:08:08.938751] [INFO ] [MAIN ] CTBB: Loaded 6539 existing records. [2025-10-22T18:08:09.120968] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:09.121185] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-22T18:08:09.121231] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-22T18:08:09.121396] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-22T18:08:09.121451] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-22T18:08:09.494322] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:09.652614] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T18:08:09.717723] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-22T18:08:09.992470] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T18:08:10.517697] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-22T18:08:10.708877] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:08:10.709176] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-22T18:08:10.709266] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:08:10.709313] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-22T18:08:10.709347] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:08:10.709414] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-22T18:08:10.709476] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-22T18:08:10.709510] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-22T18:08:10.709548] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-22T18:08:10.709593] [INFO ] [MAIN ] Update Progress: 542/2367 symbols completed. CSW took 5.1s. Estimated remaining: 3h 49m 18s. Rate: 8.0 symbols/min [2025-10-22T18:08:10.884026] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:10.891358] [DEBUG] [LOCAL ] CTDD: Loaded 5258 existing records from primary storage. [2025-10-22T18:08:10.891558] [INFO ] [MAIN ] CTDD: Loaded 5258 existing records. [2025-10-22T18:08:11.077494] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:11.077808] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-22T18:08:11.077871] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-22T18:08:11.078031] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-22T18:08:11.078074] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-22T18:08:11.326206] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-22T18:08:11.449399] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:11.490232] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T18:08:12.117739] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-22T18:08:12.444888] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T18:08:12.838312] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T18:08:12.917713] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-22T18:08:13.717727] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-22T18:08:13.767799] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T18:08:14.517671] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-22T18:08:15.085525] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T18:08:15.323254] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-22T18:08:15.329589] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T18:08:16.117712] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-22T18:08:16.162329] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T18:08:16.917732] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-22T18:08:17.682926] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T18:08:17.717706] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-22T18:08:18.006698] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T18:08:18.455627] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-22T18:08:18.517708] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-22T18:08:19.255401] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T18:08:19.317695] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-22T18:08:20.117694] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-22T18:08:20.178332] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T18:08:20.917733] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-22T18:08:21.688551] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T18:08:21.717704] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-22T18:08:21.857073] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T18:08:22.517788] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-22T18:08:23.317686] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-22T18:08:23.350634] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T18:08:23.357939] [INFO ] [REMOTE ] CSTM: Full fetch complete (69171 records). [2025-10-22T18:08:23.358081] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-22T18:08:23.358881] [FATAL] [VALIDATOR ] CSTM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:08:23.358970] [FATAL] [MAIN ] CSTM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:08:23.359013] [WARN ] [MAIN ] CSTM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:08:23.359088] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-22T18:08:23.359152] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-22T18:08:23.359187] [INFO ] [LOCAL ] CSTM: Starting deletion of derivative data. [2025-10-22T18:08:23.359339] [DEBUG] [LOCAL ] CSTM: Deleted derivative data file. [2025-10-22T18:08:23.359427] [INFO ] [MAIN ] Update Progress: 543/2367 symbols completed. CSTM took 30.5s. Estimated remaining: 3h 49m 28s. Rate: 7.9 symbols/min [2025-10-22T18:08:23.467304] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T18:08:23.541435] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:23.541626] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-22T18:08:23.541697] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-22T18:08:23.541825] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-22T18:08:23.541867] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-22T18:08:23.541907] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-22T18:08:23.541938] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-22T18:08:23.926787] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:23.994015] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T18:08:24.117737] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-22T18:08:24.779669] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T18:08:24.917717] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-22T18:08:25.542291] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T18:08:25.717696] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-22T18:08:26.517725] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-22T18:08:26.638669] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T18:08:26.913365] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:08:26.913746] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-22T18:08:26.913851] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:08:26.913901] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-22T18:08:26.913959] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:08:26.914030] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-22T18:08:26.914095] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-22T18:08:26.914130] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-22T18:08:26.914169] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-22T18:08:26.914215] [INFO ] [MAIN ] Update Progress: 544/2367 symbols completed. CTEV took 3.6s. Estimated remaining: 3h 49m 7s. Rate: 8.0 symbols/min [2025-10-22T18:08:27.080202] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:27.107444] [DEBUG] [LOCAL ] CTO: Loaded 27425 existing records from primary storage. [2025-10-22T18:08:27.107737] [INFO ] [MAIN ] CTO: Loaded 27425 existing records. [2025-10-22T18:08:27.278397] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:27.278618] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-22T18:08:27.278694] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-22T18:08:27.278904] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-22T18:08:27.278941] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-22T18:08:27.322909] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-22T18:08:27.627012] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:28.117745] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-22T18:08:28.313153] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T18:08:28.315280] [INFO ] [REMOTE ] CSV: Full fetch complete (19052 records). [2025-10-22T18:08:28.315348] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-22T18:08:28.672575] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-22T18:08:28.672684] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-22T18:08:28.673127] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-22T18:08:28.673169] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-22T18:08:28.673708] [DEBUG] [LOCAL ] CSV: Trimmed 19052 records to 12427 (keeping 200 days of data) [2025-10-22T18:08:28.750736] [DEBUG] [LOCAL ] CSV: Primary data saved (12427 records). [2025-10-22T18:08:28.750914] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-22T18:08:28.751012] [INFO ] [MAIN ] Update Progress: 545/2367 symbols completed. CSV took 34.1s. Estimated remaining: 3h 48m 41s. Rate: 8.0 symbols/min [2025-10-22T18:08:28.866237] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T18:08:28.936240] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:28.933133] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-22T18:08:28.936429] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-22T18:08:28.936502] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-22T18:08:28.936639] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-22T18:08:28.937396] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-22T18:08:28.937464] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-22T18:08:28.937499] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-22T18:08:29.293017] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:29.700420] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T18:08:29.717618] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-22T18:08:30.305625] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T18:08:30.306741] [INFO ] [REMOTE ] CTDD: Full fetch complete (7919 records). [2025-10-22T18:08:30.306842] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-22T18:08:30.522730] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-22T18:08:30.660975] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-22T18:08:30.661049] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-22T18:08:30.661261] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-22T18:08:30.661301] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-22T18:08:30.661716] [DEBUG] [LOCAL ] CTDD: Trimmed 7919 records to 5135 (keeping 200 days of data) [2025-10-22T18:08:30.691661] [DEBUG] [LOCAL ] CTDD: Primary data saved (5135 records). [2025-10-22T18:08:30.691739] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-22T18:08:30.691808] [INFO ] [MAIN ] Update Progress: 546/2367 symbols completed. CTDD took 20.0s. Estimated remaining: 3h 48m 14s. Rate: 8.0 symbols/min [2025-10-22T18:08:30.861439] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:30.911385] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-22T18:08:30.911745] [INFO ] [MAIN ] CTRA: Loaded 53647 existing records. [2025-10-22T18:08:31.086757] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:31.086972] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-22T18:08:31.087029] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-22T18:08:31.087348] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-22T18:08:31.087404] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-22T18:08:31.323367] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-22T18:08:31.394386] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T18:08:31.454226] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:32.117699] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-22T18:08:32.917678] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-22T18:08:33.053936] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T18:08:33.174245] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T18:08:33.717679] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-22T18:08:33.802012] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T18:08:34.517700] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-22T18:08:35.238399] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T18:08:35.317736] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-22T18:08:35.934936] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T18:08:36.117744] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-22T18:08:36.480732] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T18:08:36.917686] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-22T18:08:37.092683] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T18:08:37.717723] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-22T18:08:38.517699] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-22T18:08:38.695074] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T18:08:39.317709] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-22T18:08:39.562011] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T18:08:39.629910] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T18:08:40.117698] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-22T18:08:40.219680] [DEBUG] [REMOTE ] CTO: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-22T18:08:40.219973] [WARN ] [REMOTE ] CTO: No data returned for month 2025-04 [2025-10-22T18:08:40.220073] [FATAL] [REMOTE ] CTO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:08:40.220150] [FATAL] [MAIN ] CTO: Failed to fetch primary data. [2025-10-22T18:08:40.220213] [WARN ] [MAIN ] CTO: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:08:40.220293] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-22T18:08:40.220373] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-22T18:08:40.220410] [INFO ] [LOCAL ] CTO: Starting deletion of derivative data. [2025-10-22T18:08:40.220550] [DEBUG] [LOCAL ] CTO: Deleted derivative data file. [2025-10-22T18:08:40.220632] [INFO ] [MAIN ] Update Progress: 547/2367 symbols completed. CTO took 13.3s. Estimated remaining: 3h 48m 14s. Rate: 8.0 symbols/min [2025-10-22T18:08:40.388148] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:40.458714] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T18:08:40.470204] [DEBUG] [LOCAL ] CTRE: Loaded 49466 existing records from primary storage. [2025-10-22T18:08:40.471313] [INFO ] [MAIN ] CTRE: Loaded 49466 existing records. [2025-10-22T18:08:40.643634] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:40.643860] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-22T18:08:40.643910] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-22T18:08:40.644103] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-22T18:08:40.644149] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-22T18:08:40.922805] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-22T18:08:40.999524] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:41.717687] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-22T18:08:42.517689] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-22T18:08:42.956017] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-22T18:08:42.980063] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:08:43.317695] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-22T18:08:44.117670] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-22T18:08:44.284186] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:08:44.917700] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-22T18:08:45.312916] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T18:08:45.591613] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T18:08:45.717695] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-22T18:08:46.111458] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T18:08:46.517723] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-22T18:08:47.191784] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T18:08:47.317686] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-22T18:08:48.117634] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-22T18:08:48.580450] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T18:08:48.664436] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T18:08:48.917692] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-22T18:08:49.717689] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-22T18:08:49.808172] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:08:50.517678] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-22T18:08:50.938183] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-22T18:08:50.981398] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T18:08:51.156378] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T18:08:51.317725] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-22T18:08:52.117726] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-22T18:08:52.917712] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-22T18:08:53.110184] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T18:08:53.310875] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-22T18:08:53.649341] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:08:53.656731] [INFO ] [REMOTE ] CTOS: Full fetch complete (53973 records). [2025-10-22T18:08:53.656911] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-22T18:08:53.722795] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-22T18:08:54.042484] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-22T18:08:54.042586] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-22T18:08:54.043335] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-22T18:08:54.043419] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-22T18:08:54.044578] [DEBUG] [LOCAL ] CTOS: Trimmed 53973 records to 37221 (keeping 200 days of data) [2025-10-22T18:08:54.260834] [DEBUG] [LOCAL ] CTOS: Primary data saved (37221 records). [2025-10-22T18:08:54.260967] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-22T18:08:54.261037] [INFO ] [MAIN ] Update Progress: 548/2367 symbols completed. CTOS took 25.5s. Estimated remaining: 3h 48m 28s. Rate: 8.0 symbols/min [2025-10-22T18:08:54.452502] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:54.490361] [DEBUG] [LOCAL ] CTRI: Loaded 40676 existing records from primary storage. [2025-10-22T18:08:54.490697] [INFO ] [MAIN ] CTRI: Loaded 40676 existing records. [2025-10-22T18:08:54.522787] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-22T18:08:54.599931] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T18:08:54.686534] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:54.686779] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-22T18:08:54.686830] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-22T18:08:54.687138] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-22T18:08:54.687197] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-22T18:08:55.059036] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:55.317715] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-22T18:08:56.117699] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-22T18:08:56.505367] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-22T18:08:56.685440] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T18:08:56.686851] [INFO ] [REMOTE ] CTBB: Full fetch complete (10074 records). [2025-10-22T18:08:56.686920] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-22T18:08:56.926985] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-22T18:08:57.057226] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-22T18:08:57.057340] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-22T18:08:57.057767] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-22T18:08:57.057843] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-22T18:08:57.058464] [DEBUG] [LOCAL ] CTBB: Trimmed 10074 records to 6394 (keeping 200 days of data) [2025-10-22T18:08:57.111417] [DEBUG] [LOCAL ] CTBB: Primary data saved (6394 records). [2025-10-22T18:08:57.121327] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-22T18:08:57.121435] [INFO ] [MAIN ] Update Progress: 549/2367 symbols completed. CTBB took 48.4s. Estimated remaining: 3h 48m 5s. Rate: 8.0 symbols/min [2025-10-22T18:08:57.153827] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:08:57.298028] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:57.314725] [DEBUG] [LOCAL ] CTS: Loaded 19552 existing records from primary storage. [2025-10-22T18:08:57.314944] [INFO ] [MAIN ] CTS: Loaded 19552 existing records. [2025-10-22T18:08:57.484810] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:57.485010] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-22T18:08:57.485056] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-22T18:08:57.485222] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-22T18:08:57.485260] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-22T18:08:57.726542] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-22T18:08:57.851505] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:57.938998] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T18:08:58.517721] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-22T18:08:59.319112] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-22T18:08:59.321516] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T18:08:59.862428] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:09:00.117725] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-22T18:09:00.917733] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-22T18:09:01.502729] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-22T18:09:01.570558] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T18:09:01.717769] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-22T18:09:01.806035] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T18:09:02.517747] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-22T18:09:03.317698] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-22T18:09:03.542560] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T18:09:03.957615] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T18:09:04.065847] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T18:09:04.117690] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-22T18:09:04.917717] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-22T18:09:05.164165] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T18:09:05.717753] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-22T18:09:06.517760] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-22T18:09:06.784149] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:09:06.996487] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T18:09:07.317676] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-22T18:09:07.726044] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T18:09:08.117738] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-22T18:09:08.917742] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-22T18:09:09.157256] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T18:09:09.187515] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T18:09:09.717751] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-22T18:09:10.517700] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-22T18:09:10.651346] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T18:09:10.873182] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T18:09:11.317698] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-22T18:09:12.058951] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T18:09:12.117700] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-22T18:09:12.917739] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-22T18:09:13.162315] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:09:13.170555] [INFO ] [REMOTE ] CTRE: Full fetch complete (71317 records). [2025-10-22T18:09:13.170729] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-22T18:09:13.501248] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T18:09:13.597437] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-22T18:09:13.597527] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-22T18:09:13.598358] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-22T18:09:13.598447] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-22T18:09:13.599886] [DEBUG] [LOCAL ] CTRE: Trimmed 71317 records to 49425 (keeping 200 days of data) [2025-10-22T18:09:13.720378] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-22T18:09:13.893573] [DEBUG] [LOCAL ] CTRE: Primary data saved (49425 records). [2025-10-22T18:09:13.893717] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-22T18:09:13.894333] [INFO ] [MAIN ] Update Progress: 550/2367 symbols completed. CTRE took 33.7s. Estimated remaining: 3h 48m 28s. Rate: 8.0 symbols/min [2025-10-22T18:09:14.061781] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:14.112792] [DEBUG] [LOCAL ] CTVA: Loaded 53305 existing records from primary storage. [2025-10-22T18:09:14.113086] [INFO ] [MAIN ] CTVA: Loaded 53305 existing records. [2025-10-22T18:09:14.247830] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T18:09:14.313791] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:09:14.313977] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-22T18:09:14.314022] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-22T18:09:14.314212] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-22T18:09:14.314258] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-22T18:09:14.527809] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-22T18:09:14.662948] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:15.248856] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T18:09:15.317636] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-22T18:09:16.117734] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-22T18:09:16.715941] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T18:09:16.724946] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-22T18:09:16.725106] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-22T18:09:16.926951] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-22T18:09:17.116045] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T18:09:17.163492] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-22T18:09:17.163741] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-22T18:09:17.164674] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-22T18:09:17.164783] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-22T18:09:17.166257] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 53647 (keeping 200 days of data) [2025-10-22T18:09:17.490374] [DEBUG] [LOCAL ] CTRA: Primary data saved (53647 records). [2025-10-22T18:09:17.490495] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-22T18:09:17.490582] [INFO ] [MAIN ] Update Progress: 551/2367 symbols completed. CTRA took 46.8s. Estimated remaining: 3h 48m 7s. Rate: 8.0 symbols/min [2025-10-22T18:09:17.659878] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:17.660007] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-22T18:09:17.660044] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-22T18:09:17.660174] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-22T18:09:17.660240] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-22T18:09:17.660293] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-22T18:09:17.660334] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-22T18:09:17.722842] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-22T18:09:18.017215] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:18.098449] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T18:09:18.204464] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T18:09:18.517733] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-22T18:09:18.928686] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-22T18:09:19.198994] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T18:09:19.317703] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-22T18:09:20.117750] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-22T18:09:20.917674] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-22T18:09:21.159698] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T18:09:21.183538] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T18:09:21.183632] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-22T18:09:21.717828] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-22T18:09:22.517706] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-22T18:09:23.317685] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-22T18:09:23.519254] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T18:09:23.526771] [INFO ] [REMOTE ] CTRI: Full fetch complete (53943 records). [2025-10-22T18:09:23.526872] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-22T18:09:23.527445] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:09:23.527529] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:09:23.527570] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:09:23.527609] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-22T18:09:23.527724] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-22T18:09:23.527767] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-22T18:09:23.527936] [DEBUG] [LOCAL ] CTRI: Deleted derivative data file. [2025-10-22T18:09:23.528021] [INFO ] [MAIN ] Update Progress: 552/2367 symbols completed. CTRI took 29.3s. Estimated remaining: 3h 47m 55s. Rate: 8.0 symbols/min [2025-10-22T18:09:23.698759] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-22T18:09:23.701838] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:23.703524] [DEBUG] [LOCAL ] CUBE: No existing data file found in primary storage. [2025-10-22T18:09:23.703569] [WARN ] [MAIN ] CUBE: No existing data found, performing full refresh instead. [2025-10-22T18:09:23.703706] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-22T18:09:23.703757] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-22T18:09:23.703799] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-22T18:09:23.703831] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-22T18:09:24.058770] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:24.117613] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-22T18:09:24.345017] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T18:09:24.917774] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-22T18:09:25.284209] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-22T18:09:25.717738] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-22T18:09:25.864534] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T18:09:26.055240] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-22T18:09:26.517885] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-22T18:09:27.317779] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-22T18:09:27.567369] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-22T18:09:28.117696] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-22T18:09:28.400531] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T18:09:28.917772] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-22T18:09:29.327555] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-22T18:09:29.339349] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T18:09:29.343054] [INFO ] [REMOTE ] CTS: Full fetch complete (27317 records). [2025-10-22T18:09:29.343128] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-22T18:09:29.706467] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-22T18:09:29.706543] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-22T18:09:29.707037] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-22T18:09:29.707098] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-22T18:09:29.707804] [DEBUG] [LOCAL ] CTS: Trimmed 27317 records to 19510 (keeping 200 days of data) [2025-10-22T18:09:29.757060] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-22T18:09:29.825737] [DEBUG] [LOCAL ] CTS: Primary data saved (19510 records). [2025-10-22T18:09:29.825877] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-22T18:09:29.825955] [INFO ] [MAIN ] Update Progress: 553/2367 symbols completed. CTS took 32.7s. Estimated remaining: 3h 47m 43s. Rate: 8.0 symbols/min [2025-10-22T18:09:29.996769] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:30.020234] [DEBUG] [LOCAL ] CUBI: Loaded 27119 existing records from primary storage. [2025-10-22T18:09:30.020477] [INFO ] [MAIN ] CUBI: Loaded 27119 existing records. [2025-10-22T18:09:30.195811] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:09:30.196048] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-22T18:09:30.196103] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-22T18:09:30.196379] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-22T18:09:30.196435] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-22T18:09:30.519945] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-22T18:09:30.546760] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:31.317695] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-22T18:09:31.565580] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T18:09:31.649538] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-22T18:09:32.117725] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-22T18:09:32.154589] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:09:32.917752] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-22T18:09:33.717723] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-22T18:09:33.912528] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T18:09:33.992509] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-22T18:09:34.517681] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-22T18:09:34.671382] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:09:35.001338] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-22T18:09:35.002081] [INFO ] [REMOTE ] CUBB: Full fetch complete (952 records). [2025-10-22T18:09:35.002146] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-22T18:09:35.172411] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-22T18:09:35.172560] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:09:35.172605] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:09:35.172693] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-22T18:09:35.172762] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-22T18:09:35.172844] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-22T18:09:35.172894] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-22T18:09:35.172948] [INFO ] [MAIN ] Update Progress: 554/2367 symbols completed. CUBB took 17.7s. Estimated remaining: 3h 47m 28s. Rate: 8.0 symbols/min [2025-10-22T18:09:35.321504] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-22T18:09:35.338607] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:35.384493] [DEBUG] [LOCAL ] CUK: Loaded 51065 existing records from primary storage. [2025-10-22T18:09:35.384812] [INFO ] [MAIN ] CUK: Loaded 51065 existing records. [2025-10-22T18:09:35.556677] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:09:35.556887] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-22T18:09:35.556932] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-22T18:09:35.557973] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-22T18:09:35.558031] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-22T18:09:35.908949] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:36.117681] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-22T18:09:36.733609] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:09:36.917719] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-22T18:09:37.717694] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-22T18:09:37.987016] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T18:09:38.022902] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T18:09:38.517741] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-22T18:09:39.298557] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:09:39.317608] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-22T18:09:39.766518] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T18:09:40.117712] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-22T18:09:40.917685] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-22T18:09:41.202390] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T18:09:41.238316] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T18:09:41.717703] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-22T18:09:42.517680] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-22T18:09:42.713744] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T18:09:43.209408] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T18:09:43.317699] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-22T18:09:44.117677] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-22T18:09:44.213326] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T18:09:44.372177] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T18:09:44.917699] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-22T18:09:45.717637] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-22T18:09:45.887267] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T18:09:46.056609] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T18:09:46.517700] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-22T18:09:47.133190] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:09:47.317691] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-22T18:09:48.117699] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-22T18:09:48.351296] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T18:09:48.426257] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T18:09:48.917713] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-22T18:09:49.717698] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-22T18:09:49.997517] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T18:09:50.067535] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T18:09:50.517667] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-22T18:09:51.317676] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-22T18:09:51.654694] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T18:09:51.893347] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T18:09:52.117716] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-22T18:09:52.583321] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T18:09:52.917744] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-22T18:09:53.717698] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-22T18:09:54.101410] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T18:09:54.142057] [INFO ] [REMOTE ] CUBI: Full fetch complete (39101 records). [2025-10-22T18:09:54.142223] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-22T18:09:54.144420] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T18:09:54.519127] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-22T18:09:54.529883] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-22T18:09:54.529950] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-22T18:09:54.530713] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-22T18:09:54.530887] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-22T18:09:54.532016] [DEBUG] [LOCAL ] CUBI: Trimmed 39101 records to 26998 (keeping 200 days of data) [2025-10-22T18:09:54.685477] [DEBUG] [LOCAL ] CUBI: Primary data saved (26998 records). [2025-10-22T18:09:54.685603] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-22T18:09:54.685701] [INFO ] [MAIN ] Update Progress: 555/2367 symbols completed. CUBI took 24.9s. Estimated remaining: 3h 47m 60s. Rate: 7.9 symbols/min [2025-10-22T18:09:54.850249] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:54.850420] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-22T18:09:54.850457] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-22T18:09:54.850583] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-22T18:09:54.850623] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-22T18:09:54.850698] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-22T18:09:54.850750] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-22T18:09:55.207661] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:55.317612] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-22T18:09:55.430367] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T18:09:55.438768] [INFO ] [REMOTE ] CUBE: Full fetch complete (73337 records). [2025-10-22T18:09:55.438911] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-22T18:09:55.817824] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-22T18:09:55.817902] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-22T18:09:55.818711] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-22T18:09:55.818775] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-22T18:09:55.820077] [DEBUG] [LOCAL ] CUBE: Trimmed 73337 records to 50871 (keeping 200 days of data) [2025-10-22T18:09:56.119919] [DEBUG] [LOCAL ] CUBE: Primary data saved (50871 records). [2025-10-22T18:09:56.119834] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-22T18:09:56.120836] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-22T18:09:56.120920] [INFO ] [MAIN ] Update Progress: 556/2367 symbols completed. CUBE took 32.6s. Estimated remaining: 3h 47m 33s. Rate: 8.0 symbols/min [2025-10-22T18:09:56.293326] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:56.323743] [DEBUG] [LOCAL ] CURB: Loaded 32813 existing records from primary storage. [2025-10-22T18:09:56.323987] [INFO ] [MAIN ] CURB: Loaded 32813 existing records. [2025-10-22T18:09:56.530457] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:09:56.530733] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-22T18:09:56.530789] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-22T18:09:56.531038] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-22T18:09:56.531097] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-22T18:09:56.854443] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T18:09:56.875046] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-22T18:09:56.920675] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-22T18:09:56.954166] [INFO ] [REMOTE ] CTVA: Full fetch complete (77235 records). [2025-10-22T18:09:56.953871] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:56.954713] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-22T18:09:57.084441] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T18:09:57.402831] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-22T18:09:57.402926] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-22T18:09:57.403840] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-22T18:09:57.403909] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-22T18:09:57.405448] [DEBUG] [LOCAL ] CTVA: Trimmed 77235 records to 53308 (keeping 200 days of data) [2025-10-22T18:09:57.499212] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T18:09:57.717951] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-22T18:09:57.743404] [DEBUG] [LOCAL ] CTVA: Primary data saved (53308 records). [2025-10-22T18:09:57.743550] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-22T18:09:57.744256] [INFO ] [MAIN ] Update Progress: 557/2367 symbols completed. CTVA took 43.8s. Estimated remaining: 3h 47m 6s. Rate: 8.0 symbols/min [2025-10-22T18:09:58.517721] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-22T18:09:59.173452] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T18:09:59.183637] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T18:09:59.317609] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-22T18:10:00.117714] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-22T18:10:00.540580] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T18:10:00.765805] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-22T18:10:00.917724] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-22T18:10:01.717761] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-22T18:10:02.483041] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T18:10:02.517711] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-22T18:10:02.545271] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:10:03.317754] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-22T18:10:04.076621] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T18:10:04.117737] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-22T18:10:04.840318] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-22T18:10:04.917613] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-22T18:10:04.952461] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T18:10:05.717714] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-22T18:10:06.517735] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-22T18:10:07.152964] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T18:10:07.156502] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-22T18:10:07.222152] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T18:10:07.317678] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-22T18:10:08.117677] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-22T18:10:08.481833] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T18:10:08.917723] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-22T18:10:09.372414] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:10:09.717715] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-22T18:10:10.427422] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:10:10.517720] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-22T18:10:11.106704] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T18:10:11.107844] [INFO ] [REMOTE ] CULP: Full fetch complete (4499 records). [2025-10-22T18:10:11.107914] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-22T18:10:11.318593] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-22T18:10:11.474289] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-22T18:10:11.474462] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-22T18:10:11.474698] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-22T18:10:11.474782] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-22T18:10:11.475320] [DEBUG] [LOCAL ] CULP: Trimmed 4499 records to 2843 (keeping 200 days of data) [2025-10-22T18:10:11.520615] [DEBUG] [LOCAL ] CULP: Primary data saved (2843 records). [2025-10-22T18:10:11.520856] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-22T18:10:11.521184] [INFO ] [MAIN ] Update Progress: 558/2367 symbols completed. CULP took 16.8s. Estimated remaining: 3h 47m 18s. Rate: 8.0 symbols/min [2025-10-22T18:10:11.523350] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T18:10:12.117750] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-22T18:10:12.826919] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T18:10:12.917757] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-22T18:10:13.918936] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T18:10:13.930224] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-22T18:10:13.981118] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T18:10:14.517717] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-22T18:10:15.950591] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T18:10:15.957489] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-22T18:10:16.814467] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (2.88 seconds). [2025-10-22T18:10:16.824348] [INFO ] [REMOTE ] CUK: Full fetch complete (74369 records). [2025-10-22T18:10:16.824488] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-22T18:10:17.237186] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-22T18:10:17.237318] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-22T18:10:17.238288] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-22T18:10:17.238431] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-22T18:10:17.239914] [DEBUG] [LOCAL ] CUK: Trimmed 74369 records to 51064 (keeping 200 days of data) [2025-10-22T18:10:17.548943] [DEBUG] [LOCAL ] CUK: Primary data saved (51064 records). [2025-10-22T18:10:17.549635] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-22T18:10:17.550454] [INFO ] [MAIN ] Update Progress: 559/2367 symbols completed. CUK took 42.4s. Estimated remaining: 3h 47m 6s. Rate: 8.0 symbols/min [2025-10-22T18:10:17.550323] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T18:10:17.560317] [INFO ] [REMOTE ] CURB: Full fetch complete (47560 records). [2025-10-22T18:10:17.560514] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-22T18:10:17.954348] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-22T18:10:17.954438] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-22T18:10:17.955135] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-22T18:10:17.955203] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-22T18:10:17.956323] [DEBUG] [LOCAL ] CURB: Trimmed 47560 records to 32786 (keeping 200 days of data) [2025-10-22T18:10:18.154816] [DEBUG] [LOCAL ] CURB: Primary data saved (32786 records). [2025-10-22T18:10:18.154980] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-22T18:10:18.155078] [INFO ] [MAIN ] Update Progress: 560/2367 symbols completed. CURB took 22.0s. Estimated remaining: 3h 46m 36s. Rate: 8.0 symbols/min [2025-10-22T18:10:18.796126] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:18.882872] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:18.884023] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:18.939693] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:18.940270] [DEBUG] [LOCAL ] CUZ: No existing data file found in primary storage. [2025-10-22T18:10:18.940315] [WARN ] [MAIN ] CUZ: No existing data found, performing full refresh instead. [2025-10-22T18:10:18.940404] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-22T18:10:18.940440] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-22T18:10:18.940478] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-10-22T18:10:18.940510] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-22T18:10:19.042137] [DEBUG] [LOCAL ] CVEO: Loaded 15250 existing records from primary storage. [2025-10-22T18:10:19.059638] [INFO ] [MAIN ] CVEO: Loaded 15250 existing records. [2025-10-22T18:10:19.187289] [DEBUG] [LOCAL ] CURV: Loaded 27190 existing records from primary storage. [2025-10-22T18:10:19.278769] [INFO ] [MAIN ] CURV: Loaded 27190 existing records. [2025-10-22T18:10:19.337378] [DEBUG] [LOCAL ] CVE: Loaded 53567 existing records from primary storage. [2025-10-22T18:10:19.431109] [INFO ] [MAIN ] CVE: Loaded 53567 existing records. [2025-10-22T18:10:19.645677] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:19.730096] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-22T18:10:19.819579] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:19.802320] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-22T18:10:19.819909] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-22T18:10:19.839500] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-22T18:10:19.879815] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-22T18:10:19.895809] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:19.901352] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-22T18:10:19.935779] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-22T18:10:19.973816] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:20.015624] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-22T18:10:20.020867] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-22T18:10:20.027095] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-22T18:10:20.049718] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-22T18:10:20.060526] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-22T18:10:20.082447] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-22T18:10:20.790130] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:20.810288] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-22T18:10:20.966084] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:20.966360] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-22T18:10:21.045812] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:21.046119] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-22T18:10:21.548092] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T18:10:21.558827] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-22T18:10:21.834103] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T18:10:21.836209] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-22T18:10:22.422536] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T18:10:22.425860] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-22T18:10:22.597857] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:10:22.608337] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-22T18:10:23.072861] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-22T18:10:23.076529] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-22T18:10:23.627015] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-22T18:10:23.632496] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-22T18:10:23.930553] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T18:10:24.040528] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-22T18:10:24.083737] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T18:10:24.117712] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-22T18:10:24.692926] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T18:10:24.917697] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-22T18:10:25.717700] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-22T18:10:25.892574] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:10:26.171717] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T18:10:26.517702] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-22T18:10:27.317671] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-22T18:10:27.362011] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:10:27.728537] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T18:10:28.117673] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-22T18:10:28.439898] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T18:10:28.917685] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-22T18:10:29.135183] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T18:10:29.717733] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-22T18:10:30.517670] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-22T18:10:30.844256] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T18:10:31.066951] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T18:10:31.317695] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-22T18:10:31.407473] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T18:10:32.117700] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-22T18:10:32.418976] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T18:10:32.917708] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-22T18:10:33.717674] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-22T18:10:33.969667] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:10:34.034801] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T18:10:34.517720] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-22T18:10:35.317694] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-22T18:10:35.688712] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T18:10:36.117675] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-22T18:10:36.229294] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T18:10:36.312257] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T18:10:36.917697] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-22T18:10:37.694530] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T18:10:37.717676] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-22T18:10:38.517695] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-22T18:10:38.602623] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T18:10:39.317680] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-22T18:10:39.413628] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T18:10:39.445200] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T18:10:39.447996] [INFO ] [REMOTE ] CVEO: Full fetch complete (20833 records). [2025-10-22T18:10:39.448073] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-22T18:10:39.448513] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:10:39.448599] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:10:39.448668] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:10:39.448730] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-22T18:10:39.448788] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-22T18:10:39.448825] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-10-22T18:10:39.448963] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-10-22T18:10:39.449030] [INFO ] [MAIN ] Update Progress: 561/2367 symbols completed. CVEO took 21.3s. Estimated remaining: 3h 47m 13s. Rate: 7.9 symbols/min [2025-10-22T18:10:39.622850] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:39.664109] [DEBUG] [LOCAL ] CVI: Loaded 46730 existing records from primary storage. [2025-10-22T18:10:39.664414] [INFO ] [MAIN ] CVI: Loaded 46730 existing records. [2025-10-22T18:10:39.836823] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:39.837026] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-22T18:10:39.837071] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-22T18:10:39.837278] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-22T18:10:39.837332] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-22T18:10:40.122966] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-22T18:10:40.188089] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:40.917713] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-22T18:10:41.149463] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T18:10:41.374499] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T18:10:41.717718] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-22T18:10:42.134911] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T18:10:42.517676] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-22T18:10:42.840856] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T18:10:43.317727] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-22T18:10:44.109724] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T18:10:44.117688] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-22T18:10:44.869138] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T18:10:44.917727] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-22T18:10:45.717722] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-22T18:10:45.997547] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T18:10:46.517704] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-22T18:10:46.937798] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T18:10:47.195145] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T18:10:47.317759] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-22T18:10:48.117706] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-22T18:10:48.244973] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T18:10:48.917691] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-22T18:10:49.353310] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:10:49.362458] [INFO ] [REMOTE ] CVE: Full fetch complete (77718 records). [2025-10-22T18:10:49.362615] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-22T18:10:49.723866] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-22T18:10:49.731687] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T18:10:49.819347] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-22T18:10:49.819437] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-22T18:10:49.820395] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-22T18:10:49.820472] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-22T18:10:49.821977] [DEBUG] [LOCAL ] CVE: Trimmed 77718 records to 53567 (keeping 200 days of data) [2025-10-22T18:10:50.145398] [DEBUG] [LOCAL ] CVE: Primary data saved (53567 records). [2025-10-22T18:10:50.145539] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-22T18:10:50.145627] [INFO ] [MAIN ] Update Progress: 562/2367 symbols completed. CVE took 32.0s. Estimated remaining: 3h 47m 16s. Rate: 7.9 symbols/min [2025-10-22T18:10:50.313164] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:50.328473] [DEBUG] [LOCAL ] CVLG: Loaded 15331 existing records from primary storage. [2025-10-22T18:10:50.328702] [INFO ] [MAIN ] CVLG: Loaded 15331 existing records. [2025-10-22T18:10:50.504308] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:50.504564] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-22T18:10:50.504625] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-22T18:10:50.504952] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-22T18:10:50.505054] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-22T18:10:50.535789] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-22T18:10:50.651239] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:10:50.899443] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:51.317726] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-22T18:10:51.504734] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:10:51.512619] [INFO ] [REMOTE ] CUZ: Full fetch complete (70793 records). [2025-10-22T18:10:51.512769] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-22T18:10:51.900362] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-22T18:10:51.900487] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-22T18:10:51.901328] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-22T18:10:51.901430] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-22T18:10:51.902885] [DEBUG] [LOCAL ] CUZ: Trimmed 70793 records to 49436 (keeping 200 days of data) [2025-10-22T18:10:52.136111] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-22T18:10:52.140191] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T18:10:52.152174] [INFO ] [REMOTE ] CURV: Full fetch complete (38929 records). [2025-10-22T18:10:52.154365] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-22T18:10:52.399957] [DEBUG] [LOCAL ] CUZ: Primary data saved (49436 records). [2025-10-22T18:10:52.473354] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-22T18:10:52.499471] [INFO ] [MAIN ] Update Progress: 563/2367 symbols completed. CUZ took 34.3s. Estimated remaining: 3h 46m 51s. Rate: 8.0 symbols/min [2025-10-22T18:10:52.556617] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T18:10:52.795778] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-22T18:10:52.801939] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-22T18:10:52.812609] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-22T18:10:52.827906] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-22T18:10:52.831469] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:52.832446] [DEBUG] [LOCAL ] CURV: Trimmed 38929 records to 27192 (keeping 200 days of data) [2025-10-22T18:10:52.919944] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-22T18:10:52.979281] [DEBUG] [LOCAL ] CVNA: Loaded 52839 existing records from primary storage. [2025-10-22T18:10:53.007754] [INFO ] [MAIN ] CVNA: Loaded 52839 existing records. [2025-10-22T18:10:53.119297] [DEBUG] [LOCAL ] CURV: Primary data saved (27192 records). [2025-10-22T18:10:53.124976] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-22T18:10:53.135317] [INFO ] [MAIN ] Update Progress: 564/2367 symbols completed. CURV took 35.0s. Estimated remaining: 3h 46m 22s. Rate: 8.0 symbols/min [2025-10-22T18:10:53.297096] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:53.297286] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-22T18:10:53.297357] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-22T18:10:53.303044] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-22T18:10:53.308207] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-22T18:10:53.453352] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:53.656558] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T18:10:53.731554] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-22T18:10:53.761865] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:53.813853] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-22T18:10:53.812841] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T18:10:53.823499] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-22T18:10:54.009662] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:54.009858] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-22T18:10:54.009905] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-22T18:10:54.010110] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-22T18:10:54.010166] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-22T18:10:54.352938] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:54.517679] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-22T18:10:54.620877] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T18:10:55.317690] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-22T18:10:56.117715] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-22T18:10:56.674848] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-22T18:10:56.917716] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-22T18:10:57.176329] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:10:57.585532] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T18:10:57.717764] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-22T18:10:58.517714] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-22T18:10:58.598219] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:10:59.317745] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-22T18:10:59.676971] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-22T18:10:59.776839] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T18:11:00.117708] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-22T18:11:00.917732] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-22T18:11:01.717730] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-22T18:11:01.794048] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-22T18:11:02.517726] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-22T18:11:02.969356] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-22T18:11:03.317769] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-22T18:11:03.331886] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-22T18:11:04.117759] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-22T18:11:04.418365] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T18:11:04.736612] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (3.02 seconds). [2025-10-22T18:11:04.917691] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-22T18:11:05.331316] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T18:11:05.421412] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T18:11:05.717698] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-22T18:11:06.517700] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-22T18:11:06.985217] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T18:11:07.317759] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-22T18:11:07.788382] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T18:11:08.117677] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-22T18:11:08.241422] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T18:11:08.241120] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:11:08.917716] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-22T18:11:09.717713] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-22T18:11:10.341439] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T18:11:10.517607] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-22T18:11:10.686046] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:11:10.703208] [INFO ] [REMOTE ] CVI: Full fetch complete (66871 records). [2025-10-22T18:11:10.703572] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T18:11:10.706497] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-22T18:11:10.707571] [FATAL] [VALIDATOR ] CVI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:11:10.707716] [FATAL] [MAIN ] CVI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:11:10.707764] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:11:10.707831] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-22T18:11:10.707908] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-22T18:11:10.707962] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-22T18:11:10.708530] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-10-22T18:11:10.708617] [INFO ] [MAIN ] Update Progress: 565/2367 symbols completed. CVI took 31.3s. Estimated remaining: 3h 46m 46s. Rate: 7.9 symbols/min [2025-10-22T18:11:10.883475] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:10.934173] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-22T18:11:10.934495] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-22T18:11:11.119079] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:11:11.119289] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-22T18:11:11.119337] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-22T18:11:11.119520] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-22T18:11:11.119557] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-22T18:11:11.320085] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-22T18:11:11.509502] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:11:12.117684] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-22T18:11:12.331337] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T18:11:12.363766] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:11:12.917738] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-22T18:11:13.717737] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-22T18:11:14.142536] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T18:11:14.517700] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-22T18:11:14.558280] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T18:11:14.560964] [INFO ] [REMOTE ] CVLG: Full fetch complete (21317 records). [2025-10-22T18:11:14.561076] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-22T18:11:14.949858] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-22T18:11:14.950065] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-22T18:11:14.950543] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-22T18:11:14.950758] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-22T18:11:14.951544] [DEBUG] [LOCAL ] CVLG: Trimmed 21317 records to 15231 (keeping 200 days of data) [2025-10-22T18:11:15.050486] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T18:11:15.085962] [DEBUG] [LOCAL ] CVLG: Primary data saved (15231 records). [2025-10-22T18:11:15.086106] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-22T18:11:15.086190] [INFO ] [MAIN ] Update Progress: 566/2367 symbols completed. CVLG took 24.9s. Estimated remaining: 3h 46m 29s. Rate: 8.0 symbols/min [2025-10-22T18:11:15.256241] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:15.276995] [DEBUG] [LOCAL ] CW: Loaded 21993 existing records from primary storage. [2025-10-22T18:11:15.277241] [INFO ] [MAIN ] CW: Loaded 21993 existing records. [2025-10-22T18:11:15.330007] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-22T18:11:15.460314] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:11:15.460505] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-22T18:11:15.460553] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-22T18:11:15.460770] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-22T18:11:15.460825] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-22T18:11:15.809702] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:11:16.117808] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-22T18:11:16.807933] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-22T18:11:16.917701] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-22T18:11:17.519174] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T18:11:17.715378] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-22T18:11:17.725969] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-22T18:11:18.517774] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-22T18:11:19.223391] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-22T18:11:19.317616] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-22T18:11:19.857488] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-22T18:11:20.117670] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-22T18:11:20.217311] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T18:11:20.917732] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-22T18:11:21.253783] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T18:11:21.461613] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:11:21.717700] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-22T18:11:22.517638] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-22T18:11:23.002485] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-22T18:11:23.317708] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-22T18:11:23.943568] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-22T18:11:23.953250] [INFO ] [REMOTE ] CVNA: Full fetch complete (76742 records). [2025-10-22T18:11:23.953389] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-22T18:11:24.117945] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-22T18:11:24.397765] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-22T18:11:24.397931] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-22T18:11:24.398993] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-22T18:11:24.399114] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-22T18:11:24.401347] [DEBUG] [LOCAL ] CVNA: Trimmed 76742 records to 52837 (keeping 200 days of data) [2025-10-22T18:11:24.559271] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T18:11:24.571257] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T18:11:24.774220] [DEBUG] [LOCAL ] CVNA: Primary data saved (52837 records). [2025-10-22T18:11:24.774350] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-22T18:11:24.774429] [INFO ] [MAIN ] Update Progress: 567/2367 symbols completed. CVNA took 32.2s. Estimated remaining: 3h 46m 28s. Rate: 7.9 symbols/min [2025-10-22T18:11:24.922821] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-22T18:11:24.972201] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:25.023331] [DEBUG] [LOCAL ] CWAN: Loaded 52682 existing records from primary storage. [2025-10-22T18:11:25.023682] [INFO ] [MAIN ] CWAN: Loaded 52682 existing records. [2025-10-22T18:11:25.224205] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:11:25.226096] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T18:11:25.234630] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-22T18:11:25.235090] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-22T18:11:25.235294] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-22T18:11:25.235334] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-22T18:11:25.277679] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-22T18:11:25.303731] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-22T18:11:25.731826] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-22T18:11:25.954758] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:11:26.001127] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-22T18:11:26.001222] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-22T18:11:26.002158] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-22T18:11:26.002226] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-22T18:11:26.003742] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-22T18:11:26.323094] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-22T18:11:26.323246] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-22T18:11:26.323334] [INFO ] [MAIN ] Update Progress: 568/2367 symbols completed. CVS took 33.2s. Estimated remaining: 3h 46m 1s. Rate: 8.0 symbols/min [2025-10-22T18:11:26.495296] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:26.517719] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-22T18:11:26.536443] [DEBUG] [LOCAL ] CWEN: Loaded 45297 existing records from primary storage. [2025-10-22T18:11:26.536798] [INFO ] [MAIN ] CWEN: Loaded 45297 existing records. [2025-10-22T18:11:26.714848] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:11:26.715051] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-22T18:11:26.715098] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-22T18:11:26.715357] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-22T18:11:26.715397] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-22T18:11:27.038457] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T18:11:27.098254] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:11:27.317689] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-22T18:11:27.444845] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-22T18:11:27.874946] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T18:11:28.117722] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-22T18:11:28.745360] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T18:11:28.917746] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-22T18:11:29.713772] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:11:29.722216] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-22T18:11:30.517698] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-22T18:11:31.298609] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T18:11:31.317609] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-22T18:11:32.117718] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-22T18:11:32.525363] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (3.61 seconds). [2025-10-22T18:11:32.592099] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T18:11:32.684734] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T18:11:32.917690] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-22T18:11:33.650115] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:11:33.717673] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-22T18:11:34.517741] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-22T18:11:35.317723] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-22T18:11:35.384253] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-22T18:11:35.644977] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T18:11:36.117670] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-22T18:11:36.145471] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:11:36.472132] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T18:11:36.917732] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-22T18:11:37.717760] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-22T18:11:38.542948] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-22T18:11:38.571709] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T18:11:38.576365] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-22T18:11:39.038823] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T18:11:39.317618] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-22T18:11:40.117681] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-22T18:11:40.277453] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:11:40.865557] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T18:11:40.917618] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-22T18:11:41.266260] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T18:11:41.269691] [INFO ] [REMOTE ] CW: Full fetch complete (33010 records). [2025-10-22T18:11:41.269772] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-22T18:11:41.629486] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-22T18:11:41.629580] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-22T18:11:41.630113] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-22T18:11:41.630179] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-22T18:11:41.631101] [DEBUG] [LOCAL ] CW: Trimmed 33010 records to 21935 (keeping 200 days of data) [2025-10-22T18:11:41.728700] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-22T18:11:41.782999] [DEBUG] [LOCAL ] CW: Primary data saved (21935 records). [2025-10-22T18:11:41.783156] [INFO ] [MAIN ] CW: Full history saved. [2025-10-22T18:11:41.783262] [INFO ] [MAIN ] Update Progress: 569/2367 symbols completed. CW took 26.7s. Estimated remaining: 3h 46m 19s. Rate: 7.9 symbols/min [2025-10-22T18:11:41.950987] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:41.951556] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-22T18:11:41.951632] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-22T18:11:41.951838] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-22T18:11:41.951881] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-22T18:11:41.951923] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-22T18:11:41.951960] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-22T18:11:42.316527] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:11:42.450131] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:11:42.517690] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-22T18:11:43.317694] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-22T18:11:43.391800] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T18:11:44.117767] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-22T18:11:44.323799] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:11:44.917685] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-22T18:11:45.016738] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T18:11:45.630459] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:11:45.717686] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-22T18:11:46.485585] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:11:46.517680] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-22T18:11:47.317682] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-22T18:11:47.551226] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T18:11:48.117666] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-22T18:11:48.626807] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-22T18:11:48.917690] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-22T18:11:49.331006] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T18:11:49.717695] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-22T18:11:49.929765] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T18:11:50.477757] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T18:11:50.517714] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-22T18:11:51.317761] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-22T18:11:51.443056] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T18:11:51.981892] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T18:11:52.117704] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-22T18:11:52.917737] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-22T18:11:53.358278] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T18:11:53.717713] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-22T18:11:53.803697] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T18:11:54.159526] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T18:11:54.517687] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-22T18:11:55.278173] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T18:11:55.317679] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-22T18:11:56.117733] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-22T18:11:56.917743] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-22T18:11:57.094967] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T18:11:57.129980] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-22T18:11:57.138997] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-22T18:11:57.139195] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-22T18:11:57.544253] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-22T18:11:57.544388] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-22T18:11:57.545358] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-22T18:11:57.545426] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-22T18:11:57.546927] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-22T18:11:57.726861] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-22T18:11:57.910557] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-22T18:11:57.911361] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-22T18:11:57.912215] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T18:11:57.912361] [INFO ] [MAIN ] Update Progress: 570/2367 symbols completed. CVX took 47.2s. Estimated remaining: 3h 46m 38s. Rate: 7.9 symbols/min [2025-10-22T18:11:57.998049] [INFO ] [REMOTE ] CWEN: Full fetch complete (65670 records). [2025-10-22T18:11:58.023068] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-22T18:11:58.214342] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:58.503840] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-22T18:11:58.503953] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-22T18:11:58.504770] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-22T18:11:58.504852] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-22T18:11:58.506570] [DEBUG] [LOCAL ] CWEN: Trimmed 65670 records to 45287 (keeping 200 days of data) [2025-10-22T18:11:58.584771] [DEBUG] [LOCAL ] CWK: Loaded 49650 existing records from primary storage. [2025-10-22T18:11:58.636881] [INFO ] [MAIN ] CWK: Loaded 49650 existing records. [2025-10-22T18:11:58.694584] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:11:58.763930] [INFO ] [REMOTE ] CWAN: Full fetch complete (75609 records). [2025-10-22T18:11:58.794381] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-22T18:11:58.955066] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:11:59.021867] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-22T18:11:59.036272] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-22T18:11:59.053164] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-22T18:11:59.059799] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-22T18:11:59.519729] [DEBUG] [LOCAL ] CWEN: Primary data saved (45287 records). [2025-10-22T18:11:59.560809] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-22T18:11:59.631962] [INFO ] [MAIN ] Update Progress: 571/2367 symbols completed. CWEN took 33.3s. Estimated remaining: 3h 46m 12s. Rate: 7.9 symbols/min [2025-10-22T18:11:59.947101] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-22T18:12:00.021561] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-22T18:12:00.008241] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:00.036790] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-22T18:12:00.051083] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-22T18:12:00.084553] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-22T18:12:00.098404] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-22T18:12:00.098128] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:00.098789] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-22T18:12:00.099584] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-22T18:12:00.099875] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-22T18:12:00.099942] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-22T18:12:00.100037] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-22T18:12:00.100104] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-22T18:12:00.122567] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-22T18:12:00.204511] [DEBUG] [LOCAL ] CWAN: Trimmed 75609 records to 52687 (keeping 200 days of data) [2025-10-22T18:12:00.577190] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:00.591806] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-22T18:12:00.784572] [DEBUG] [LOCAL ] CWAN: Primary data saved (52687 records). [2025-10-22T18:12:00.784795] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-22T18:12:00.784996] [INFO ] [MAIN ] Update Progress: 572/2367 symbols completed. CWAN took 36.0s. Estimated remaining: 3h 45m 45s. Rate: 8.0 symbols/min [2025-10-22T18:12:00.957334] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:01.007442] [DEBUG] [LOCAL ] CX: Loaded 52833 existing records from primary storage. [2025-10-22T18:12:01.007848] [INFO ] [MAIN ] CX: Loaded 52833 existing records. [2025-10-22T18:12:01.184247] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:01.184456] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-22T18:12:01.184502] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-22T18:12:01.184761] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-22T18:12:01.184817] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-22T18:12:01.560861] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:01.561222] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-22T18:12:02.053454] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T18:12:02.062862] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-22T18:12:02.620118] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T18:12:02.626630] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-22T18:12:02.733010] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-22T18:12:03.317722] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-22T18:12:03.889520] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-22T18:12:04.117672] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-22T18:12:04.139217] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T18:12:04.294044] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-22T18:12:04.917702] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-22T18:12:05.045842] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T18:12:05.053904] [INFO ] [REMOTE ] CWH: Full fetch complete (73203 records). [2025-10-22T18:12:05.054060] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-22T18:12:05.460031] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-22T18:12:05.460175] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-22T18:12:05.461285] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-22T18:12:05.461352] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-22T18:12:05.463668] [DEBUG] [LOCAL ] CWH: Trimmed 73203 records to 51271 (keeping 200 days of data) [2025-10-22T18:12:05.718900] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-22T18:12:05.801355] [DEBUG] [LOCAL ] CWH: Primary data saved (51271 records). [2025-10-22T18:12:05.801692] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-22T18:12:05.801802] [INFO ] [MAIN ] Update Progress: 573/2367 symbols completed. CWH took 24.0s. Estimated remaining: 3h 45m 29s. Rate: 8.0 symbols/min [2025-10-22T18:12:06.008319] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:06.011530] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T18:12:06.028955] [DEBUG] [LOCAL ] CXE: Loaded 6372 existing records from primary storage. [2025-10-22T18:12:06.029145] [INFO ] [MAIN ] CXE: Loaded 6372 existing records. [2025-10-22T18:12:06.212625] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:06.212919] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-22T18:12:06.213038] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-22T18:12:06.219186] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-22T18:12:06.228730] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-22T18:12:06.274456] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T18:12:06.517723] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-22T18:12:06.600807] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:07.250541] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:12:07.317680] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-22T18:12:07.887975] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T18:12:08.117730] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-22T18:12:08.283254] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T18:12:08.917697] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-22T18:12:09.717716] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-22T18:12:09.733549] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T18:12:09.909093] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T18:12:10.517684] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-22T18:12:11.047924] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T18:12:11.317711] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-22T18:12:12.120622] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-22T18:12:12.298669] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T18:12:12.917668] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-22T18:12:13.101236] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T18:12:13.509376] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T18:12:13.717613] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-22T18:12:13.726846] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T18:12:14.517705] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-22T18:12:15.317735] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-22T18:12:15.718636] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T18:12:16.117702] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-22T18:12:16.279700] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T18:12:16.565805] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T18:12:16.847373] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T18:12:16.917734] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-22T18:12:17.717734] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-22T18:12:18.460542] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T18:12:18.525299] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-22T18:12:18.542519] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:12:19.317692] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-22T18:12:19.923544] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T18:12:20.117710] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-22T18:12:20.306705] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:12:20.508050] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-22T18:12:20.917707] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-22T18:12:21.522264] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T18:12:21.717682] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-22T18:12:22.517757] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-22T18:12:23.317752] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-22T18:12:23.445502] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T18:12:23.964315] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:12:24.060173] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T18:12:24.117701] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-22T18:12:24.917737] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-22T18:12:25.717708] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-22T18:12:26.088953] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T18:12:26.457981] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T18:12:26.459670] [INFO ] [REMOTE ] CXE: Full fetch complete (11439 records). [2025-10-22T18:12:26.459756] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-22T18:12:26.522766] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-22T18:12:26.681975] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:12:26.903343] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-22T18:12:26.903425] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-22T18:12:26.903695] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-22T18:12:26.903754] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-22T18:12:26.904173] [DEBUG] [LOCAL ] CXE: Trimmed 11439 records to 6414 (keeping 200 days of data) [2025-10-22T18:12:26.942446] [DEBUG] [LOCAL ] CXE: Primary data saved (6414 records). [2025-10-22T18:12:26.942604] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-22T18:12:26.942726] [INFO ] [MAIN ] Update Progress: 574/2367 symbols completed. CXE took 21.1s. Estimated remaining: 3h 46m 4s. Rate: 7.9 symbols/min [2025-10-22T18:12:27.122076] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:27.127915] [DEBUG] [LOCAL ] CXH: Loaded 4418 existing records from primary storage. [2025-10-22T18:12:27.128103] [INFO ] [MAIN ] CXH: Loaded 4418 existing records. [2025-10-22T18:12:27.298228] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:27.298430] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-22T18:12:27.298476] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-22T18:12:27.298622] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-22T18:12:27.298706] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-22T18:12:27.328510] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-22T18:12:27.667957] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:27.737429] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T18:12:28.117700] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-22T18:12:28.917690] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-22T18:12:28.962351] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:12:29.430463] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-22T18:12:29.449234] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T18:12:29.454693] [INFO ] [REMOTE ] CWT: Full fetch complete (41362 records). [2025-10-22T18:12:29.454830] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-22T18:12:29.722862] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-22T18:12:29.857103] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-22T18:12:29.857192] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-22T18:12:29.857994] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-22T18:12:29.858068] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-22T18:12:29.859138] [DEBUG] [LOCAL ] CWT: Trimmed 41362 records to 28062 (keeping 200 days of data) [2025-10-22T18:12:30.035508] [DEBUG] [LOCAL ] CWT: Primary data saved (28062 records). [2025-10-22T18:12:30.035673] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-22T18:12:30.035764] [INFO ] [MAIN ] Update Progress: 575/2367 symbols completed. CWT took 30.4s. Estimated remaining: 3h 45m 43s. Rate: 7.9 symbols/min [2025-10-22T18:12:30.200783] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:30.242488] [DEBUG] [LOCAL ] CXM: Loaded 47468 existing records from primary storage. [2025-10-22T18:12:30.242845] [INFO ] [MAIN ] CXM: Loaded 47468 existing records. [2025-10-22T18:12:30.428609] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:30.428875] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-22T18:12:30.428923] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-22T18:12:30.429110] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-22T18:12:30.429148] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-22T18:12:30.523106] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-22T18:12:30.930029] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:31.327469] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-22T18:12:31.355140] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:12:32.117707] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-22T18:12:32.414323] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T18:12:32.423444] [INFO ] [REMOTE ] CX: Full fetch complete (76587 records). [2025-10-22T18:12:32.423590] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-22T18:12:32.653347] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-22T18:12:32.826120] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-22T18:12:32.826223] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-22T18:12:32.827115] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-22T18:12:32.827189] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-22T18:12:32.828786] [DEBUG] [LOCAL ] CX: Trimmed 76587 records to 52826 (keeping 200 days of data) [2025-10-22T18:12:32.922353] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-22T18:12:32.948210] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T18:12:33.170375] [DEBUG] [LOCAL ] CX: Primary data saved (52826 records). [2025-10-22T18:12:33.170510] [INFO ] [MAIN ] CX: Full history saved. [2025-10-22T18:12:33.170588] [INFO ] [MAIN ] Update Progress: 576/2367 symbols completed. CX took 32.4s. Estimated remaining: 3h 45m 21s. Rate: 7.9 symbols/min [2025-10-22T18:12:33.335320] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:33.365621] [DEBUG] [LOCAL ] CXT: Loaded 30841 existing records from primary storage. [2025-10-22T18:12:33.365947] [INFO ] [MAIN ] CXT: Loaded 30841 existing records. [2025-10-22T18:12:33.437370] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-22T18:12:33.548386] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:33.548670] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-22T18:12:33.548730] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-22T18:12:33.548922] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-22T18:12:33.548978] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-22T18:12:33.723945] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-22T18:12:33.893357] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:34.352504] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T18:12:34.517705] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-22T18:12:35.317724] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-22T18:12:36.117684] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-22T18:12:36.166576] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T18:12:36.740093] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T18:12:36.917722] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-22T18:12:37.583916] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T18:12:37.717744] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-22T18:12:38.253334] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:12:38.517702] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-22T18:12:39.317684] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-22T18:12:39.468481] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:12:39.476948] [INFO ] [REMOTE ] CWK: Full fetch complete (71367 records). [2025-10-22T18:12:39.477124] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-22T18:12:39.890982] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-22T18:12:39.891149] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-22T18:12:39.891988] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-22T18:12:39.892052] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-22T18:12:39.893384] [DEBUG] [LOCAL ] CWK: Trimmed 71367 records to 49638 (keeping 200 days of data) [2025-10-22T18:12:40.122870] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-22T18:12:40.195822] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:12:40.224715] [DEBUG] [LOCAL ] CWK: Primary data saved (49638 records). [2025-10-22T18:12:40.224850] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-22T18:12:40.224931] [INFO ] [MAIN ] Update Progress: 577/2367 symbols completed. CWK took 42.3s. Estimated remaining: 3h 45m 12s. Rate: 7.9 symbols/min [2025-10-22T18:12:40.401827] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:40.441410] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T18:12:40.462456] [DEBUG] [LOCAL ] CXW: Loaded 43650 existing records from primary storage. [2025-10-22T18:12:40.462812] [INFO ] [MAIN ] CXW: Loaded 43650 existing records. [2025-10-22T18:12:40.636743] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:40.636998] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-22T18:12:40.637047] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-22T18:12:40.637271] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-22T18:12:40.637327] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-22T18:12:40.919671] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-22T18:12:40.927224] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T18:12:41.000735] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:41.717707] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-22T18:12:42.292857] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T18:12:42.517674] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-22T18:12:43.317671] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-22T18:12:43.877947] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T18:12:43.963747] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T18:12:43.963574] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-22T18:12:44.117668] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-22T18:12:44.917706] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-22T18:12:45.726662] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-22T18:12:45.731569] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:12:46.270921] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:12:46.517702] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-22T18:12:47.317760] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-22T18:12:47.397801] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T18:12:47.478826] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-22T18:12:48.117704] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-22T18:12:48.922836] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-22T18:12:48.943911] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:12:49.679598] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T18:12:49.705538] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-22T18:12:49.717610] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-22T18:12:50.517772] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-22T18:12:51.082701] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T18:12:51.317771] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-22T18:12:52.117676] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-22T18:12:52.171307] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T18:12:52.714168] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T18:12:52.719384] [INFO ] [REMOTE ] CXT: Full fetch complete (45673 records). [2025-10-22T18:12:52.719477] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-22T18:12:52.924940] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-22T18:12:53.090840] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-22T18:12:53.090917] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-22T18:12:53.091550] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-22T18:12:53.091591] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-22T18:12:53.092564] [DEBUG] [LOCAL ] CXT: Trimmed 45673 records to 30698 (keeping 200 days of data) [2025-10-22T18:12:53.275991] [DEBUG] [LOCAL ] CXT: Primary data saved (30698 records). [2025-10-22T18:12:53.276134] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-22T18:12:53.276211] [INFO ] [MAIN ] Update Progress: 578/2367 symbols completed. CXT took 20.1s. Estimated remaining: 3h 45m 22s. Rate: 7.9 symbols/min [2025-10-22T18:12:53.451341] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:53.451531] [DEBUG] [LOCAL ] CYD: No existing data file found in primary storage. [2025-10-22T18:12:53.451584] [WARN ] [MAIN ] CYD: No existing data found, performing full refresh instead. [2025-10-22T18:12:53.451717] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-22T18:12:53.451764] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-22T18:12:53.451806] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-22T18:12:53.451837] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-22T18:12:53.676497] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T18:12:53.727032] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-22T18:12:53.816337] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:53.941750] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T18:12:54.517715] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-22T18:12:54.948337] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-22T18:12:55.133263] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T18:12:55.317682] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-22T18:12:56.117681] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-22T18:12:56.474422] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T18:12:56.917686] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-22T18:12:57.600512] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T18:12:57.717682] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-22T18:12:57.796853] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T18:12:58.151497] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-22T18:12:58.152392] [INFO ] [REMOTE ] CXH: Full fetch complete (5303 records). [2025-10-22T18:12:58.152462] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-22T18:12:58.510425] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-22T18:12:58.510501] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-22T18:12:58.510662] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-22T18:12:58.510723] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-22T18:12:58.511093] [DEBUG] [LOCAL ] CXH: Trimmed 5303 records to 4392 (keeping 200 days of data) [2025-10-22T18:12:58.521489] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-22T18:12:58.539637] [DEBUG] [LOCAL ] CXH: Primary data saved (4392 records). [2025-10-22T18:12:58.539791] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-22T18:12:58.539893] [INFO ] [MAIN ] Update Progress: 579/2367 symbols completed. CXH took 31.6s. Estimated remaining: 3h 45m 7s. Rate: 7.9 symbols/min [2025-10-22T18:12:58.705207] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:58.748223] [DEBUG] [LOCAL ] CYH: Loaded 47712 existing records from primary storage. [2025-10-22T18:12:58.748528] [INFO ] [MAIN ] CYH: Loaded 47712 existing records. [2025-10-22T18:12:58.929853] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:58.930096] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-22T18:12:58.930176] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-22T18:12:58.930446] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-22T18:12:58.930513] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-22T18:12:59.274902] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:59.317615] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-22T18:13:00.117684] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-22T18:13:00.160051] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T18:13:00.917720] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-22T18:13:01.556535] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-22T18:13:01.717727] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-22T18:13:01.909948] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T18:13:02.517719] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-22T18:13:02.818481] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T18:13:03.317701] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-22T18:13:03.444303] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T18:13:04.079023] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T18:13:04.117711] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-22T18:13:04.909340] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T18:13:04.917126] [INFO ] [REMOTE ] CXM: Full fetch complete (68626 records). [2025-10-22T18:13:04.917302] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-22T18:13:04.917689] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-22T18:13:05.319950] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-22T18:13:05.320038] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-22T18:13:05.320854] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-22T18:13:05.320948] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-22T18:13:05.322327] [DEBUG] [LOCAL ] CXM: Trimmed 68626 records to 47404 (keeping 200 days of data) [2025-10-22T18:13:05.588814] [DEBUG] [LOCAL ] CXM: Primary data saved (47404 records). [2025-10-22T18:13:05.588939] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-22T18:13:05.589539] [INFO ] [MAIN ] Update Progress: 580/2367 symbols completed. CXM took 35.6s. Estimated remaining: 3h 44m 58s. Rate: 7.9 symbols/min [2025-10-22T18:13:05.717673] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-22T18:13:05.742860] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:13:05.799247] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:05.866612] [DEBUG] [LOCAL ] D: Loaded 53649 existing records from primary storage. [2025-10-22T18:13:05.867123] [INFO ] [MAIN ] D: Loaded 53649 existing records. [2025-10-22T18:13:06.057095] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:06.057536] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-22T18:13:06.057734] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-22T18:13:06.058187] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-22T18:13:06.058246] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-22T18:13:06.433458] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:06.460692] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T18:13:06.517676] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-22T18:13:07.033720] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T18:13:07.317937] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-22T18:13:08.117722] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-22T18:13:08.170104] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T18:13:08.917797] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-22T18:13:08.952048] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:13:09.717694] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-22T18:13:09.890874] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T18:13:09.947930] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:13:10.521802] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-22T18:13:11.317699] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-22T18:13:11.384937] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T18:13:11.838086] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T18:13:12.080689] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T18:13:12.117668] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-22T18:13:12.917700] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-22T18:13:13.317083] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T18:13:13.717694] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-22T18:13:14.427814] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T18:13:14.517613] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-22T18:13:15.317683] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-22T18:13:15.365585] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T18:13:16.117677] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-22T18:13:16.283178] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:13:16.613617] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T18:13:16.917717] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-22T18:13:17.717706] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-22T18:13:17.830379] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T18:13:18.262226] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T18:13:18.517697] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-22T18:13:19.291384] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T18:13:19.301904] [INFO ] [REMOTE ] CXW: Full fetch complete (64840 records). [2025-10-22T18:13:19.302107] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-22T18:13:19.325346] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-22T18:13:19.685457] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-22T18:13:19.685577] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-22T18:13:19.686395] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-22T18:13:19.686463] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-22T18:13:19.687845] [DEBUG] [LOCAL ] CXW: Trimmed 64840 records to 43639 (keeping 200 days of data) [2025-10-22T18:13:19.950870] [DEBUG] [LOCAL ] CXW: Primary data saved (43639 records). [2025-10-22T18:13:19.951274] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-22T18:13:19.951382] [INFO ] [MAIN ] Update Progress: 581/2367 symbols completed. CXW took 39.7s. Estimated remaining: 3h 45m 11s. Rate: 7.9 symbols/min [2025-10-22T18:13:20.118005] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:20.118145] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-22T18:13:20.131879] [DEBUG] [LOCAL ] DAC: Loaded 12508 existing records from primary storage. [2025-10-22T18:13:20.132070] [INFO ] [MAIN ] DAC: Loaded 12508 existing records. [2025-10-22T18:13:20.308096] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:20.308435] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-22T18:13:20.308489] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-22T18:13:20.309053] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-22T18:13:20.318994] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-22T18:13:20.437912] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T18:13:20.715998] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:20.917680] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-22T18:13:21.413905] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-22T18:13:21.503457] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T18:13:21.508991] [INFO ] [REMOTE ] CYD: Full fetch complete (36025 records). [2025-10-22T18:13:21.509104] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-22T18:13:21.725128] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-22T18:13:21.880854] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-22T18:13:21.942809] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-22T18:13:21.942877] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-22T18:13:21.943426] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-22T18:13:21.943465] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-22T18:13:21.944243] [DEBUG] [LOCAL ] CYD: Trimmed 36025 records to 27277 (keeping 200 days of data) [2025-10-22T18:13:22.102504] [DEBUG] [LOCAL ] CYD: Primary data saved (27277 records). [2025-10-22T18:13:22.102627] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-22T18:13:22.102731] [INFO ] [MAIN ] Update Progress: 582/2367 symbols completed. CYD took 28.8s. Estimated remaining: 3h 44m 47s. Rate: 7.9 symbols/min [2025-10-22T18:13:22.270434] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:22.315489] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-22T18:13:22.315822] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-22T18:13:22.485879] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:22.486048] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-22T18:13:22.486093] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-22T18:13:22.486473] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-22T18:13:22.486527] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-22T18:13:22.527288] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-22T18:13:22.840404] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:23.317750] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-22T18:13:23.605078] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T18:13:23.690494] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T18:13:24.117702] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-22T18:13:24.917743] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-22T18:13:25.081818] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T18:13:25.717756] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-22T18:13:25.843141] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T18:13:26.021805] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T18:13:26.517711] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-22T18:13:27.317671] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-22T18:13:27.554274] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T18:13:27.834870] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-22T18:13:28.117699] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-22T18:13:28.917723] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-22T18:13:29.188986] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T18:13:29.449108] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T18:13:29.717729] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-22T18:13:30.517702] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-22T18:13:30.916748] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T18:13:31.159583] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T18:13:31.225751] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T18:13:31.234376] [INFO ] [REMOTE ] CYH: Full fetch complete (69788 records). [2025-10-22T18:13:31.234575] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-22T18:13:31.322868] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-22T18:13:31.636296] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-22T18:13:31.636404] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-22T18:13:31.637237] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-22T18:13:31.637298] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-22T18:13:31.638523] [DEBUG] [LOCAL ] CYH: Trimmed 69788 records to 47658 (keeping 200 days of data) [2025-10-22T18:13:31.897860] [DEBUG] [LOCAL ] CYH: Primary data saved (47658 records). [2025-10-22T18:13:31.897996] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-22T18:13:31.898072] [INFO ] [MAIN ] Update Progress: 583/2367 symbols completed. CYH took 33.4s. Estimated remaining: 3h 44m 46s. Rate: 7.9 symbols/min [2025-10-22T18:13:32.062169] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:32.106639] [DEBUG] [LOCAL ] DAN: Loaded 49394 existing records from primary storage. [2025-10-22T18:13:32.106989] [INFO ] [MAIN ] DAN: Loaded 49394 existing records. [2025-10-22T18:13:32.122897] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-22T18:13:32.286286] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:32.286498] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-22T18:13:32.286544] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-22T18:13:32.286841] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-22T18:13:32.286896] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-22T18:13:32.635004] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:32.917715] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-22T18:13:33.239798] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T18:13:33.641822] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-22T18:13:33.717720] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-22T18:13:34.517705] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-22T18:13:34.951089] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T18:13:35.256416] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T18:13:35.317680] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-22T18:13:35.872621] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-22T18:13:36.117726] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-22T18:13:36.143290] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T18:13:36.917709] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-22T18:13:37.717726] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-22T18:13:38.025496] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-22T18:13:38.491489] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T18:13:38.517718] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-22T18:13:38.853975] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T18:13:39.317702] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-22T18:13:40.117698] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-22T18:13:40.174028] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T18:13:40.182960] [INFO ] [REMOTE ] D: Full fetch complete (77812 records). [2025-10-22T18:13:40.183091] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-22T18:13:40.594573] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-22T18:13:40.594733] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-22T18:13:40.595734] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-22T18:13:40.595839] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-22T18:13:40.623779] [DEBUG] [LOCAL ] D: Trimmed 77812 records to 53649 (keeping 200 days of data) [2025-10-22T18:13:40.625321] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-22T18:13:40.931504] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-22T18:13:40.957809] [DEBUG] [LOCAL ] D: Primary data saved (53649 records). [2025-10-22T18:13:40.957916] [INFO ] [MAIN ] D: Full history saved. [2025-10-22T18:13:40.957990] [INFO ] [MAIN ] Update Progress: 584/2367 symbols completed. D took 35.4s. Estimated remaining: 3h 44m 43s. Rate: 7.9 symbols/min [2025-10-22T18:13:41.128843] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:41.145610] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T18:13:41.149013] [INFO ] [REMOTE ] DAC: Full fetch complete (19136 records). [2025-10-22T18:13:41.149094] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-22T18:13:41.237933] [DEBUG] [LOCAL ] DAO: Loaded 19753 existing records from primary storage. [2025-10-22T18:13:41.264083] [INFO ] [MAIN ] DAO: Loaded 19753 existing records. [2025-10-22T18:13:41.642015] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:41.669935] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-22T18:13:41.682871] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-22T18:13:41.699188] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-22T18:13:41.710114] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-22T18:13:41.710234] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-22T18:13:41.710329] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-22T18:13:41.710805] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-22T18:13:41.731466] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-22T18:13:41.723688] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-22T18:13:41.793801] [DEBUG] [LOCAL ] DAC: Trimmed 19136 records to 12381 (keeping 200 days of data) [2025-10-22T18:13:42.081913] [DEBUG] [LOCAL ] DAC: Primary data saved (12381 records). [2025-10-22T18:13:42.096963] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-22T18:13:42.097152] [INFO ] [MAIN ] Update Progress: 585/2367 symbols completed. DAC took 22.1s. Estimated remaining: 3h 44m 16s. Rate: 7.9 symbols/min [2025-10-22T18:13:42.283036] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:42.351857] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:42.399399] [DEBUG] [LOCAL ] DAR: Loaded 52006 existing records from primary storage. [2025-10-22T18:13:42.399769] [INFO ] [MAIN ] DAR: Loaded 52006 existing records. [2025-10-22T18:13:42.521904] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-22T18:13:42.579201] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:42.580940] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-22T18:13:42.581000] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-22T18:13:42.591792] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-22T18:13:42.608941] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-22T18:13:42.648328] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T18:13:42.982912] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:43.317698] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-22T18:13:43.720261] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T18:13:43.896989] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T18:13:44.117703] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-22T18:13:44.923698] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-22T18:13:44.942316] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T18:13:45.717739] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-22T18:13:46.406689] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T18:13:46.466518] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T18:13:46.517672] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-22T18:13:47.317682] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-22T18:13:47.409802] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T18:13:48.117704] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-22T18:13:48.228981] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T18:13:48.663750] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T18:13:48.917696] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-22T18:13:49.717674] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-22T18:13:49.983705] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T18:13:50.517682] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-22T18:13:50.679947] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T18:13:51.093778] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T18:13:51.317738] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-22T18:13:52.117704] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-22T18:13:52.191927] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T18:13:52.917767] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-22T18:13:53.264615] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T18:13:53.506493] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T18:13:53.717710] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-22T18:13:54.517712] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-22T18:13:54.691355] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T18:13:54.852388] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T18:13:55.317698] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-22T18:13:56.117727] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-22T18:13:56.512627] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T18:13:56.711334] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T18:13:56.905566] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T18:13:56.917614] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-22T18:13:57.717697] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-22T18:13:58.491593] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T18:13:58.517612] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-22T18:13:59.317705] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-22T18:13:59.507464] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T18:14:00.117686] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-22T18:14:00.195087] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T18:14:00.203760] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-22T18:14:00.203888] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-22T18:14:00.557802] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:14:00.592574] [INFO ] [REMOTE ] DAN: Full fetch complete (71386 records). [2025-10-22T18:14:00.616899] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-22T18:14:00.741009] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-22T18:14:00.747576] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-22T18:14:00.754081] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-22T18:14:00.764774] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-22T18:14:00.824189] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 53753 (keeping 200 days of data) [2025-10-22T18:14:00.958908] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-22T18:14:01.312535] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-22T18:14:01.319985] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-22T18:14:01.321794] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-22T18:14:01.323687] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-22T18:14:01.360935] [DEBUG] [LOCAL ] DAN: Trimmed 71386 records to 49384 (keeping 200 days of data) [2025-10-22T18:14:01.556708] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-22T18:14:01.562131] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-22T18:14:01.562624] [INFO ] [MAIN ] Update Progress: 586/2367 symbols completed. DAL took 39.5s. Estimated remaining: 3h 44m 45s. Rate: 7.9 symbols/min [2025-10-22T18:14:01.875928] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:01.962548] [DEBUG] [LOCAL ] DAN: Primary data saved (49384 records). [2025-10-22T18:14:01.962731] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-22T18:14:01.962833] [INFO ] [MAIN ] Update Progress: 587/2367 symbols completed. DAN took 30.1s. Estimated remaining: 3h 44m 16s. Rate: 7.9 symbols/min [2025-10-22T18:14:02.109708] [DEBUG] [LOCAL ] DAVA: Loaded 41991 existing records from primary storage. [2025-10-22T18:14:02.115512] [INFO ] [MAIN ] DAVA: Loaded 41991 existing records. [2025-10-22T18:14:02.251554] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:02.350762] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:02.351097] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-22T18:14:02.351229] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-22T18:14:02.351455] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-22T18:14:02.351513] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-22T18:14:02.509471] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T18:14:02.606486] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-22T18:14:02.647495] [DEBUG] [LOCAL ] DAY: Loaded 49140 existing records from primary storage. [2025-10-22T18:14:02.695373] [INFO ] [MAIN ] DAY: Loaded 49140 existing records. [2025-10-22T18:14:02.799556] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-22T18:14:02.858819] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-22T18:14:02.986225] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:03.040206] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:03.040395] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-22T18:14:03.040443] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-22T18:14:03.040632] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-22T18:14:03.040723] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-22T18:14:03.322717] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-22T18:14:03.389440] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:04.117590] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-22T18:14:04.135618] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T18:14:04.917711] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-22T18:14:05.131301] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:14:05.538240] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-22T18:14:05.717710] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-22T18:14:06.044343] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T18:14:06.517693] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-22T18:14:06.723257] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-22T18:14:06.788712] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T18:14:07.317720] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-22T18:14:08.117729] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-22T18:14:08.281462] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:14:08.763236] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:14:08.917706] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-22T18:14:09.725381] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-22T18:14:09.742245] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:14:10.517685] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-22T18:14:11.233298] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T18:14:11.236943] [INFO ] [REMOTE ] DAO: Full fetch complete (32416 records). [2025-10-22T18:14:11.237021] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-22T18:14:11.317828] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-22T18:14:11.651791] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-10-22T18:14:11.650213] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-22T18:14:11.662157] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-22T18:14:11.662879] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-22T18:14:11.663134] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-22T18:14:11.665314] [DEBUG] [LOCAL ] DAO: Trimmed 32416 records to 19714 (keeping 200 days of data) [2025-10-22T18:14:11.779188] [DEBUG] [LOCAL ] DAO: Primary data saved (19714 records). [2025-10-22T18:14:11.779371] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-22T18:14:11.779478] [INFO ] [MAIN ] Update Progress: 588/2367 symbols completed. DAO took 30.8s. Estimated remaining: 3h 44m 15s. Rate: 7.9 symbols/min [2025-10-22T18:14:11.958321] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:11.972335] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T18:14:12.026142] [DEBUG] [LOCAL ] DB: Loaded 52474 existing records from primary storage. [2025-10-22T18:14:12.026455] [INFO ] [MAIN ] DB: Loaded 52474 existing records. [2025-10-22T18:14:12.123497] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-22T18:14:12.214695] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:12.214912] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-22T18:14:12.214961] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-22T18:14:12.215141] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-22T18:14:12.215180] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-22T18:14:12.588741] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:12.917685] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-22T18:14:13.039443] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:14:13.717676] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-22T18:14:13.908503] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:14:14.522861] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-22T18:14:14.543474] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T18:14:15.317719] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-22T18:14:15.430579] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T18:14:16.076386] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T18:14:16.117694] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-22T18:14:16.917721] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-22T18:14:17.224175] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T18:14:17.233245] [INFO ] [REMOTE ] DAR: Full fetch complete (75074 records). [2025-10-22T18:14:17.233397] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-22T18:14:17.625443] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-22T18:14:17.625555] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-22T18:14:17.626489] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-22T18:14:17.626549] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-22T18:14:17.628011] [DEBUG] [LOCAL ] DAR: Trimmed 75074 records to 51998 (keeping 200 days of data) [2025-10-22T18:14:17.733867] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-22T18:14:17.956772] [DEBUG] [LOCAL ] DAR: Primary data saved (51998 records). [2025-10-22T18:14:17.957463] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-22T18:14:17.958562] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:14:17.958709] [INFO ] [MAIN ] Update Progress: 589/2367 symbols completed. DAR took 35.9s. Estimated remaining: 3h 44m 3s. Rate: 7.9 symbols/min [2025-10-22T18:14:18.155804] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:18.155966] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-22T18:14:18.156004] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-22T18:14:18.156112] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-22T18:14:18.156154] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-22T18:14:18.156195] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-22T18:14:18.156228] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-22T18:14:18.519856] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-22T18:14:18.551932] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:18.580204] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T18:14:19.240496] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:14:19.317700] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-22T18:14:20.016060] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T18:14:20.117822] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-22T18:14:20.127412] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T18:14:20.917743] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-22T18:14:21.376626] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:14:21.717678] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-22T18:14:21.899099] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T18:14:22.517713] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-22T18:14:23.158549] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T18:14:23.317699] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-22T18:14:24.117711] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-22T18:14:24.291084] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T18:14:24.917734] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-22T18:14:25.209794] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T18:14:25.259621] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T18:14:25.717729] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-22T18:14:26.207178] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T18:14:26.517724] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-22T18:14:26.950784] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T18:14:27.317689] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-22T18:14:28.117702] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-22T18:14:28.659092] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-22T18:14:28.917729] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-22T18:14:29.123113] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T18:14:29.176610] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T18:14:29.717734] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-22T18:14:30.517751] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-22T18:14:30.750232] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T18:14:30.763911] [INFO ] [REMOTE ] DAY: Full fetch complete (71858 records). [2025-10-22T18:14:30.764154] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-22T18:14:31.298216] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-22T18:14:31.298449] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-22T18:14:31.299512] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-22T18:14:31.299684] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-22T18:14:31.301249] [DEBUG] [LOCAL ] DAY: Trimmed 71858 records to 49122 (keeping 200 days of data) [2025-10-22T18:14:31.349948] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-22T18:14:31.423252] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T18:14:31.618772] [DEBUG] [LOCAL ] DAY: Primary data saved (49122 records). [2025-10-22T18:14:31.618900] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-22T18:14:31.618985] [INFO ] [MAIN ] Update Progress: 590/2367 symbols completed. DAY took 29.7s. Estimated remaining: 3h 44m 14s. Rate: 7.9 symbols/min [2025-10-22T18:14:31.788785] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:31.828912] [DEBUG] [LOCAL ] DBI: Loaded 43510 existing records from primary storage. [2025-10-22T18:14:31.829212] [INFO ] [MAIN ] DBI: Loaded 43510 existing records. [2025-10-22T18:14:31.989082] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-22T18:14:32.036758] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:32.036909] [INFO ] [REMOTE ] DAVA: Full fetch complete (57331 records). [2025-10-22T18:14:32.037197] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-22T18:14:32.037325] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-22T18:14:32.037426] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-22T18:14:32.037880] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-22T18:14:32.037940] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-22T18:14:32.123608] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-22T18:14:32.766734] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:32.807015] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-22T18:14:32.807103] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-22T18:14:32.807939] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-22T18:14:32.808003] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-22T18:14:32.809238] [DEBUG] [LOCAL ] DAVA: Trimmed 57331 records to 41943 (keeping 200 days of data) [2025-10-22T18:14:32.920694] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-22T18:14:33.054797] [DEBUG] [LOCAL ] DAVA: Primary data saved (41943 records). [2025-10-22T18:14:33.054922] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-22T18:14:33.055000] [INFO ] [MAIN ] Update Progress: 591/2367 symbols completed. DAVA took 31.5s. Estimated remaining: 3h 43m 48s. Rate: 7.9 symbols/min [2025-10-22T18:14:33.226141] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:33.237001] [DEBUG] [LOCAL ] DBL: Loaded 9364 existing records from primary storage. [2025-10-22T18:14:33.237177] [INFO ] [MAIN ] DBL: Loaded 9364 existing records. [2025-10-22T18:14:33.417480] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:33.418260] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-22T18:14:33.418419] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-22T18:14:33.423959] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-22T18:14:33.432804] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-22T18:14:33.477812] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:14:33.620552] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-22T18:14:33.722751] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-22T18:14:33.838110] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:34.517685] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-22T18:14:34.753276] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T18:14:35.215272] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T18:14:35.317713] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-22T18:14:35.375248] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T18:14:36.117701] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-22T18:14:36.807728] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T18:14:36.917638] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-22T18:14:36.955684] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T18:14:37.717698] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-22T18:14:38.517821] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-22T18:14:38.591749] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:14:38.656166] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T18:14:39.225579] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T18:14:39.317705] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-22T18:14:40.117693] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-22T18:14:40.441601] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T18:14:40.917718] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-22T18:14:41.607838] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-22T18:14:41.717718] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-22T18:14:41.777320] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T18:14:42.485154] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T18:14:42.517678] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-22T18:14:43.317702] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-22T18:14:44.120301] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-22T18:14:44.123063] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T18:14:44.127883] [INFO ] [REMOTE ] DBD: Full fetch complete (31871 records). [2025-10-22T18:14:44.127959] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-22T18:14:44.128411] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:14:44.128491] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:14:44.128556] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:14:44.128628] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-22T18:14:44.128725] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-22T18:14:44.128767] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-22T18:14:44.128807] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-22T18:14:44.128860] [INFO ] [MAIN ] Update Progress: 592/2367 symbols completed. DBD took 26.2s. Estimated remaining: 3h 43m 51s. Rate: 7.9 symbols/min [2025-10-22T18:14:44.296516] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:44.339742] [DEBUG] [LOCAL ] DBRG: Loaded 49982 existing records from primary storage. [2025-10-22T18:14:44.340049] [INFO ] [MAIN ] DBRG: Loaded 49982 existing records. [2025-10-22T18:14:44.514994] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:44.515256] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-22T18:14:44.515326] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-22T18:14:44.515675] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-22T18:14:44.515734] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-22T18:14:44.805564] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T18:14:44.912512] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:44.917609] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-22T18:14:44.999098] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T18:14:45.717698] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-22T18:14:46.517710] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-22T18:14:46.708866] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T18:14:47.317672] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-22T18:14:47.358408] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T18:14:47.544975] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T18:14:48.117687] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-22T18:14:48.917725] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-22T18:14:48.944467] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:14:49.554412] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T18:14:49.717639] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-22T18:14:50.517677] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-22T18:14:50.774053] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T18:14:51.317690] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-22T18:14:51.364955] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T18:14:52.117677] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-22T18:14:52.218247] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T18:14:52.917707] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-22T18:14:53.249282] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:14:53.258092] [INFO ] [REMOTE ] DB: Full fetch complete (75639 records). [2025-10-22T18:14:53.258202] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-22T18:14:53.677418] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:14:53.682182] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-22T18:14:53.691299] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-22T18:14:53.692852] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-22T18:14:53.693211] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-22T18:14:53.695171] [DEBUG] [LOCAL ] DB: Trimmed 75639 records to 52466 (keeping 200 days of data) [2025-10-22T18:14:53.764118] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-22T18:14:53.906571] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T18:14:54.038413] [DEBUG] [LOCAL ] DB: Primary data saved (52466 records). [2025-10-22T18:14:54.038564] [INFO ] [MAIN ] DB: Full history saved. [2025-10-22T18:14:54.038671] [INFO ] [MAIN ] Update Progress: 593/2367 symbols completed. DB took 42.3s. Estimated remaining: 3h 43m 50s. Rate: 7.9 symbols/min [2025-10-22T18:14:54.202569] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:54.236802] [DEBUG] [LOCAL ] DCI: Loaded 36912 existing records from primary storage. [2025-10-22T18:14:54.237075] [INFO ] [MAIN ] DCI: Loaded 36912 existing records. [2025-10-22T18:14:54.417860] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:54.418107] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-22T18:14:54.418167] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-22T18:14:54.418389] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-22T18:14:54.418448] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-22T18:14:54.519802] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-22T18:14:54.775390] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:55.247956] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T18:14:55.317693] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-22T18:14:55.397416] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T18:14:56.117706] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-22T18:14:56.884545] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T18:14:56.917665] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-22T18:14:57.075129] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T18:14:57.712818] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T18:14:57.714568] [INFO ] [REMOTE ] DBL: Full fetch complete (12709 records). [2025-10-22T18:14:57.714636] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-22T18:14:57.725716] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-22T18:14:58.075576] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-22T18:14:58.075679] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-22T18:14:58.075976] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-22T18:14:58.076016] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-22T18:14:58.076473] [DEBUG] [LOCAL ] DBL: Trimmed 12709 records to 9247 (keeping 200 days of data) [2025-10-22T18:14:58.133445] [DEBUG] [LOCAL ] DBL: Primary data saved (9247 records). [2025-10-22T18:14:58.133576] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-22T18:14:58.133674] [INFO ] [MAIN ] Update Progress: 594/2367 symbols completed. DBL took 25.1s. Estimated remaining: 3h 43m 32s. Rate: 7.9 symbols/min [2025-10-22T18:14:58.298738] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:58.312380] [DEBUG] [LOCAL ] DCO: Loaded 14899 existing records from primary storage. [2025-10-22T18:14:58.312590] [INFO ] [MAIN ] DCO: Loaded 14899 existing records. [2025-10-22T18:14:58.488722] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:58.488951] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-22T18:14:58.488998] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-22T18:14:58.489158] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-22T18:14:58.489219] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-22T18:14:58.522936] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-22T18:14:58.836451] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:59.317685] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-22T18:14:59.355460] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:15:00.117706] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-22T18:15:00.167444] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T18:15:00.917722] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-22T18:15:01.107431] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T18:15:01.124855] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T18:15:01.717691] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-22T18:15:02.517710] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-22T18:15:03.173784] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-22T18:15:03.179856] [INFO ] [REMOTE ] DBI: Full fetch complete (64817 records). [2025-10-22T18:15:03.179952] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-22T18:15:03.322760] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-22T18:15:03.569443] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-22T18:15:03.569519] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-22T18:15:03.570323] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-22T18:15:03.570396] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-22T18:15:03.571615] [DEBUG] [LOCAL ] DBI: Trimmed 64817 records to 43370 (keeping 200 days of data) [2025-10-22T18:15:03.818802] [DEBUG] [LOCAL ] DBI: Primary data saved (43370 records). [2025-10-22T18:15:03.818929] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-22T18:15:03.819031] [INFO ] [MAIN ] Update Progress: 595/2367 symbols completed. DBI took 32.2s. Estimated remaining: 3h 43m 19s. Rate: 7.9 symbols/min [2025-10-22T18:15:03.986070] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:04.022734] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T18:15:04.042932] [DEBUG] [LOCAL ] DD: Loaded 52933 existing records from primary storage. [2025-10-22T18:15:04.043256] [INFO ] [MAIN ] DD: Loaded 52933 existing records. [2025-10-22T18:15:04.121944] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-22T18:15:04.224246] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:15:04.224494] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-22T18:15:04.224574] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-22T18:15:04.224869] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-22T18:15:04.224938] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-22T18:15:04.567903] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (2.85 seconds). [2025-10-22T18:15:04.630531] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:04.917702] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-22T18:15:05.350298] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T18:15:05.717696] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-22T18:15:05.943482] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T18:15:06.517710] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-22T18:15:07.317680] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-22T18:15:07.517409] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-22T18:15:07.982786] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-22T18:15:08.015292] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T18:15:08.117695] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-22T18:15:08.894293] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-22T18:15:08.917669] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-22T18:15:08.926816] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T18:15:09.717696] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-22T18:15:10.427190] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T18:15:10.517714] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-22T18:15:11.317677] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-22T18:15:11.510697] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T18:15:11.599504] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:15:12.117778] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-22T18:15:12.917716] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-22T18:15:13.025172] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T18:15:13.317834] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T18:15:13.717705] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-22T18:15:14.517739] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-22T18:15:14.666948] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:15:15.030702] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T18:15:15.317777] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-22T18:15:15.594539] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T18:15:16.117786] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-22T18:15:16.917697] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-22T18:15:17.466474] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T18:15:17.475243] [INFO ] [REMOTE ] DBRG: Full fetch complete (72550 records). [2025-10-22T18:15:17.475396] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-22T18:15:17.741978] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-22T18:15:17.805370] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T18:15:17.911244] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-22T18:15:17.911337] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-22T18:15:17.912204] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-22T18:15:17.912275] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-22T18:15:17.913756] [DEBUG] [LOCAL ] DBRG: Trimmed 72550 records to 49979 (keeping 200 days of data) [2025-10-22T18:15:18.212569] [DEBUG] [LOCAL ] DBRG: Primary data saved (49979 records). [2025-10-22T18:15:18.212956] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-22T18:15:18.213041] [INFO ] [MAIN ] Update Progress: 596/2367 symbols completed. DBRG took 34.1s. Estimated remaining: 3h 43m 32s. Rate: 7.9 symbols/min [2025-10-22T18:15:18.408922] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:18.457223] [DEBUG] [LOCAL ] DDD: Loaded 50947 existing records from primary storage. [2025-10-22T18:15:18.457518] [INFO ] [MAIN ] DDD: Loaded 50947 existing records. [2025-10-22T18:15:18.526764] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-22T18:15:18.635961] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:15:18.636236] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-22T18:15:18.636283] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-22T18:15:18.636836] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-22T18:15:18.636893] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-22T18:15:19.018437] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:19.029902] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T18:15:19.062357] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-22T18:15:19.317731] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-22T18:15:20.122748] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-22T18:15:20.136727] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T18:15:20.917722] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-22T18:15:21.061315] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:15:21.717745] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-22T18:15:21.822883] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T18:15:22.517748] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-22T18:15:22.565918] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T18:15:23.317683] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-22T18:15:23.481689] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T18:15:24.101737] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T18:15:24.117603] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-22T18:15:24.234159] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:15:24.917718] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-22T18:15:25.717742] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-22T18:15:25.977075] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T18:15:26.478905] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T18:15:26.484984] [INFO ] [REMOTE ] DCI: Full fetch complete (53641 records). [2025-10-22T18:15:26.485133] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-22T18:15:26.522768] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-22T18:15:26.883327] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-22T18:15:26.883407] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-22T18:15:26.884089] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-22T18:15:26.884152] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-22T18:15:26.885221] [DEBUG] [LOCAL ] DCI: Trimmed 53641 records to 36843 (keeping 200 days of data) [2025-10-22T18:15:27.104872] [DEBUG] [LOCAL ] DCI: Primary data saved (36843 records). [2025-10-22T18:15:27.105056] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-22T18:15:27.105169] [INFO ] [MAIN ] Update Progress: 597/2367 symbols completed. DCI took 33.1s. Estimated remaining: 3h 43m 28s. Rate: 7.9 symbols/min [2025-10-22T18:15:27.317695] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-22T18:15:27.506126] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T18:15:27.531499] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T18:15:28.117696] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-22T18:15:28.917672] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-22T18:15:29.343138] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T18:15:29.346687] [INFO ] [REMOTE ] DCO: Full fetch complete (19712 records). [2025-10-22T18:15:29.346797] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-22T18:15:29.568251] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-22T18:15:29.731082] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-22T18:15:29.781335] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-22T18:15:29.781421] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-22T18:15:29.781873] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-22T18:15:29.781940] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-22T18:15:29.782526] [DEBUG] [LOCAL ] DCO: Trimmed 19712 records to 14967 (keeping 200 days of data) [2025-10-22T18:15:29.870609] [DEBUG] [LOCAL ] DCO: Primary data saved (14967 records). [2025-10-22T18:15:29.870788] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-22T18:15:29.870870] [INFO ] [MAIN ] Update Progress: 598/2367 symbols completed. DCO took 31.7s. Estimated remaining: 3h 43m 7s. Rate: 7.9 symbols/min [2025-10-22T18:15:30.547817] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:15:30.559194] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-22T18:15:31.498587] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T18:15:31.509382] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-22T18:15:32.316026] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T18:15:32.327071] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-22T18:15:32.942149] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T18:15:32.953113] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-22T18:15:33.312009] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:15:33.320433] [INFO ] [REMOTE ] DD: Full fetch complete (76236 records). [2025-10-22T18:15:33.320568] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-22T18:15:33.321425] [FATAL] [VALIDATOR ] DD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:15:33.321523] [FATAL] [MAIN ] DD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:15:33.321565] [WARN ] [MAIN ] DD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:15:33.321628] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-22T18:15:33.321731] [DEBUG] [LOCAL ] DD: No primary data file found to delete. [2025-10-22T18:15:33.321775] [INFO ] [LOCAL ] DD: Starting deletion of derivative data. [2025-10-22T18:15:33.321939] [DEBUG] [LOCAL ] DD: Deleted derivative data file. [2025-10-22T18:15:33.322036] [INFO ] [MAIN ] Update Progress: 599/2367 symbols completed. DD took 29.5s. Estimated remaining: 3h 42m 47s. Rate: 7.9 symbols/min [2025-10-22T18:15:34.630592] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T18:15:34.641500] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-22T18:15:36.549520] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T18:15:36.560526] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-22T18:15:38.483034] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T18:15:38.494095] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-22T18:15:40.795430] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-22T18:15:40.804098] [INFO ] [REMOTE ] DDD: Full fetch complete (73969 records). [2025-10-22T18:15:40.804233] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-22T18:15:41.219256] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-22T18:15:41.219386] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-22T18:15:41.220323] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-22T18:15:41.220577] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-22T18:15:41.222149] [DEBUG] [LOCAL ] DDD: Trimmed 73969 records to 50948 (keeping 200 days of data) [2025-10-22T18:15:41.509616] [DEBUG] [LOCAL ] DDD: Primary data saved (50948 records). [2025-10-22T18:15:41.509787] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-22T18:15:41.509869] [INFO ] [MAIN ] Update Progress: 600/2367 symbols completed. DDD took 23.3s. Estimated remaining: 3h 42m 41s. Rate: 7.9 symbols/min [2025-10-22T18:15:42.180863] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:42.233903] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:42.235145] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:42.233081] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:42.235473] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-22T18:15:42.235956] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-22T18:15:42.236073] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-22T18:15:42.236116] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-22T18:15:42.236252] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-22T18:15:42.236313] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-22T18:15:42.364762] [DEBUG] [LOCAL ] DDS: Loaded 12448 existing records from primary storage. [2025-10-22T18:15:42.365306] [INFO ] [MAIN ] DDS: Loaded 12448 existing records. [2025-10-22T18:15:42.623884] [DEBUG] [LOCAL ] DDL: Loaded 37279 existing records from primary storage. [2025-10-22T18:15:42.660126] [INFO ] [MAIN ] DDL: Loaded 37279 existing records. [2025-10-22T18:15:42.660009] [DEBUG] [LOCAL ] DE: Loaded 47547 existing records from primary storage. [2025-10-22T18:15:42.708368] [INFO ] [MAIN ] DE: Loaded 47547 existing records. [2025-10-22T18:15:42.915737] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:15:42.942811] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-22T18:15:42.990193] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-22T18:15:43.102604] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-22T18:15:43.132845] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-22T18:15:43.205195] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:15:43.254333] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:15:43.200027] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:43.254626] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-22T18:15:43.263465] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-22T18:15:43.268728] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-22T18:15:43.279373] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-22T18:15:43.274164] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-22T18:15:43.303667] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-22T18:15:43.303767] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-22T18:15:43.353843] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-22T18:15:43.367813] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-22T18:15:44.041284] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T18:15:44.110692] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-22T18:15:44.287599] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:44.336600] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:44.331157] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-22T18:15:44.348953] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-22T18:15:44.412665] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:44.413564] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-22T18:15:44.547681] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T18:15:44.548730] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-22T18:15:45.015414] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T18:15:45.016636] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-22T18:15:45.377416] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T18:15:45.380492] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-22T18:15:45.526958] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T18:15:45.528846] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-22T18:15:45.548035] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T18:15:45.555217] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-22T18:15:45.996284] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T18:15:45.997325] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-22T18:15:46.163417] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:15:46.173198] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-22T18:15:46.265915] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T18:15:46.269100] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-22T18:15:46.430611] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-22T18:15:46.517724] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-22T18:15:46.896200] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:15:46.997807] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T18:15:47.174186] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T18:15:47.317693] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-22T18:15:47.695360] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T18:15:47.780401] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T18:15:48.117721] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-22T18:15:48.580875] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T18:15:48.917735] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-22T18:15:49.370902] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-22T18:15:49.371768] [INFO ] [REMOTE ] DDT: Full fetch complete (2815 records). [2025-10-22T18:15:49.371837] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-22T18:15:49.372178] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:15:49.372277] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:15:49.372350] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:15:49.372477] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-22T18:15:49.372554] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-22T18:15:49.372598] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-22T18:15:49.372686] [DEBUG] [LOCAL ] DDT: No derivative data file found to delete. [2025-10-22T18:15:49.372782] [INFO ] [MAIN ] Update Progress: 601/2367 symbols completed. DDT took 7.9s. Estimated remaining: 3h 42m 34s. Rate: 7.9 symbols/min [2025-10-22T18:15:49.541457] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:49.541620] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-22T18:15:49.541690] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-22T18:15:49.541805] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-22T18:15:49.541846] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-22T18:15:49.541889] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-22T18:15:49.541921] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-22T18:15:49.726084] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-22T18:15:49.895253] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:50.517681] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-22T18:15:51.317726] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-22T18:15:51.725476] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T18:15:51.792032] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T18:15:52.117729] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-22T18:15:52.369126] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T18:15:52.917739] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-22T18:15:53.566381] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:15:53.717700] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-22T18:15:53.980857] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T18:15:54.517715] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-22T18:15:55.317694] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-22T18:15:55.522559] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T18:15:56.117704] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-22T18:15:56.155034] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T18:15:56.872902] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T18:15:56.917706] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-22T18:15:57.058323] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T18:15:57.717701] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-22T18:15:58.473929] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T18:15:58.517615] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-22T18:15:58.558473] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:15:59.317708] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-22T18:15:59.539956] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T18:16:00.117741] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-22T18:16:00.917745] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-22T18:16:01.717803] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-22T18:16:02.300887] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-10-22T18:16:02.517744] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-22T18:16:02.547572] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-22T18:16:03.317715] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-22T18:16:03.980835] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-22T18:16:04.117683] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-22T18:16:04.357758] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (3.44 seconds). [2025-10-22T18:16:04.736426] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T18:16:04.917741] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-22T18:16:05.388031] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-22T18:16:05.717723] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-22T18:16:06.015749] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T18:16:06.017600] [INFO ] [REMOTE ] DDS: Full fetch complete (18488 records). [2025-10-22T18:16:06.017743] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-22T18:16:06.398319] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-22T18:16:06.398415] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-22T18:16:06.398837] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-22T18:16:06.398897] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-22T18:16:06.399401] [DEBUG] [LOCAL ] DDS: Trimmed 18488 records to 12375 (keeping 200 days of data) [2025-10-22T18:16:06.476870] [DEBUG] [LOCAL ] DDS: Primary data saved (12375 records). [2025-10-22T18:16:06.477000] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-22T18:16:06.477080] [INFO ] [MAIN ] Update Progress: 602/2367 symbols completed. DDS took 24.9s. Estimated remaining: 3h 42m 55s. Rate: 7.9 symbols/min [2025-10-22T18:16:06.534998] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-22T18:16:06.659044] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:06.659208] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-10-22T18:16:06.659246] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-10-22T18:16:06.659380] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-22T18:16:06.659438] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-22T18:16:06.659484] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-22T18:16:06.659517] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-22T18:16:07.030850] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:07.058569] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-22T18:16:07.129292] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T18:16:07.317725] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-22T18:16:07.770962] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T18:16:08.117616] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-22T18:16:08.185795] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T18:16:08.917732] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-22T18:16:09.717715] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-22T18:16:10.127301] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:16:10.518507] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-22T18:16:10.521132] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:16:10.939697] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T18:16:11.317681] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-22T18:16:12.072661] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T18:16:12.117714] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-22T18:16:12.917710] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-22T18:16:13.060626] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T18:16:13.069948] [INFO ] [REMOTE ] DDL: Full fetch complete (53636 records). [2025-10-22T18:16:13.070110] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-22T18:16:13.474791] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T18:16:13.473918] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-22T18:16:13.480526] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-22T18:16:13.481554] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-22T18:16:13.481923] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-22T18:16:13.482927] [DEBUG] [LOCAL ] DDL: Trimmed 53636 records to 37179 (keeping 200 days of data) [2025-10-22T18:16:13.685843] [DEBUG] [LOCAL ] DDL: Primary data saved (37179 records). [2025-10-22T18:16:13.685972] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-22T18:16:13.686050] [INFO ] [MAIN ] Update Progress: 603/2367 symbols completed. DDL took 32.2s. Estimated remaining: 3h 42m 46s. Rate: 7.9 symbols/min [2025-10-22T18:16:13.722854] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-22T18:16:13.855297] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:13.855435] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-22T18:16:13.855472] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-22T18:16:13.855577] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-22T18:16:13.855617] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-22T18:16:13.855701] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-22T18:16:13.855760] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-22T18:16:14.204785] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:14.226388] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T18:16:14.517729] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-22T18:16:15.309539] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T18:16:15.323177] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-22T18:16:15.835670] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T18:16:16.117806] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-22T18:16:16.917702] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-22T18:16:17.362772] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T18:16:17.717672] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-22T18:16:18.023462] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T18:16:18.075788] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T18:16:18.517748] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-22T18:16:19.317726] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-22T18:16:19.758165] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:16:19.766113] [INFO ] [REMOTE ] DE: Full fetch complete (69923 records). [2025-10-22T18:16:19.766264] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-22T18:16:20.118933] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-22T18:16:20.113256] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:16:20.249691] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-22T18:16:20.249972] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-22T18:16:20.250894] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-22T18:16:20.250992] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-22T18:16:20.252881] [DEBUG] [LOCAL ] DE: Trimmed 69923 records to 47533 (keeping 200 days of data) [2025-10-22T18:16:20.366767] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T18:16:20.576141] [DEBUG] [LOCAL ] DE: Primary data saved (47533 records). [2025-10-22T18:16:20.576288] [INFO ] [MAIN ] DE: Full history saved. [2025-10-22T18:16:20.576370] [INFO ] [MAIN ] Update Progress: 604/2367 symbols completed. DE took 39.1s. Estimated remaining: 3h 42m 37s. Rate: 7.9 symbols/min [2025-10-22T18:16:20.749571] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:20.792494] [DEBUG] [LOCAL ] DEI: Loaded 48305 existing records from primary storage. [2025-10-22T18:16:20.792865] [INFO ] [MAIN ] DEI: Loaded 48305 existing records. [2025-10-22T18:16:20.929328] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-22T18:16:20.971273] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:16:20.971534] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-22T18:16:20.971585] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-22T18:16:20.971811] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-22T18:16:20.971868] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-22T18:16:21.320062] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:21.717639] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-22T18:16:22.209750] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-22T18:16:22.389131] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T18:16:22.517693] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-22T18:16:23.236821] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T18:16:23.317672] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-22T18:16:23.850745] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T18:16:24.117704] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-22T18:16:24.862465] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T18:16:24.923067] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-22T18:16:24.933738] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T18:16:25.717727] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-22T18:16:26.517709] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-22T18:16:26.702688] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:16:26.708951] [INFO ] [REMOTE ] DEA: Full fetch complete (61373 records). [2025-10-22T18:16:26.709063] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-22T18:16:26.709797] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:16:26.709883] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:16:26.709926] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:16:26.709963] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-22T18:16:26.710020] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-22T18:16:26.710055] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-22T18:16:26.710093] [DEBUG] [LOCAL ] DEA: No derivative data file found to delete. [2025-10-22T18:16:26.710146] [INFO ] [MAIN ] Update Progress: 605/2367 symbols completed. DEA took 37.3s. Estimated remaining: 3h 42m 25s. Rate: 7.9 symbols/min [2025-10-22T18:16:26.877530] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:26.877729] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-10-22T18:16:26.877777] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-10-22T18:16:26.877884] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-22T18:16:26.877925] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-22T18:16:26.877965] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-22T18:16:26.877997] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-22T18:16:27.220333] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T18:16:27.254722] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:27.317611] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-22T18:16:28.117723] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-22T18:16:28.146240] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:16:28.917734] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-22T18:16:29.717697] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-22T18:16:29.860355] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-22T18:16:29.962435] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T18:16:30.517735] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-22T18:16:30.624750] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T18:16:31.055077] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T18:16:31.061815] [INFO ] [REMOTE ] DEC: Full fetch complete (44363 records). [2025-10-22T18:16:31.061986] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-22T18:16:31.062608] [FATAL] [VALIDATOR ] DEC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:16:31.062726] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:16:31.062770] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:16:31.062834] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-22T18:16:31.062897] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-22T18:16:31.062932] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-10-22T18:16:31.062972] [DEBUG] [LOCAL ] DEC: No derivative data file found to delete. [2025-10-22T18:16:31.063028] [INFO ] [MAIN ] Update Progress: 606/2367 symbols completed. DEC took 24.6s. Estimated remaining: 3h 42m 8s. Rate: 7.9 symbols/min [2025-10-22T18:16:31.229523] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:31.229762] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-22T18:16:31.229814] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-22T18:16:31.229925] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-22T18:16:31.229967] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-22T18:16:31.230009] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-22T18:16:31.230042] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-22T18:16:31.322853] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-22T18:16:31.593899] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:32.117697] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-22T18:16:32.586219] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T18:16:32.917689] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-22T18:16:33.608265] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-22T18:16:33.717693] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-22T18:16:34.003090] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:16:34.517693] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-22T18:16:34.618546] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T18:16:35.317690] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-22T18:16:36.101478] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-22T18:16:36.117613] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-22T18:16:36.151242] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T18:16:36.919115] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-22T18:16:36.924777] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T18:16:37.717688] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-22T18:16:38.506095] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-22T18:16:38.517599] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-22T18:16:38.586778] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T18:16:39.317697] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-22T18:16:39.397726] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:16:40.117712] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-22T18:16:40.917707] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-22T18:16:41.157865] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-22T18:16:41.482523] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-22T18:16:41.717724] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-22T18:16:42.003304] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T18:16:42.517733] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-22T18:16:42.577235] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T18:16:43.317736] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-22T18:16:44.008485] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-22T18:16:44.117735] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-22T18:16:44.384256] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:16:44.917682] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-22T18:16:44.954528] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T18:16:45.717673] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-22T18:16:46.029129] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T18:16:46.517739] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-22T18:16:47.189543] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T18:16:47.269000] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-22T18:16:47.317718] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-22T18:16:48.117711] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-22T18:16:48.229233] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T18:16:48.917708] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-22T18:16:49.062178] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T18:16:49.070041] [INFO ] [REMOTE ] DEI: Full fetch complete (69976 records). [2025-10-22T18:16:49.070154] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-22T18:16:49.447264] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-22T18:16:49.447340] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-22T18:16:49.448150] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-22T18:16:49.448214] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-22T18:16:49.449508] [DEBUG] [LOCAL ] DEI: Trimmed 69976 records to 48295 (keeping 200 days of data) [2025-10-22T18:16:49.719724] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-22T18:16:49.735523] [DEBUG] [LOCAL ] DEI: Primary data saved (48295 records). [2025-10-22T18:16:49.735619] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-22T18:16:49.735728] [INFO ] [MAIN ] Update Progress: 607/2367 symbols completed. DEI took 29.2s. Estimated remaining: 3h 42m 33s. Rate: 7.9 symbols/min [2025-10-22T18:16:49.899762] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:49.929120] [DEBUG] [LOCAL ] DFH: Loaded 31847 existing records from primary storage. [2025-10-22T18:16:49.929374] [INFO ] [MAIN ] DFH: Loaded 31847 existing records. [2025-10-22T18:16:50.103385] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:16:50.103606] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-22T18:16:50.103699] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-22T18:16:50.103948] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-22T18:16:50.103998] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-22T18:16:50.463797] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:50.492986] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-22T18:16:50.517601] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-22T18:16:50.615907] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T18:16:51.317697] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-22T18:16:51.833168] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T18:16:51.885717] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T18:16:52.117705] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-22T18:16:52.917724] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-22T18:16:53.478477] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T18:16:53.725559] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-22T18:16:53.750545] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-22T18:16:54.517714] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-22T18:16:54.888612] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T18:16:55.317699] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-22T18:16:55.934772] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T18:16:56.128236] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-22T18:16:56.131026] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-22T18:16:56.140220] [INFO ] [REMOTE ] DECK: Full fetch complete (77177 records). [2025-10-22T18:16:56.140331] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-22T18:16:56.554632] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-22T18:16:56.554743] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-22T18:16:56.555585] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-22T18:16:56.555627] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-22T18:16:56.557078] [DEBUG] [LOCAL ] DECK: Trimmed 77177 records to 53301 (keeping 200 days of data) [2025-10-22T18:16:56.870782] [DEBUG] [LOCAL ] DECK: Primary data saved (53301 records). [2025-10-22T18:16:56.870920] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-22T18:16:56.870994] [INFO ] [MAIN ] Update Progress: 608/2367 symbols completed. DECK took 43.2s. Estimated remaining: 3h 42m 24s. Rate: 7.9 symbols/min [2025-10-22T18:16:56.944357] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-22T18:16:57.059063] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:57.081022] [DEBUG] [LOCAL ] DFIN: Loaded 22406 existing records from primary storage. [2025-10-22T18:16:57.081284] [INFO ] [MAIN ] DFIN: Loaded 22406 existing records. [2025-10-22T18:16:57.264508] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:16:57.264832] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-22T18:16:57.264923] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-22T18:16:57.265180] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-22T18:16:57.281492] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-22T18:16:57.357722] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-22T18:16:57.656522] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:57.717679] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-22T18:16:57.750101] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T18:16:58.517738] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-22T18:16:58.862454] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T18:16:59.317718] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-22T18:16:59.471767] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-22T18:16:59.480876] [INFO ] [REMOTE ] DELL: Full fetch complete (77915 records). [2025-10-22T18:16:59.481060] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-22T18:16:59.868808] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-22T18:16:59.868917] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-22T18:16:59.869794] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-22T18:16:59.869858] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-22T18:16:59.871338] [DEBUG] [LOCAL ] DELL: Trimmed 77915 records to 53736 (keeping 200 days of data) [2025-10-22T18:17:00.121777] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-22T18:17:00.191150] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T18:17:00.242571] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-22T18:17:00.242748] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-22T18:17:00.242831] [INFO ] [MAIN ] Update Progress: 609/2367 symbols completed. DELL took 33.5s. Estimated remaining: 3h 42m 4s. Rate: 7.9 symbols/min [2025-10-22T18:17:00.410970] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:00.443998] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T18:17:00.459365] [DEBUG] [LOCAL ] DFP: Loaded 11074 existing records from primary storage. [2025-10-22T18:17:00.459583] [INFO ] [MAIN ] DFP: Loaded 11074 existing records. [2025-10-22T18:17:00.634257] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:17:00.634525] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-22T18:17:00.634586] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-22T18:17:00.634770] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-22T18:17:00.634827] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-22T18:17:00.922864] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-22T18:17:00.994523] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:01.616058] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:17:01.717663] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-22T18:17:02.517724] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-22T18:17:03.130004] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T18:17:03.166831] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T18:17:03.175798] [INFO ] [REMOTE ] DEO: Full fetch complete (71721 records). [2025-10-22T18:17:03.175944] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-22T18:17:03.320622] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-22T18:17:03.575693] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-22T18:17:03.575796] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-22T18:17:03.576601] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-22T18:17:03.576666] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-22T18:17:03.578091] [DEBUG] [LOCAL ] DEO: Trimmed 71721 records to 49185 (keeping 200 days of data) [2025-10-22T18:17:03.832695] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T18:17:03.916960] [DEBUG] [LOCAL ] DEO: Primary data saved (49185 records). [2025-10-22T18:17:03.917103] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-22T18:17:03.917174] [INFO ] [MAIN ] Update Progress: 610/2367 symbols completed. DEO took 32.9s. Estimated remaining: 3h 41m 45s. Rate: 7.9 symbols/min [2025-10-22T18:17:04.084995] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:04.117689] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-22T18:17:04.136527] [DEBUG] [LOCAL ] DG: Loaded 53258 existing records from primary storage. [2025-10-22T18:17:04.136933] [INFO ] [MAIN ] DG: Loaded 53258 existing records. [2025-10-22T18:17:04.313561] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:17:04.314097] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-22T18:17:04.314168] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-22T18:17:04.314515] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-22T18:17:04.314574] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-22T18:17:04.670882] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:04.919856] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-22T18:17:04.921826] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:17:05.512038] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:17:05.717707] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-22T18:17:06.517675] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-22T18:17:06.629208] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T18:17:07.299562] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T18:17:07.321311] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T18:17:07.320245] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-22T18:17:08.117735] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-22T18:17:08.401018] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:17:08.917698] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-22T18:17:09.717711] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-22T18:17:10.517749] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-22T18:17:11.214177] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (3.10 seconds). [2025-10-22T18:17:11.317609] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-22T18:17:11.371140] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T18:17:11.448023] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T18:17:12.117669] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-22T18:17:12.225178] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (3.31 seconds). [2025-10-22T18:17:12.550004] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T18:17:12.917700] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-22T18:17:13.717730] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-22T18:17:14.514199] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T18:17:14.518250] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-22T18:17:14.685882] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T18:17:15.317723] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-22T18:17:16.117741] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-22T18:17:16.191152] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T18:17:16.196212] [INFO ] [REMOTE ] DFH: Full fetch complete (47313 records). [2025-10-22T18:17:16.196338] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-22T18:17:16.196956] [FATAL] [VALIDATOR ] DFH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:17:16.197062] [FATAL] [MAIN ] DFH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:17:16.197144] [WARN ] [MAIN ] DFH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:17:16.197227] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-22T18:17:16.197307] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-22T18:17:16.197358] [INFO ] [LOCAL ] DFH: Starting deletion of derivative data. [2025-10-22T18:17:16.197571] [DEBUG] [LOCAL ] DFH: Deleted derivative data file. [2025-10-22T18:17:16.197727] [INFO ] [MAIN ] Update Progress: 611/2367 symbols completed. DFH took 26.5s. Estimated remaining: 3h 41m 51s. Rate: 7.9 symbols/min [2025-10-22T18:17:16.310744] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T18:17:16.415590] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (4.30 seconds). [2025-10-22T18:17:16.418344] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:16.418589] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-22T18:17:16.418733] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-22T18:17:16.429729] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-22T18:17:16.430089] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-22T18:17:16.430161] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-22T18:17:16.430198] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-22T18:17:16.778381] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:16.917664] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-22T18:17:16.979519] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T18:17:17.717708] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-22T18:17:18.517683] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-22T18:17:18.682512] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T18:17:19.296612] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T18:17:19.317613] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-22T18:17:19.552738] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T18:17:20.117678] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-22T18:17:20.167884] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T18:17:20.917698] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-22T18:17:21.318771] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T18:17:21.717697] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-22T18:17:22.056041] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T18:17:22.517722] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-22T18:17:23.317752] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-22T18:17:23.408826] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T18:17:23.625620] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T18:17:24.117704] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-22T18:17:24.297770] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:17:24.301256] [INFO ] [REMOTE ] DFIN: Full fetch complete (33182 records). [2025-10-22T18:17:24.301339] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-22T18:17:24.301901] [FATAL] [VALIDATOR ] DFIN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:17:24.302008] [FATAL] [MAIN ] DFIN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:17:24.302074] [WARN ] [MAIN ] DFIN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:17:24.302145] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-22T18:17:24.302210] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-22T18:17:24.302247] [INFO ] [LOCAL ] DFIN: Starting deletion of derivative data. [2025-10-22T18:17:24.302410] [DEBUG] [LOCAL ] DFIN: Deleted derivative data file. [2025-10-22T18:17:24.302498] [INFO ] [MAIN ] Update Progress: 612/2367 symbols completed. DFIN took 27.4s. Estimated remaining: 3h 41m 45s. Rate: 7.9 symbols/min [2025-10-22T18:17:24.488747] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:24.488907] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-22T18:17:24.488951] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-22T18:17:24.489062] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-22T18:17:24.489139] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-22T18:17:24.489192] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-22T18:17:24.489226] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-22T18:17:24.872701] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:24.917619] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-22T18:17:25.718144] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-22T18:17:25.873486] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T18:17:26.517674] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-22T18:17:26.571977] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T18:17:27.194803] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (3.08 seconds). [2025-10-22T18:17:27.317707] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-22T18:17:28.117710] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-22T18:17:28.300737] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T18:17:28.360981] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T18:17:28.917712] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-22T18:17:29.717692] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-22T18:17:30.211529] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-22T18:17:30.517693] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-22T18:17:30.724111] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T18:17:30.976728] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T18:17:31.286414] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T18:17:31.288100] [INFO ] [REMOTE ] DFP: Full fetch complete (15693 records). [2025-10-22T18:17:31.288170] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-22T18:17:31.288552] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:17:31.288637] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:17:31.288719] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:17:31.288791] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-22T18:17:31.288897] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-22T18:17:31.288950] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-10-22T18:17:31.289306] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-10-22T18:17:31.289466] [INFO ] [MAIN ] Update Progress: 613/2367 symbols completed. DFP took 31.0s. Estimated remaining: 3h 41m 36s. Rate: 7.9 symbols/min [2025-10-22T18:17:31.321757] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-22T18:17:31.461402] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:31.512631] [DEBUG] [LOCAL ] DHI: Loaded 53364 existing records from primary storage. [2025-10-22T18:17:31.513075] [INFO ] [MAIN ] DHI: Loaded 53364 existing records. [2025-10-22T18:17:31.691464] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:17:31.691718] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-22T18:17:31.691775] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-22T18:17:31.691988] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-22T18:17:31.692042] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-22T18:17:32.075107] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:32.117618] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-22T18:17:32.853681] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:17:32.917676] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-22T18:17:33.478068] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T18:17:33.717707] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-22T18:17:34.517708] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-22T18:17:34.624900] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T18:17:35.317716] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-22T18:17:35.456789] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:17:36.117751] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-22T18:17:36.684715] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T18:17:36.809213] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T18:17:36.917692] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-22T18:17:37.239529] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T18:17:37.717684] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-22T18:17:38.429711] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T18:17:38.517672] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-22T18:17:38.735158] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T18:17:39.317669] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-22T18:17:40.117726] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-22T18:17:40.292821] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:17:40.304245] [INFO ] [REMOTE ] DGX: Full fetch complete (65676 records). [2025-10-22T18:17:40.304520] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-22T18:17:40.698295] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-22T18:17:40.698396] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-22T18:17:40.699326] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-22T18:17:40.699421] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-22T18:17:40.700853] [DEBUG] [LOCAL ] DGX: Trimmed 65676 records to 44610 (keeping 200 days of data) [2025-10-22T18:17:40.919439] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-22T18:17:40.985972] [DEBUG] [LOCAL ] DGX: Primary data saved (44610 records). [2025-10-22T18:17:40.986201] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-22T18:17:40.986306] [INFO ] [MAIN ] Update Progress: 614/2367 symbols completed. DGX took 24.8s. Estimated remaining: 3h 41m 34s. Rate: 7.9 symbols/min [2025-10-22T18:17:41.156107] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:41.193490] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T18:17:41.217245] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T18:17:41.262012] [DEBUG] [LOCAL ] DHR: Loaded 53381 existing records from primary storage. [2025-10-22T18:17:41.262324] [INFO ] [MAIN ] DHR: Loaded 53381 existing records. [2025-10-22T18:17:41.434424] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:17:41.434710] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-22T18:17:41.434803] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-22T18:17:41.435037] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-22T18:17:41.435093] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-22T18:17:41.722850] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-22T18:17:41.782872] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:42.517713] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-22T18:17:42.833452] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T18:17:43.317678] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-22T18:17:43.631853] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T18:17:43.656445] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T18:17:44.117697] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-22T18:17:44.917716] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-22T18:17:44.957182] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T18:17:45.717707] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-22T18:17:46.174325] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T18:17:46.353388] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T18:17:46.517705] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-22T18:17:47.032063] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T18:17:47.317710] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-22T18:17:48.117614] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-22T18:17:48.195079] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T18:17:48.410703] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T18:17:48.419453] [INFO ] [REMOTE ] DG: Full fetch complete (77335 records). [2025-10-22T18:17:48.419595] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-22T18:17:48.798308] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-22T18:17:48.798389] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-22T18:17:48.799244] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-22T18:17:48.799325] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-22T18:17:48.800744] [DEBUG] [LOCAL ] DG: Trimmed 77335 records to 53259 (keeping 200 days of data) [2025-10-22T18:17:48.918468] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-22T18:17:49.136118] [DEBUG] [LOCAL ] DG: Primary data saved (53259 records). [2025-10-22T18:17:49.136286] [INFO ] [MAIN ] DG: Full history saved. [2025-10-22T18:17:49.136377] [INFO ] [MAIN ] Update Progress: 615/2367 symbols completed. DG took 45.2s. Estimated remaining: 3h 41m 28s. Rate: 7.9 symbols/min [2025-10-22T18:17:49.304512] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:49.304721] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-10-22T18:17:49.304769] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-10-22T18:17:49.304905] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-22T18:17:49.304973] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-22T18:17:49.305023] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-22T18:17:49.305056] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-22T18:17:49.653060] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:49.717611] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-22T18:17:49.897821] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T18:17:50.517682] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-22T18:17:50.647827] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T18:17:51.317694] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-22T18:17:51.652945] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T18:17:52.117703] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-22T18:17:52.451661] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T18:17:52.917713] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-22T18:17:53.717712] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-22T18:17:53.769052] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T18:17:54.133392] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T18:17:54.137038] [INFO ] [REMOTE ] DHF: Full fetch complete (29995 records). [2025-10-22T18:17:54.137116] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-22T18:17:54.371315] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-10-22T18:17:54.522763] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-22T18:17:54.597524] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-22T18:17:54.597603] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-22T18:17:54.598225] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-22T18:17:54.598278] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-22T18:17:54.599055] [DEBUG] [LOCAL ] DHF: Trimmed 29995 records to 20878 (keeping 200 days of data) [2025-10-22T18:17:54.724257] [DEBUG] [LOCAL ] DHF: Primary data saved (20878 records). [2025-10-22T18:17:54.724405] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-22T18:17:54.724499] [INFO ] [MAIN ] Update Progress: 616/2367 symbols completed. DHF took 30.4s. Estimated remaining: 3h 41m 15s. Rate: 7.9 symbols/min [2025-10-22T18:17:54.889946] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:54.890280] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-10-22T18:17:54.890369] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-10-22T18:17:54.890486] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-22T18:17:54.890526] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-22T18:17:54.890566] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-22T18:17:54.890597] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-22T18:17:55.230756] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:55.317615] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-22T18:17:55.769303] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-22T18:17:56.117675] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-22T18:17:56.364017] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T18:17:56.853374] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-22T18:17:56.917711] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-22T18:17:57.717704] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-22T18:17:58.067912] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T18:17:58.517704] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-22T18:17:58.620435] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T18:17:59.317698] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-22T18:17:59.531469] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T18:17:59.600799] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T18:18:00.117695] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-22T18:18:00.917769] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-22T18:18:01.717781] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-22T18:18:02.361987] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-22T18:18:02.517784] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-22T18:18:02.546327] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (3.23 seconds). [2025-10-22T18:18:02.555216] [INFO ] [REMOTE ] DHI: Full fetch complete (77400 records). [2025-10-22T18:18:02.555361] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-22T18:18:02.742089] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T18:18:02.961064] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-22T18:18:02.961147] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-22T18:18:02.962104] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-22T18:18:02.962171] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-22T18:18:02.963587] [DEBUG] [LOCAL ] DHI: Trimmed 77400 records to 53363 (keeping 200 days of data) [2025-10-22T18:18:03.293886] [DEBUG] [LOCAL ] DHI: Primary data saved (53363 records). [2025-10-22T18:18:03.294033] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-22T18:18:03.294134] [INFO ] [MAIN ] Update Progress: 617/2367 symbols completed. DHI took 32.0s. Estimated remaining: 3h 41m 10s. Rate: 7.9 symbols/min [2025-10-22T18:18:03.325108] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-22T18:18:03.466272] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:03.466447] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-10-22T18:18:03.466488] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-10-22T18:18:03.466600] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-22T18:18:03.466685] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-22T18:18:03.466752] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-22T18:18:03.466788] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-22T18:18:03.821911] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:03.855019] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-22T18:18:04.117709] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-22T18:18:04.376983] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T18:18:04.531675] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:18:04.917763] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-22T18:18:05.717718] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-22T18:18:05.780080] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T18:18:06.517758] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-22T18:18:06.629965] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T18:18:06.947881] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T18:18:07.317698] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-22T18:18:08.126804] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-22T18:18:08.132113] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T18:18:08.148021] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T18:18:08.917707] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-22T18:18:09.146613] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T18:18:09.717714] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-22T18:18:10.409753] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T18:18:10.517692] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-22T18:18:11.317734] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-22T18:18:11.842364] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-22T18:18:11.862982] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T18:18:11.972090] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:18:12.117742] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-22T18:18:12.917717] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-22T18:18:13.125966] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T18:18:13.717282] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T18:18:13.719796] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-22T18:18:14.517692] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-22T18:18:15.251407] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T18:18:15.317778] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-22T18:18:15.867119] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-22T18:18:16.117719] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-22T18:18:16.174944] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T18:18:16.917709] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-22T18:18:17.717688] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-22T18:18:17.870024] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T18:18:18.517614] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-22T18:18:18.590349] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T18:18:19.253695] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T18:18:19.317677] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-22T18:18:19.931982] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (3.81 seconds). [2025-10-22T18:18:19.940716] [INFO ] [REMOTE ] DHR: Full fetch complete (77055 records). [2025-10-22T18:18:19.940887] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-22T18:18:19.941750] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:18:19.941843] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:18:19.941886] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:18:19.941953] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-22T18:18:19.942022] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-22T18:18:19.942057] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-10-22T18:18:19.942201] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-10-22T18:18:19.942274] [INFO ] [MAIN ] Update Progress: 618/2367 symbols completed. DHR took 39.0s. Estimated remaining: 3h 41m 28s. Rate: 7.9 symbols/min [2025-10-22T18:18:20.109211] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:20.117719] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-22T18:18:20.144273] [DEBUG] [LOCAL ] DIN: Loaded 36831 existing records from primary storage. [2025-10-22T18:18:20.144560] [INFO ] [MAIN ] DIN: Loaded 36831 existing records. [2025-10-22T18:18:20.328366] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:18:20.332701] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T18:18:20.332894] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-22T18:18:20.335991] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-22T18:18:20.336436] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-22T18:18:20.336483] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-22T18:18:20.678967] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:20.917698] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-22T18:18:21.575338] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T18:18:21.583202] [INFO ] [REMOTE ] DHT: Full fetch complete (69940 records). [2025-10-22T18:18:21.583323] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-22T18:18:21.583997] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:18:21.584090] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:18:21.584133] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:18:21.584196] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-22T18:18:21.584259] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-22T18:18:21.584294] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-10-22T18:18:21.584352] [DEBUG] [LOCAL ] DHT: No derivative data file found to delete. [2025-10-22T18:18:21.584407] [INFO ] [MAIN ] Update Progress: 619/2367 symbols completed. DHT took 32.4s. Estimated remaining: 3h 41m 4s. Rate: 7.9 symbols/min [2025-10-22T18:18:21.722805] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-22T18:18:21.767771] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:21.817003] [DEBUG] [LOCAL ] DINO: Loaded 52837 existing records from primary storage. [2025-10-22T18:18:21.817328] [INFO ] [MAIN ] DINO: Loaded 52837 existing records. [2025-10-22T18:18:21.993282] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:18:21.993491] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-22T18:18:21.993538] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-22T18:18:21.993761] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-22T18:18:21.993815] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-22T18:18:22.280614] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T18:18:22.359256] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:22.517696] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-22T18:18:22.708517] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T18:18:23.317695] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-22T18:18:23.572607] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T18:18:23.575792] [INFO ] [REMOTE ] DHX: Full fetch complete (21382 records). [2025-10-22T18:18:23.575876] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-22T18:18:23.576389] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:18:23.576475] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:18:23.576517] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:18:23.576580] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-22T18:18:23.576671] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-22T18:18:23.576733] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-10-22T18:18:23.576781] [DEBUG] [LOCAL ] DHX: No derivative data file found to delete. [2025-10-22T18:18:23.576836] [INFO ] [MAIN ] Update Progress: 620/2367 symbols completed. DHX took 28.9s. Estimated remaining: 3h 40m 40s. Rate: 7.9 symbols/min [2025-10-22T18:18:23.746128] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:23.797725] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-22T18:18:23.798037] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-22T18:18:23.986367] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:18:23.986555] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-22T18:18:23.986601] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-22T18:18:23.986820] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-22T18:18:23.986876] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-22T18:18:24.130830] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-22T18:18:24.298696] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:18:24.331357] [INFO ] [REMOTE ] DIAX: Full fetch complete (17655 records). [2025-10-22T18:18:24.340711] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-22T18:18:24.370842] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:24.770480] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-22T18:18:24.770561] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-22T18:18:24.770992] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-22T18:18:24.771078] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-22T18:18:24.771682] [DEBUG] [LOCAL ] DIAX: Trimmed 17655 records to 12723 (keeping 200 days of data) [2025-10-22T18:18:24.846618] [DEBUG] [LOCAL ] DIAX: Primary data saved (12723 records). [2025-10-22T18:18:24.846768] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-22T18:18:24.846838] [INFO ] [MAIN ] Update Progress: 621/2367 symbols completed. DIAX took 21.6s. Estimated remaining: 3h 40m 15s. Rate: 7.9 symbols/min [2025-10-22T18:18:24.922759] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-22T18:18:25.028394] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:25.028562] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-22T18:18:25.028599] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-22T18:18:25.028733] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-22T18:18:25.028775] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-22T18:18:25.028816] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-22T18:18:25.028892] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-22T18:18:25.404001] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:25.732742] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-22T18:18:25.740499] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T18:18:26.490234] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T18:18:26.517689] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-22T18:18:26.872508] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-22T18:18:27.317700] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-22T18:18:27.592002] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-22T18:18:28.117693] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-22T18:18:28.923688] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-22T18:18:28.926370] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T18:18:29.717732] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-22T18:18:30.194299] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-22T18:18:30.196277] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-22T18:18:30.517692] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-22T18:18:31.317722] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-22T18:18:31.424428] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-22T18:18:31.750805] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-22T18:18:32.117721] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-22T18:18:32.922855] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-22T18:18:32.938623] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-22T18:18:33.313614] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-22T18:18:33.584348] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T18:18:33.717706] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-22T18:18:34.517679] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-22T18:18:34.642120] [DEBUG] [REMOTE ] DIVY: Error fetching primary data for 2025-06: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-10-22T18:18:34.642243] [WARN ] [REMOTE ] DIVY: No data returned for month 2025-06 [2025-10-22T18:18:34.642319] [FATAL] [REMOTE ] DIVY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:18:34.642363] [FATAL] [MAIN ] DIVY: Failed to fetch primary data. [2025-10-22T18:18:34.642424] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:18:34.642493] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-22T18:18:34.642556] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-22T18:18:34.642592] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-22T18:18:34.642632] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-22T18:18:34.642728] [INFO ] [MAIN ] Update Progress: 622/2367 symbols completed. DIVY took 9.8s. Estimated remaining: 3h 40m 14s. Rate: 7.9 symbols/min [2025-10-22T18:18:34.813834] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:34.814024] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-10-22T18:18:34.814073] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-10-22T18:18:34.814189] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-22T18:18:34.814250] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-22T18:18:34.814321] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-10-22T18:18:34.814357] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-22T18:18:35.222082] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:35.256218] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T18:18:35.317725] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-22T18:18:36.117746] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-22T18:18:36.917667] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-22T18:18:37.377070] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T18:18:37.519457] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T18:18:37.717741] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-22T18:18:38.517751] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-22T18:18:39.317735] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-22T18:18:39.494789] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T18:18:39.640496] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-22T18:18:39.887742] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T18:18:40.117727] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-22T18:18:40.917758] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-22T18:18:41.049205] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:18:41.717730] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-22T18:18:41.862150] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:18:42.276889] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T18:18:42.517770] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-22T18:18:43.078036] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T18:18:43.317728] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-22T18:18:44.117733] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-22T18:18:44.917747] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-22T18:18:44.995095] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-22T18:18:45.074826] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:18:45.717685] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-22T18:18:45.756419] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:18:46.341782] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T18:18:46.517710] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-22T18:18:47.317759] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-22T18:18:47.610099] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T18:18:48.117723] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-22T18:18:48.171697] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T18:18:48.917710] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-22T18:18:49.515571] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-22T18:18:49.717667] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-22T18:18:49.845283] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T18:18:50.350586] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T18:18:50.517741] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-22T18:18:51.317749] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-22T18:18:52.117717] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-22T18:18:52.444948] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:18:52.453559] [INFO ] [REMOTE ] DINO: Full fetch complete (76718 records). [2025-10-22T18:18:52.453741] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-22T18:18:52.868608] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-10-22T18:18:52.897891] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-22T18:18:52.898717] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-22T18:18:52.899844] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-22T18:18:52.899989] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-22T18:18:52.901768] [DEBUG] [LOCAL ] DINO: Trimmed 76718 records to 52825 (keeping 200 days of data) [2025-10-22T18:18:52.953480] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-22T18:18:53.048087] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T18:18:53.250099] [DEBUG] [LOCAL ] DINO: Primary data saved (52825 records). [2025-10-22T18:18:53.250322] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-22T18:18:53.250416] [INFO ] [MAIN ] Update Progress: 623/2367 symbols completed. DINO took 31.7s. Estimated remaining: 3h 40m 37s. Rate: 7.9 symbols/min [2025-10-22T18:18:53.418810] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:53.444131] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T18:18:53.465699] [DEBUG] [LOCAL ] DKL: Loaded 17059 existing records from primary storage. [2025-10-22T18:18:53.466024] [INFO ] [MAIN ] DKL: Loaded 17059 existing records. [2025-10-22T18:18:53.637967] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:18:53.638200] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-22T18:18:53.638246] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-22T18:18:53.638430] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-22T18:18:53.638485] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-22T18:18:53.725552] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-22T18:18:53.982773] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:54.517697] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-22T18:18:55.312551] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T18:18:55.321684] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-22T18:18:55.353126] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-22T18:18:56.084206] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T18:18:56.117672] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-22T18:18:56.517447] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T18:18:56.917737] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-22T18:18:57.611203] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T18:18:57.617369] [INFO ] [REMOTE ] DIN: Full fetch complete (54768 records). [2025-10-22T18:18:57.617519] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-22T18:18:57.726085] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-22T18:18:58.028113] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-22T18:18:58.028210] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-22T18:18:58.028989] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-22T18:18:58.029107] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-22T18:18:58.043608] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T18:18:58.049255] [DEBUG] [LOCAL ] DIN: Trimmed 54768 records to 36752 (keeping 200 days of data) [2025-10-22T18:18:58.266315] [DEBUG] [LOCAL ] DIN: Primary data saved (36752 records). [2025-10-22T18:18:58.266445] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-22T18:18:58.266520] [INFO ] [MAIN ] Update Progress: 624/2367 symbols completed. DIN took 38.3s. Estimated remaining: 3h 40m 22s. Rate: 7.9 symbols/min [2025-10-22T18:18:58.434818] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:58.477857] [DEBUG] [LOCAL ] DKS: Loaded 49449 existing records from primary storage. [2025-10-22T18:18:58.478201] [INFO ] [MAIN ] DKS: Loaded 49449 existing records. [2025-10-22T18:18:58.525165] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-22T18:18:58.664333] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:18:58.664537] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-22T18:18:58.664584] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-22T18:18:58.664814] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-22T18:18:58.664872] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-22T18:18:59.017318] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:59.285331] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:18:59.317671] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-22T18:18:59.376448] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T18:19:00.117765] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-22T18:19:00.828405] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T18:19:00.917716] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-22T18:19:01.717706] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-22T18:19:02.326412] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T18:19:02.410996] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T18:19:02.517736] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-22T18:19:03.317712] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-22T18:19:03.524629] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T18:19:04.117708] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-22T18:19:04.168360] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T18:19:04.902845] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T18:19:04.917607] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-22T18:19:05.654598] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-22T18:19:05.663065] [INFO ] [REMOTE ] DIS: Full fetch complete (77577 records). [2025-10-22T18:19:05.663248] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-22T18:19:05.664295] [FATAL] [VALIDATOR ] DIS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:19:05.664401] [FATAL] [MAIN ] DIS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:19:05.664446] [WARN ] [MAIN ] DIS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:19:05.664516] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-22T18:19:05.664583] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-22T18:19:05.664618] [INFO ] [LOCAL ] DIS: Starting deletion of derivative data. [2025-10-22T18:19:05.664894] [DEBUG] [LOCAL ] DIS: Deleted derivative data file. [2025-10-22T18:19:05.665444] [INFO ] [MAIN ] Update Progress: 625/2367 symbols completed. DIS took 42.1s. Estimated remaining: 3h 40m 14s. Rate: 7.9 symbols/min [2025-10-22T18:19:05.726859] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-22T18:19:05.841092] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:05.874548] [DEBUG] [LOCAL ] DLB: Loaded 32289 existing records from primary storage. [2025-10-22T18:19:05.874864] [INFO ] [MAIN ] DLB: Loaded 32289 existing records. [2025-10-22T18:19:05.989483] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T18:19:06.070590] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:06.070860] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-22T18:19:06.070911] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-22T18:19:06.071097] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-22T18:19:06.071136] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-22T18:19:06.438810] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:06.517700] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-22T18:19:07.317768] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-22T18:19:07.444146] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T18:19:07.677311] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T18:19:08.117725] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-22T18:19:08.728309] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:19:08.917685] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-22T18:19:09.079347] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T18:19:09.717698] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-22T18:19:10.517664] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-22T18:19:10.591928] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T18:19:10.663673] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:19:11.317731] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-22T18:19:12.117714] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-22T18:19:12.152513] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:19:12.917686] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-22T18:19:13.327096] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T18:19:13.532704] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T18:19:13.717703] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-22T18:19:13.755390] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T18:19:13.757592] [INFO ] [REMOTE ] DKL: Full fetch complete (27575 records). [2025-10-22T18:19:13.757725] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-22T18:19:14.120891] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-22T18:19:14.120965] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-22T18:19:14.121466] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-22T18:19:14.121526] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-22T18:19:14.122242] [DEBUG] [LOCAL ] DKL: Trimmed 27575 records to 16871 (keeping 200 days of data) [2025-10-22T18:19:14.220534] [DEBUG] [LOCAL ] DKL: Primary data saved (16871 records). [2025-10-22T18:19:14.220684] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-22T18:19:14.220773] [INFO ] [MAIN ] Update Progress: 626/2367 symbols completed. DKL took 21.0s. Estimated remaining: 3h 40m 9s. Rate: 7.9 symbols/min [2025-10-22T18:19:14.390713] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:14.397047] [DEBUG] [LOCAL ] DLNG: Loaded 6106 existing records from primary storage. [2025-10-22T18:19:14.397197] [INFO ] [MAIN ] DLNG: Loaded 6106 existing records. [2025-10-22T18:19:14.522800] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-22T18:19:14.581293] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:14.581550] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-22T18:19:14.581610] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-22T18:19:14.581793] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-22T18:19:14.581842] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-22T18:19:14.939515] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:15.317733] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-22T18:19:15.580870] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T18:19:16.117700] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-22T18:19:16.700991] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T18:19:16.809176] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T18:19:16.816845] [INFO ] [REMOTE ] DK: Full fetch complete (70772 records). [2025-10-22T18:19:16.816969] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-22T18:19:16.922911] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-22T18:19:17.199511] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-22T18:19:17.199587] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-22T18:19:17.200533] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-22T18:19:17.200595] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-22T18:19:17.201871] [DEBUG] [LOCAL ] DK: Trimmed 70772 records to 49230 (keeping 200 days of data) [2025-10-22T18:19:17.496339] [DEBUG] [LOCAL ] DK: Primary data saved (49230 records). [2025-10-22T18:19:17.496508] [INFO ] [MAIN ] DK: Full history saved. [2025-10-22T18:19:17.496603] [INFO ] [MAIN ] Update Progress: 627/2367 symbols completed. DK took 42.9s. Estimated remaining: 3h 39m 50s. Rate: 7.9 symbols/min [2025-10-22T18:19:17.664407] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:17.713523] [DEBUG] [LOCAL ] DLR: Loaded 50634 existing records from primary storage. [2025-10-22T18:19:17.713879] [INFO ] [MAIN ] DLR: Loaded 50634 existing records. [2025-10-22T18:19:17.745362] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-22T18:19:17.894058] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:17.894266] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-22T18:19:17.894315] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-22T18:19:17.894551] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-22T18:19:17.894606] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-22T18:19:18.251613] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:18.284568] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T18:19:18.517692] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-22T18:19:18.796943] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T18:19:19.317767] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-22T18:19:19.411637] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:19:19.952162] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T18:19:20.117738] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-22T18:19:20.519199] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T18:19:20.917744] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-22T18:19:21.675205] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T18:19:21.717685] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-22T18:19:21.864012] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T18:19:22.260896] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-22T18:19:22.517699] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-22T18:19:23.317744] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-22T18:19:23.896937] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T18:19:24.117694] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-22T18:19:24.917718] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-22T18:19:25.222142] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T18:19:25.619954] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T18:19:25.717715] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-22T18:19:25.900971] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T18:19:26.517704] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-22T18:19:27.317729] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-22T18:19:27.873204] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T18:19:27.955301] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T18:19:27.962838] [INFO ] [REMOTE ] DKS: Full fetch complete (71332 records). [2025-10-22T18:19:27.962999] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-22T18:19:27.963718] [FATAL] [VALIDATOR ] DKS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:19:27.963809] [FATAL] [MAIN ] DKS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:19:27.963851] [WARN ] [MAIN ] DKS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:19:27.963890] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-22T18:19:27.963947] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-10-22T18:19:27.963984] [INFO ] [LOCAL ] DKS: Starting deletion of derivative data. [2025-10-22T18:19:27.964170] [DEBUG] [LOCAL ] DKS: Deleted derivative data file. [2025-10-22T18:19:27.964262] [INFO ] [MAIN ] Update Progress: 628/2367 symbols completed. DKS took 29.7s. Estimated remaining: 3h 39m 50s. Rate: 7.9 symbols/min [2025-10-22T18:19:28.067495] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T18:19:28.118392] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-22T18:19:28.137097] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:28.165949] [DEBUG] [LOCAL ] DLX: Loaded 28165 existing records from primary storage. [2025-10-22T18:19:28.166240] [INFO ] [MAIN ] DLX: Loaded 28165 existing records. [2025-10-22T18:19:28.343420] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:28.344471] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-22T18:19:28.344531] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-22T18:19:28.345187] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-22T18:19:28.345245] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-22T18:19:28.690531] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:28.734942] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T18:19:28.917679] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-22T18:19:29.517711] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:19:29.717703] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-22T18:19:30.442975] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T18:19:30.445142] [INFO ] [REMOTE ] DLNG: Full fetch complete (11318 records). [2025-10-22T18:19:30.445236] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-22T18:19:30.527592] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-22T18:19:30.853143] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-22T18:19:30.853247] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-22T18:19:30.853603] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-22T18:19:30.853720] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-22T18:19:30.854198] [DEBUG] [LOCAL ] DLNG: Trimmed 11318 records to 6048 (keeping 200 days of data) [2025-10-22T18:19:30.892020] [DEBUG] [LOCAL ] DLNG: Primary data saved (6048 records). [2025-10-22T18:19:30.892113] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-22T18:19:30.892191] [INFO ] [MAIN ] Update Progress: 629/2367 symbols completed. DLNG took 16.7s. Estimated remaining: 3h 39m 30s. Rate: 7.9 symbols/min [2025-10-22T18:19:31.062298] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:31.086137] [DEBUG] [LOCAL ] DLY: Loaded 20743 existing records from primary storage. [2025-10-22T18:19:31.086422] [INFO ] [MAIN ] DLY: Loaded 20743 existing records. [2025-10-22T18:19:31.308667] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:31.308928] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-22T18:19:31.308989] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-22T18:19:31.309183] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-22T18:19:31.309238] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-22T18:19:31.322780] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-22T18:19:31.775921] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:31.843632] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T18:19:32.117694] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-22T18:19:32.917705] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-22T18:19:33.471894] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-22T18:19:33.553121] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T18:19:33.717724] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-22T18:19:34.517688] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-22T18:19:34.750007] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T18:19:34.818619] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T18:19:35.317610] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-22T18:19:35.968584] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:19:36.117689] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-22T18:19:36.917690] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-22T18:19:37.081953] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T18:19:37.649455] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T18:19:37.717681] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-22T18:19:38.157399] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T18:19:38.517683] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-22T18:19:38.747289] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T18:19:39.317706] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-22T18:19:40.117716] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-22T18:19:40.908480] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-22T18:19:40.918779] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-22T18:19:40.953724] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T18:19:40.959295] [INFO ] [REMOTE ] DLB: Full fetch complete (47435 records). [2025-10-22T18:19:40.959379] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-22T18:19:41.330926] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-22T18:19:41.331002] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-22T18:19:41.331623] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-22T18:19:41.331696] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-22T18:19:41.332613] [DEBUG] [LOCAL ] DLB: Trimmed 47435 records to 32217 (keeping 200 days of data) [2025-10-22T18:19:41.527490] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T18:19:41.551006] [DEBUG] [LOCAL ] DLB: Primary data saved (32217 records). [2025-10-22T18:19:41.551112] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-22T18:19:41.551181] [INFO ] [MAIN ] Update Progress: 630/2367 symbols completed. DLB took 35.9s. Estimated remaining: 3h 39m 31s. Rate: 7.9 symbols/min [2025-10-22T18:19:41.721020] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-22T18:19:41.722494] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:41.732890] [DEBUG] [LOCAL ] DMA: Loaded 4729 existing records from primary storage. [2025-10-22T18:19:41.733359] [INFO ] [MAIN ] DMA: Loaded 4729 existing records. [2025-10-22T18:19:41.922056] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:41.922347] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-22T18:19:41.922419] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-22T18:19:41.922671] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-22T18:19:41.922728] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-22T18:19:42.203432] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:19:42.293014] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:42.517726] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-22T18:19:43.153051] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T18:19:43.154123] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T18:19:43.317746] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-22T18:19:44.117697] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-22T18:19:44.917706] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-22T18:19:45.369568] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T18:19:45.403720] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T18:19:45.480898] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T18:19:45.717676] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-22T18:19:46.043853] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-22T18:19:46.517705] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-22T18:19:47.317715] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-22T18:19:48.117702] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-22T18:19:48.419310] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T18:19:48.648625] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T18:19:48.917620] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-22T18:19:49.284314] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T18:19:49.717728] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-22T18:19:50.517683] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-22T18:19:50.682456] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:19:50.710991] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T18:19:51.317724] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-22T18:19:51.496741] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T18:19:52.117703] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-22T18:19:52.917680] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-22T18:19:53.014578] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T18:19:53.318958] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T18:19:53.560994] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T18:19:53.717618] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-22T18:19:54.366801] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T18:19:54.517715] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-22T18:19:54.977672] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-22T18:19:55.317706] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-22T18:19:55.885562] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T18:19:56.117728] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-22T18:19:56.917730] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-22T18:19:57.073719] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T18:19:57.523316] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T18:19:57.717713] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-22T18:19:58.517773] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-22T18:19:58.930453] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T18:19:58.936696] [INFO ] [REMOTE ] DLX: Full fetch complete (41338 records). [2025-10-22T18:19:58.936855] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-22T18:19:59.322914] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-22T18:19:59.530544] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-22T18:19:59.530777] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-22T18:19:59.531821] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-22T18:19:59.531901] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-22T18:19:59.533289] [DEBUG] [LOCAL ] DLX: Trimmed 41338 records to 28049 (keeping 200 days of data) [2025-10-22T18:19:59.792840] [DEBUG] [LOCAL ] DLX: Primary data saved (28049 records). [2025-10-22T18:19:59.814147] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-22T18:19:59.814754] [INFO ] [MAIN ] Update Progress: 631/2367 symbols completed. DLX took 31.9s. Estimated remaining: 3h 39m 52s. Rate: 7.9 symbols/min [2025-10-22T18:19:59.835403] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T18:20:00.046023] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:00.057925] [DEBUG] [LOCAL ] DMB: Loaded 10482 existing records from primary storage. [2025-10-22T18:20:00.058151] [INFO ] [MAIN ] DMB: Loaded 10482 existing records. [2025-10-22T18:20:00.125297] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-22T18:20:00.242166] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:00.242431] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-22T18:20:00.242506] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-22T18:20:00.242804] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-22T18:20:00.242877] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-22T18:20:00.602521] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:00.917732] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-22T18:20:01.278089] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T18:20:01.354482] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T18:20:01.717748] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-22T18:20:02.375579] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T18:20:02.517701] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-22T18:20:02.582363] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T18:20:03.317714] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-22T18:20:03.457526] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T18:20:03.466340] [INFO ] [REMOTE ] DLR: Full fetch complete (74166 records). [2025-10-22T18:20:03.466475] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-22T18:20:03.896333] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-22T18:20:03.896449] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-22T18:20:03.897451] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-22T18:20:03.897529] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-22T18:20:03.899081] [DEBUG] [LOCAL ] DLR: Trimmed 74166 records to 50597 (keeping 200 days of data) [2025-10-22T18:20:04.120894] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-22T18:20:04.123199] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T18:20:04.237715] [DEBUG] [LOCAL ] DLR: Primary data saved (50597 records). [2025-10-22T18:20:04.237878] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-22T18:20:04.237963] [INFO ] [MAIN ] Update Progress: 632/2367 symbols completed. DLR took 46.7s. Estimated remaining: 3h 39m 36s. Rate: 7.9 symbols/min [2025-10-22T18:20:04.405301] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:04.417491] [DEBUG] [LOCAL ] DMO: Loaded 9862 existing records from primary storage. [2025-10-22T18:20:04.417776] [INFO ] [MAIN ] DMO: Loaded 9862 existing records. [2025-10-22T18:20:04.596993] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:04.597205] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-22T18:20:04.597253] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-22T18:20:04.597411] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-22T18:20:04.597449] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-22T18:20:04.923197] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-22T18:20:04.955121] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:05.431463] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T18:20:05.717749] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-22T18:20:05.727995] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T18:20:05.729450] [INFO ] [REMOTE ] DMA: Full fetch complete (6578 records). [2025-10-22T18:20:05.729518] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-22T18:20:06.077791] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-22T18:20:06.077871] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-22T18:20:06.078151] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-22T18:20:06.078215] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-22T18:20:06.078624] [DEBUG] [LOCAL ] DMA: Trimmed 6578 records to 4714 (keeping 200 days of data) [2025-10-22T18:20:06.105892] [DEBUG] [LOCAL ] DMA: Primary data saved (4714 records). [2025-10-22T18:20:06.105989] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-22T18:20:06.106063] [INFO ] [MAIN ] Update Progress: 633/2367 symbols completed. DMA took 24.6s. Estimated remaining: 3h 39m 13s. Rate: 7.9 symbols/min [2025-10-22T18:20:06.271531] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:06.316793] [DEBUG] [LOCAL ] DNA: Loaded 48547 existing records from primary storage. [2025-10-22T18:20:06.317110] [INFO ] [MAIN ] DNA: Loaded 48547 existing records. [2025-10-22T18:20:06.497412] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:06.497702] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-22T18:20:06.497761] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-22T18:20:06.497963] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-22T18:20:06.498019] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-22T18:20:06.526541] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-22T18:20:06.590671] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T18:20:06.862931] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:07.317926] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-22T18:20:07.883987] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T18:20:07.888780] [INFO ] [REMOTE ] DLY: Full fetch complete (28365 records). [2025-10-22T18:20:07.888865] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-22T18:20:07.889321] [FATAL] [VALIDATOR ] DLY: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:20:07.889414] [FATAL] [MAIN ] DLY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:20:07.889467] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:20:07.889513] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-22T18:20:07.889582] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-22T18:20:07.889620] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-10-22T18:20:07.889838] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-10-22T18:20:07.889952] [INFO ] [MAIN ] Update Progress: 634/2367 symbols completed. DLY took 37.0s. Estimated remaining: 3h 38m 49s. Rate: 7.9 symbols/min [2025-10-22T18:20:08.059136] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:08.098075] [DEBUG] [LOCAL ] DNOW: Loaded 43799 existing records from primary storage. [2025-10-22T18:20:08.098358] [INFO ] [MAIN ] DNOW: Loaded 43799 existing records. [2025-10-22T18:20:08.126876] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-22T18:20:08.241500] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T18:20:08.300838] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:08.301013] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-22T18:20:08.301057] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-22T18:20:08.301226] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-22T18:20:08.301263] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-22T18:20:08.649438] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:08.917746] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-22T18:20:09.213862] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T18:20:09.717710] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-22T18:20:10.463346] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T18:20:10.517692] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-22T18:20:10.773807] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:20:11.011316] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T18:20:11.317720] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-22T18:20:12.013295] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T18:20:12.117684] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-22T18:20:12.917670] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-22T18:20:12.999128] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T18:20:13.717725] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-22T18:20:14.365861] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:20:14.416039] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T18:20:14.517695] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-22T18:20:15.317698] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-22T18:20:16.052632] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T18:20:16.089381] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:20:16.117614] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-22T18:20:16.917717] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-22T18:20:17.490542] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T18:20:17.717703] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-22T18:20:17.758220] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:20:18.517721] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-22T18:20:19.317703] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-22T18:20:19.432268] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T18:20:19.680017] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-22T18:20:20.117697] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-22T18:20:20.919932] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-22T18:20:20.922622] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T18:20:21.717722] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-22T18:20:21.989614] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:20:22.517719] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-22T18:20:22.920002] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T18:20:22.985741] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T18:20:23.317719] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-22T18:20:23.426965] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T18:20:24.117712] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-22T18:20:24.917714] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-22T18:20:25.019387] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T18:20:25.717716] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-22T18:20:25.771557] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-22T18:20:26.413400] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T18:20:26.517672] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-22T18:20:26.575102] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T18:20:27.317711] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-22T18:20:28.117664] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-22T18:20:28.295030] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T18:20:28.895485] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T18:20:28.917616] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-22T18:20:29.052931] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T18:20:29.717699] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-22T18:20:29.882997] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-22T18:20:29.884966] [INFO ] [REMOTE ] DMO: Full fetch complete (14479 records). [2025-10-22T18:20:29.885047] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-22T18:20:30.244215] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-22T18:20:30.244311] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-22T18:20:30.244629] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-22T18:20:30.244714] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-22T18:20:30.245194] [DEBUG] [LOCAL ] DMO: Trimmed 14479 records to 9788 (keeping 200 days of data) [2025-10-22T18:20:30.304507] [DEBUG] [LOCAL ] DMO: Primary data saved (9788 records). [2025-10-22T18:20:30.304635] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-22T18:20:30.304749] [INFO ] [MAIN ] Update Progress: 635/2367 symbols completed. DMO took 26.1s. Estimated remaining: 3h 39m 22s. Rate: 7.9 symbols/min [2025-10-22T18:20:30.471961] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:30.482796] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T18:20:30.485008] [INFO ] [REMOTE ] DMB: Full fetch complete (14652 records). [2025-10-22T18:20:30.485088] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-22T18:20:30.485533] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:20:30.485627] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:20:30.485739] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:20:30.485821] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-22T18:20:30.485912] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-22T18:20:30.485957] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-22T18:20:30.486083] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-10-22T18:20:30.486168] [INFO ] [MAIN ] Update Progress: 636/2367 symbols completed. DMB took 30.7s. Estimated remaining: 3h 38m 55s. Rate: 7.9 symbols/min [2025-10-22T18:20:30.518709] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-22T18:20:30.630437] [DEBUG] [LOCAL ] DNP: Loaded 33093 existing records from primary storage. [2025-10-22T18:20:30.653968] [INFO ] [MAIN ] DNP: Loaded 33093 existing records. [2025-10-22T18:20:30.755130] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:30.861825] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:30.862096] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-22T18:20:30.862152] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-22T18:20:30.862370] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-22T18:20:30.862427] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-22T18:20:31.107484] [DEBUG] [LOCAL ] DOC: Loaded 53555 existing records from primary storage. [2025-10-22T18:20:31.151861] [INFO ] [MAIN ] DOC: Loaded 53555 existing records. [2025-10-22T18:20:31.319559] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-22T18:20:31.460522] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:31.481911] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:31.482116] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-22T18:20:31.482162] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-22T18:20:31.482341] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-22T18:20:31.482378] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-22T18:20:31.852971] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:32.117757] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-22T18:20:32.151413] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:20:32.917744] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-22T18:20:33.357806] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T18:20:33.717676] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-22T18:20:33.954242] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T18:20:34.517690] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-22T18:20:34.565719] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:20:35.317679] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-22T18:20:35.774429] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T18:20:36.117705] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-22T18:20:36.188829] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T18:20:36.253514] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T18:20:36.917753] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-22T18:20:37.717712] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-22T18:20:37.886093] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T18:20:38.268458] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T18:20:38.517762] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-22T18:20:39.317709] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-22T18:20:39.696966] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T18:20:40.117728] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-22T18:20:40.247340] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T18:20:40.255054] [INFO ] [REMOTE ] DNOW: Full fetch complete (63628 records). [2025-10-22T18:20:40.255200] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-22T18:20:40.648609] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-22T18:20:40.648841] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-22T18:20:40.649597] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-22T18:20:40.649670] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-22T18:20:40.650952] [DEBUG] [LOCAL ] DNOW: Trimmed 63628 records to 43752 (keeping 200 days of data) [2025-10-22T18:20:40.913335] [DEBUG] [LOCAL ] DNOW: Primary data saved (43752 records). [2025-10-22T18:20:40.913612] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-22T18:20:40.924116] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-22T18:20:40.924298] [INFO ] [MAIN ] Update Progress: 637/2367 symbols completed. DNOW took 33.0s. Estimated remaining: 3h 38m 55s. Rate: 7.9 symbols/min [2025-10-22T18:20:40.947722] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:20:41.667993] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:20:41.717611] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-22T18:20:42.517693] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-22T18:20:42.910709] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T18:20:43.262546] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T18:20:43.317683] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-22T18:20:44.121199] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-22T18:20:44.524999] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T18:20:44.917829] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-22T18:20:45.706013] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T18:20:45.717608] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-22T18:20:45.794508] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-22T18:20:45.802566] [INFO ] [REMOTE ] DNA: Full fetch complete (70871 records). [2025-10-22T18:20:45.802766] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-22T18:20:45.803587] [FATAL] [VALIDATOR ] DNA: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:20:45.803711] [FATAL] [MAIN ] DNA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:20:45.803761] [WARN ] [MAIN ] DNA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:20:45.803827] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-22T18:20:45.803897] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-22T18:20:45.803935] [INFO ] [LOCAL ] DNA: Starting deletion of derivative data. [2025-10-22T18:20:45.804111] [DEBUG] [LOCAL ] DNA: Deleted derivative data file. [2025-10-22T18:20:45.804806] [INFO ] [MAIN ] Update Progress: 638/2367 symbols completed. DNA took 39.7s. Estimated remaining: 3h 38m 40s. Rate: 7.9 symbols/min [2025-10-22T18:20:46.560422] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T18:20:46.572001] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-22T18:20:47.068135] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T18:20:47.317764] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-22T18:20:48.318003] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T18:20:48.328923] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-22T18:20:48.591515] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T18:20:48.917730] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-22T18:20:49.908329] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T18:20:49.920012] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-22T18:20:50.573411] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:20:50.580375] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-22T18:20:51.762873] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T18:20:51.774872] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-22T18:20:52.069056] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T18:20:52.074229] [INFO ] [REMOTE ] DNP: Full fetch complete (48481 records). [2025-10-22T18:20:52.074319] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-22T18:20:52.505491] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-22T18:20:52.505581] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-22T18:20:52.506349] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-22T18:20:52.506414] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-22T18:20:52.507533] [DEBUG] [LOCAL ] DNP: Trimmed 48481 records to 32937 (keeping 200 days of data) [2025-10-22T18:20:52.704082] [DEBUG] [LOCAL ] DNP: Primary data saved (32937 records). [2025-10-22T18:20:52.704258] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-22T18:20:52.704355] [INFO ] [MAIN ] Update Progress: 639/2367 symbols completed. DNP took 22.4s. Estimated remaining: 3h 38m 30s. Rate: 7.9 symbols/min [2025-10-22T18:20:53.814565] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T18:20:53.830973] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-22T18:20:56.161603] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-22T18:20:56.172577] [INFO ] [REMOTE ] DOC: Full fetch complete (77595 records). [2025-10-22T18:20:56.172787] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-22T18:20:56.569524] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-22T18:20:56.569617] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-22T18:20:56.570507] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-22T18:20:56.570566] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-22T18:20:56.572092] [DEBUG] [LOCAL ] DOC: Trimmed 77595 records to 53555 (keeping 200 days of data) [2025-10-22T18:20:56.893384] [DEBUG] [LOCAL ] DOC: Primary data saved (53555 records). [2025-10-22T18:20:56.893519] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-22T18:20:56.893596] [INFO ] [MAIN ] Update Progress: 640/2367 symbols completed. DOC took 26.4s. Estimated remaining: 3h 38m 14s. Rate: 7.9 symbols/min [2025-10-22T18:20:57.417219] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:57.531286] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:57.512148] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:57.548038] [DEBUG] [LOCAL ] DOLE: No existing data file found in primary storage. [2025-10-22T18:20:57.571087] [WARN ] [MAIN ] DOLE: No existing data found, performing full refresh instead. [2025-10-22T18:20:57.603310] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-22T18:20:57.603087] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:57.603815] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-22T18:20:57.603732] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-22T18:20:57.603944] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-22T18:20:57.604157] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-22T18:20:57.604207] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-22T18:20:57.604249] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-22T18:20:57.604281] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-22T18:20:57.604056] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-22T18:20:57.624943] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-22T18:20:57.893855] [DEBUG] [LOCAL ] DOUG: Loaded 33846 existing records from primary storage. [2025-10-22T18:20:57.928734] [INFO ] [MAIN ] DOUG: Loaded 33846 existing records. [2025-10-22T18:20:58.145453] [DEBUG] [LOCAL ] DOCN: Loaded 51135 existing records from primary storage. [2025-10-22T18:20:58.217132] [INFO ] [MAIN ] DOCN: Loaded 51135 existing records. [2025-10-22T18:20:58.642736] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:58.669880] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:58.712020] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-22T18:20:58.731225] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-22T18:20:58.776441] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-22T18:20:58.812859] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:58.784343] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-22T18:20:58.837083] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-22T18:20:58.836593] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-22T18:20:58.842741] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:58.854302] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-22T18:20:58.874269] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-22T18:20:58.912125] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-22T18:20:58.919192] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-22T18:20:59.533917] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:59.535327] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-22T18:20:59.554977] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:59.555356] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-22T18:21:00.480052] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T18:21:00.490022] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-22T18:21:00.574180] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:21:00.583933] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-22T18:21:01.618359] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T18:21:01.626169] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-22T18:21:01.747537] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T18:21:01.757296] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-22T18:21:02.461883] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T18:21:02.468417] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-22T18:21:02.958696] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-22T18:21:02.969106] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-22T18:21:03.544696] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T18:21:03.553115] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-22T18:21:03.646496] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T18:21:03.656420] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-22T18:21:03.999202] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:21:04.006489] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-22T18:21:04.910761] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T18:21:04.921614] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-22T18:21:04.962365] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T18:21:04.970570] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-22T18:21:05.005716] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T18:21:05.016815] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-22T18:21:05.510704] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T18:21:05.717780] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-22T18:21:06.367153] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T18:21:06.480504] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T18:21:06.527352] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-22T18:21:06.547867] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T18:21:07.328526] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-22T18:21:07.334168] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T18:21:08.127861] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-22T18:21:08.132698] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T18:21:08.917711] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-22T18:21:09.174562] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:21:09.717755] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-22T18:21:10.024567] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T18:21:10.074871] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T18:21:10.517753] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-22T18:21:11.317731] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-22T18:21:11.613517] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T18:21:12.049409] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T18:21:12.117617] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-22T18:21:12.782303] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T18:21:12.917617] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-22T18:21:13.000208] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T18:21:13.717737] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-22T18:21:14.517705] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-22T18:21:14.736563] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:21:15.317065] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T18:21:15.323957] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-22T18:21:15.447193] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T18:21:16.117739] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-22T18:21:16.917721] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-22T18:21:17.324977] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-22T18:21:17.472431] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T18:21:17.477616] [INFO ] [REMOTE ] DOUG: Full fetch complete (50003 records). [2025-10-22T18:21:17.477835] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-22T18:21:17.729005] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-22T18:21:17.856899] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-22T18:21:17.856978] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-22T18:21:17.857616] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-22T18:21:17.857724] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-22T18:21:17.858688] [DEBUG] [LOCAL ] DOUG: Trimmed 50003 records to 33811 (keeping 200 days of data) [2025-10-22T18:21:18.043257] [DEBUG] [LOCAL ] DOUG: Primary data saved (33811 records). [2025-10-22T18:21:18.043397] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-22T18:21:18.043475] [INFO ] [MAIN ] Update Progress: 641/2367 symbols completed. DOUG took 21.1s. Estimated remaining: 3h 38m 42s. Rate: 7.9 symbols/min [2025-10-22T18:21:18.210545] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:18.252961] [DEBUG] [LOCAL ] DOV: Loaded 45577 existing records from primary storage. [2025-10-22T18:21:18.253275] [INFO ] [MAIN ] DOV: Loaded 45577 existing records. [2025-10-22T18:21:18.434464] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:21:18.434794] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-22T18:21:18.434897] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-22T18:21:18.435153] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-22T18:21:18.435213] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-22T18:21:18.531804] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-22T18:21:18.561848] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T18:21:18.817920] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:19.185234] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T18:21:19.317700] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-22T18:21:20.117617] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-22T18:21:20.625829] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T18:21:20.917875] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-22T18:21:20.920505] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:21:21.233901] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T18:21:21.717733] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-22T18:21:22.517716] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-22T18:21:22.599895] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T18:21:23.317719] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-22T18:21:23.705958] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T18:21:24.117713] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-22T18:21:24.245318] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T18:21:24.917777] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-22T18:21:25.474455] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-22T18:21:25.483371] [INFO ] [REMOTE ] DOCN: Full fetch complete (72961 records). [2025-10-22T18:21:25.483515] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-22T18:21:25.723962] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-22T18:21:25.906628] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-22T18:21:25.919563] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-22T18:21:25.928070] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-22T18:21:25.928224] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-22T18:21:25.930339] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T18:21:25.939484] [DEBUG] [LOCAL ] DOCN: Trimmed 72961 records to 51129 (keeping 200 days of data) [2025-10-22T18:21:26.244270] [DEBUG] [LOCAL ] DOCN: Primary data saved (51129 records). [2025-10-22T18:21:26.244841] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-22T18:21:26.244943] [INFO ] [MAIN ] Update Progress: 642/2367 symbols completed. DOCN took 29.4s. Estimated remaining: 3h 38m 36s. Rate: 7.9 symbols/min [2025-10-22T18:21:26.425156] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:26.425437] [DEBUG] [LOCAL ] DOW: No existing data file found in primary storage. [2025-10-22T18:21:26.425498] [WARN ] [MAIN ] DOW: No existing data found, performing full refresh instead. [2025-10-22T18:21:26.425680] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-22T18:21:26.425925] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-22T18:21:26.425972] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-10-22T18:21:26.426005] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-22T18:21:26.522159] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-22T18:21:26.747417] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T18:21:26.794351] [INFO ] [REMOTE ] DOLE: Full fetch complete (54407 records). [2025-10-22T18:21:26.831949] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-22T18:21:26.835764] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:26.837123] [FATAL] [VALIDATOR ] DOLE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:21:26.837259] [FATAL] [MAIN ] DOLE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:21:26.837323] [WARN ] [MAIN ] DOLE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:21:26.837586] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-22T18:21:26.837714] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-22T18:21:26.837775] [INFO ] [LOCAL ] DOLE: Starting deletion of derivative data. [2025-10-22T18:21:26.837823] [DEBUG] [LOCAL ] DOLE: No derivative data file found to delete. [2025-10-22T18:21:26.837884] [INFO ] [MAIN ] Update Progress: 643/2367 symbols completed. DOLE took 29.9s. Estimated remaining: 3h 38m 10s. Rate: 7.9 symbols/min [2025-10-22T18:21:27.025773] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:27.041369] [DEBUG] [LOCAL ] DPG: Loaded 13478 existing records from primary storage. [2025-10-22T18:21:27.041600] [INFO ] [MAIN ] DPG: Loaded 13478 existing records. [2025-10-22T18:21:27.227002] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:21:27.227263] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-22T18:21:27.227319] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-22T18:21:27.227513] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-22T18:21:27.227569] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-22T18:21:27.324068] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-22T18:21:27.586114] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:27.839509] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T18:21:27.847340] [INFO ] [REMOTE ] DOCS: Full fetch complete (73764 records). [2025-10-22T18:21:27.847484] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-22T18:21:28.122877] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-22T18:21:28.280083] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-22T18:21:28.280211] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-22T18:21:28.281234] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-22T18:21:28.281620] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-22T18:21:28.283792] [DEBUG] [LOCAL ] DOCS: Trimmed 73764 records to 50353 (keeping 200 days of data) [2025-10-22T18:21:28.539135] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T18:21:28.655044] [DEBUG] [LOCAL ] DOCS: Primary data saved (50353 records). [2025-10-22T18:21:28.655161] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-22T18:21:28.655233] [INFO ] [MAIN ] Update Progress: 644/2367 symbols completed. DOCS took 31.8s. Estimated remaining: 3h 37m 47s. Rate: 7.9 symbols/min [2025-10-22T18:21:28.825777] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:28.868112] [DEBUG] [LOCAL ] DQ: Loaded 43827 existing records from primary storage. [2025-10-22T18:21:28.868405] [INFO ] [MAIN ] DQ: Loaded 43827 existing records. [2025-10-22T18:21:28.944900] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-22T18:21:29.044233] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T18:21:29.076668] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:21:29.076925] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-22T18:21:29.077024] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-22T18:21:29.077387] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-22T18:21:29.077447] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-22T18:21:29.212405] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:21:29.483181] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:29.717753] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-22T18:21:30.512335] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T18:21:30.517602] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-22T18:21:30.919892] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T18:21:31.317701] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-22T18:21:31.419474] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T18:21:32.117693] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-22T18:21:32.908162] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T18:21:32.917611] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-22T18:21:33.717674] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-22T18:21:34.398839] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-22T18:21:34.517092] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T18:21:34.525820] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-22T18:21:34.629731] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T18:21:35.317714] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-22T18:21:36.117683] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-22T18:21:36.169554] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T18:21:36.247951] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T18:21:36.917735] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-22T18:21:37.667138] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T18:21:37.717687] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-22T18:21:38.517726] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-22T18:21:38.641206] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T18:21:38.833176] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T18:21:39.317724] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-22T18:21:40.122783] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-22T18:21:40.138923] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:21:40.382456] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T18:21:40.917736] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-22T18:21:41.717731] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-22T18:21:41.862268] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T18:21:42.393153] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-22T18:21:42.517714] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-22T18:21:43.317734] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-22T18:21:43.381016] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T18:21:44.117614] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-22T18:21:44.234322] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T18:21:44.683775] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-22T18:21:44.917755] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-22T18:21:45.717737] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-22T18:21:45.930186] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T18:21:46.517719] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-22T18:21:46.982129] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T18:21:47.317681] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-22T18:21:47.355221] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T18:21:47.517855] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T18:21:47.520374] [INFO ] [REMOTE ] DPG: Full fetch complete (19007 records). [2025-10-22T18:21:47.520443] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-22T18:21:47.880017] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-22T18:21:47.880094] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-22T18:21:47.880609] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-22T18:21:47.880710] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-22T18:21:47.881470] [DEBUG] [LOCAL ] DPG: Trimmed 19007 records to 13345 (keeping 200 days of data) [2025-10-22T18:21:47.962308] [DEBUG] [LOCAL ] DPG: Primary data saved (13345 records). [2025-10-22T18:21:47.962440] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-22T18:21:47.962520] [INFO ] [MAIN ] Update Progress: 645/2367 symbols completed. DPG took 21.1s. Estimated remaining: 3h 38m 11s. Rate: 7.9 symbols/min [2025-10-22T18:21:48.135732] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:48.132202] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-22T18:21:48.174273] [DEBUG] [LOCAL ] DRD: Loaded 37887 existing records from primary storage. [2025-10-22T18:21:48.174560] [INFO ] [MAIN ] DRD: Loaded 37887 existing records. [2025-10-22T18:21:48.351829] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:21:48.352076] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-22T18:21:48.352125] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-22T18:21:48.352412] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-22T18:21:48.352472] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-22T18:21:48.720925] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:48.917723] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-22T18:21:49.527109] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-22T18:21:49.593240] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T18:21:49.717686] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-22T18:21:50.120521] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T18:21:50.517710] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-22T18:21:50.983537] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T18:21:51.317719] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-22T18:21:52.117742] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-22T18:21:52.586378] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T18:21:52.910189] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T18:21:52.919573] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-22T18:21:53.448115] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T18:21:53.717709] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-22T18:21:54.517710] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-22T18:21:55.091946] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-22T18:21:55.124514] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T18:21:55.317711] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-22T18:21:56.117674] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-22T18:21:56.353205] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:21:56.361088] [INFO ] [REMOTE ] DOV: Full fetch complete (66122 records). [2025-10-22T18:21:56.361236] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-22T18:21:56.746198] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-22T18:21:56.746420] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-22T18:21:56.747275] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-22T18:21:56.747352] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-22T18:21:56.748637] [DEBUG] [LOCAL ] DOV: Trimmed 66122 records to 45584 (keeping 200 days of data) [2025-10-22T18:21:56.927178] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-22T18:21:56.999091] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:21:57.065516] [DEBUG] [LOCAL ] DOV: Primary data saved (45584 records). [2025-10-22T18:21:57.065692] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-22T18:21:57.065791] [INFO ] [MAIN ] Update Progress: 646/2367 symbols completed. DOV took 39.0s. Estimated remaining: 3h 38m 7s. Rate: 7.9 symbols/min [2025-10-22T18:21:57.238294] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:57.281214] [DEBUG] [LOCAL ] DRH: Loaded 50269 existing records from primary storage. [2025-10-22T18:21:57.281519] [INFO ] [MAIN ] DRH: Loaded 50269 existing records. [2025-10-22T18:21:57.457363] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:21:57.457587] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-22T18:21:57.457686] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-22T18:21:57.457924] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-22T18:21:57.457979] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-22T18:21:57.728146] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-22T18:21:57.820286] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:57.846430] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T18:21:58.517712] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-22T18:21:59.293070] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-22T18:21:59.302735] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-22T18:21:59.326212] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-22T18:21:59.323517] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-22T18:21:59.328498] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T18:21:59.781363] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-22T18:21:59.781458] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-22T18:21:59.782412] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-22T18:21:59.782483] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-22T18:21:59.784050] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 53733 (keeping 200 days of data) [2025-10-22T18:22:00.119688] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-22T18:22:00.121993] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-22T18:22:00.122275] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-22T18:22:00.123243] [INFO ] [MAIN ] Update Progress: 647/2367 symbols completed. DOW took 33.9s. Estimated remaining: 3h 37m 47s. Rate: 7.9 symbols/min [2025-10-22T18:22:00.300682] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:00.344258] [DEBUG] [LOCAL ] DRI: Loaded 47615 existing records from primary storage. [2025-10-22T18:22:00.344568] [INFO ] [MAIN ] DRI: Loaded 47615 existing records. [2025-10-22T18:22:00.526437] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:22:00.526737] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-22T18:22:00.526823] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-22T18:22:00.527011] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-22T18:22:00.527051] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-22T18:22:00.675330] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-22T18:22:00.922775] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-22T18:22:00.987144] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:01.395448] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-22T18:22:01.717695] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-22T18:22:01.760875] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T18:22:02.517765] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-22T18:22:02.793378] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T18:22:02.805219] [INFO ] [REMOTE ] DQ: Full fetch complete (63304 records). [2025-10-22T18:22:02.805444] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-22T18:22:02.806552] [FATAL] [VALIDATOR ] DQ: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:22:02.806711] [FATAL] [MAIN ] DQ: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:22:02.807084] [WARN ] [MAIN ] DQ: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:22:02.807185] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-22T18:22:02.807282] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-22T18:22:02.807345] [INFO ] [LOCAL ] DQ: Starting deletion of derivative data. [2025-10-22T18:22:02.807522] [DEBUG] [LOCAL ] DQ: Deleted derivative data file. [2025-10-22T18:22:02.809939] [INFO ] [MAIN ] Update Progress: 648/2367 symbols completed. DQ took 34.2s. Estimated remaining: 3h 37m 27s. Rate: 7.9 symbols/min [2025-10-22T18:22:03.063973] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:03.078926] [DEBUG] [LOCAL ] DRLL: Loaded 8769 existing records from primary storage. [2025-10-22T18:22:03.079187] [INFO ] [MAIN ] DRLL: Loaded 8769 existing records. [2025-10-22T18:22:03.280033] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:22:03.280750] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-22T18:22:03.280938] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-22T18:22:03.281251] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-22T18:22:03.281359] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-22T18:22:03.322922] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-22T18:22:03.576411] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:22:03.699109] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:03.886286] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T18:22:04.117714] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-22T18:22:04.909481] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T18:22:04.922957] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-22T18:22:05.015476] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T18:22:05.717718] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-22T18:22:06.347818] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:22:06.517705] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-22T18:22:07.317620] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-22T18:22:07.743291] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T18:22:08.117675] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-22T18:22:08.263060] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T18:22:08.501934] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T18:22:08.917699] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-22T18:22:09.501593] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T18:22:09.717703] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-22T18:22:10.326101] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T18:22:10.517706] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-22T18:22:11.317885] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-22T18:22:11.344224] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T18:22:11.391343] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:22:12.117676] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-22T18:22:12.917686] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-22T18:22:13.039234] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T18:22:13.345961] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-22T18:22:13.353903] [INFO ] [REMOTE ] DRD: Full fetch complete (52158 records). [2025-10-22T18:22:13.354116] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-22T18:22:13.722718] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-22T18:22:13.739912] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-22T18:22:13.741091] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-22T18:22:13.741939] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-22T18:22:13.742008] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-22T18:22:13.743181] [DEBUG] [LOCAL ] DRD: Trimmed 52158 records to 37899 (keeping 200 days of data) [2025-10-22T18:22:13.979221] [DEBUG] [LOCAL ] DRD: Primary data saved (37899 records). [2025-10-22T18:22:13.979357] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-22T18:22:13.979447] [INFO ] [MAIN ] Update Progress: 649/2367 symbols completed. DRD took 26.0s. Estimated remaining: 3h 37m 29s. Rate: 7.9 symbols/min [2025-10-22T18:22:14.158067] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:14.158272] [DEBUG] [LOCAL ] DSL: No existing data file found in primary storage. [2025-10-22T18:22:14.158326] [WARN ] [MAIN ] DSL: No existing data found, performing full refresh instead. [2025-10-22T18:22:14.158458] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-22T18:22:14.158510] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-22T18:22:14.158552] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-22T18:22:14.158585] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-22T18:22:14.510259] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:14.517611] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-22T18:22:14.856334] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T18:22:15.317720] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-22T18:22:15.555623] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T18:22:15.638027] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T18:22:16.117697] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-22T18:22:16.917700] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-22T18:22:17.275544] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T18:22:17.352261] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T18:22:17.717721] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-22T18:22:18.212026] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T18:22:18.430854] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T18:22:18.517673] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-22T18:22:19.272763] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T18:22:19.317720] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-22T18:22:20.117715] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-22T18:22:20.675909] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T18:22:20.917710] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-22T18:22:21.381810] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-22T18:22:21.717693] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-22T18:22:21.839052] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T18:22:22.517730] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-22T18:22:23.317734] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-22T18:22:23.384724] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:22:23.756553] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T18:22:24.122943] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-22T18:22:24.131735] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T18:22:24.917714] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-22T18:22:25.717700] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-22T18:22:25.923275] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T18:22:26.060882] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T18:22:26.517711] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-22T18:22:27.317689] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-22T18:22:27.433594] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:22:28.117618] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-22T18:22:28.168077] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T18:22:28.344990] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:22:28.917714] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-22T18:22:29.034352] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T18:22:29.717696] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-22T18:22:30.323322] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T18:22:30.517709] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-22T18:22:30.561176] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T18:22:30.569630] [INFO ] [REMOTE ] DRI: Full fetch complete (69505 records). [2025-10-22T18:22:30.569842] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-22T18:22:30.992319] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-22T18:22:30.992418] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-22T18:22:30.993326] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-22T18:22:30.993401] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-22T18:22:30.994902] [DEBUG] [LOCAL ] DRI: Trimmed 69505 records to 47513 (keeping 200 days of data) [2025-10-22T18:22:31.320367] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-22T18:22:31.323094] [DEBUG] [LOCAL ] DRI: Primary data saved (47513 records). [2025-10-22T18:22:31.323594] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-22T18:22:31.324474] [INFO ] [MAIN ] Update Progress: 650/2367 symbols completed. DRI took 31.2s. Estimated remaining: 3h 37m 47s. Rate: 7.9 symbols/min [2025-10-22T18:22:31.436730] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T18:22:31.508061] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:31.521331] [DEBUG] [LOCAL ] DSM: Loaded 14103 existing records from primary storage. [2025-10-22T18:22:31.521583] [INFO ] [MAIN ] DSM: Loaded 14103 existing records. [2025-10-22T18:22:31.694425] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:22:31.694689] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-22T18:22:31.694747] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-22T18:22:31.694970] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-22T18:22:31.695008] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-22T18:22:32.056036] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:32.117690] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-22T18:22:32.857320] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T18:22:32.859041] [INFO ] [REMOTE ] DRLL: Full fetch complete (14510 records). [2025-10-22T18:22:32.859129] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-22T18:22:32.859527] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:22:32.859613] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:22:32.859711] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:22:32.859766] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-22T18:22:32.859846] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-22T18:22:32.859900] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-10-22T18:22:32.860052] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-10-22T18:22:32.860136] [INFO ] [MAIN ] Update Progress: 651/2367 symbols completed. DRLL took 30.0s. Estimated remaining: 3h 37m 23s. Rate: 7.9 symbols/min [2025-10-22T18:22:32.920834] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-22T18:22:33.047680] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:33.047877] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-22T18:22:33.048020] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-22T18:22:33.048167] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-22T18:22:33.048264] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-22T18:22:33.048382] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-22T18:22:33.048504] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-22T18:22:33.181991] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T18:22:33.246047] [INFO ] [REMOTE ] DRH: Full fetch complete (71605 records). [2025-10-22T18:22:33.263529] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-22T18:22:33.334351] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:22:33.352052] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:22:33.363993] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:22:33.377694] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-22T18:22:33.377817] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-22T18:22:33.382302] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-10-22T18:22:33.382627] [DEBUG] [LOCAL ] DRH: Deleted derivative data file. [2025-10-22T18:22:33.401223] [INFO ] [MAIN ] Update Progress: 652/2367 symbols completed. DRH took 36.3s. Estimated remaining: 3h 36m 57s. Rate: 7.9 symbols/min [2025-10-22T18:22:33.549691] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:33.638362] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:33.659112] [DEBUG] [LOCAL ] DSU: Loaded 23023 existing records from primary storage. [2025-10-22T18:22:33.659359] [INFO ] [MAIN ] DSU: Loaded 23023 existing records. [2025-10-22T18:22:33.722872] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-22T18:22:33.836970] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:22:33.837218] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-22T18:22:33.837283] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-22T18:22:33.837496] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-22T18:22:33.837555] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-22T18:22:34.154457] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T18:22:34.222048] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:34.318531] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T18:22:34.517710] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-22T18:22:35.317727] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-22T18:22:35.954924] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T18:22:36.117709] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-22T18:22:36.216045] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T18:22:36.591895] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-22T18:22:36.917755] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-22T18:22:37.717733] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-22T18:22:38.044054] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T18:22:38.517685] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-22T18:22:38.762779] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T18:22:39.317725] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-22T18:22:39.345898] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T18:22:39.867238] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T18:22:40.117706] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-22T18:22:40.917695] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-22T18:22:41.538921] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:22:41.638582] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T18:22:41.717734] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-22T18:22:42.517696] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-22T18:22:42.823494] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T18:22:43.317703] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-22T18:22:43.435479] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T18:22:44.117741] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-22T18:22:44.529405] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T18:22:44.917717] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-22T18:22:45.252892] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T18:22:45.717744] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-22T18:22:46.170317] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:22:46.517678] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-22T18:22:46.843989] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T18:22:47.317689] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-22T18:22:47.755998] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T18:22:47.762667] [INFO ] [REMOTE ] DSL: Full fetch complete (41780 records). [2025-10-22T18:22:47.762770] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-22T18:22:48.125606] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-22T18:22:48.181242] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-22T18:22:48.181354] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-22T18:22:48.182054] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-22T18:22:48.182118] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-22T18:22:48.183132] [DEBUG] [LOCAL ] DSL: Trimmed 41780 records to 28887 (keeping 200 days of data) [2025-10-22T18:22:48.371891] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T18:22:48.382176] [DEBUG] [LOCAL ] DSL: Primary data saved (28887 records). [2025-10-22T18:22:48.382278] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-22T18:22:48.382381] [INFO ] [MAIN ] Update Progress: 653/2367 symbols completed. DSL took 34.4s. Estimated remaining: 3h 37m 9s. Rate: 7.9 symbols/min [2025-10-22T18:22:48.563930] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:48.586180] [DEBUG] [LOCAL ] DSX: Loaded 23594 existing records from primary storage. [2025-10-22T18:22:48.586451] [INFO ] [MAIN ] DSX: Loaded 23594 existing records. [2025-10-22T18:22:48.766905] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:22:48.767175] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-22T18:22:48.767228] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-22T18:22:48.767397] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-22T18:22:48.767434] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-22T18:22:48.853052] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T18:22:48.917955] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-22T18:22:49.126047] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:49.455758] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-22T18:22:49.717708] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-22T18:22:50.517514] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T18:22:50.517726] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-22T18:22:51.317706] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-22T18:22:51.697914] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:22:52.117686] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-22T18:22:52.201134] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T18:22:52.917748] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-22T18:22:53.286375] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T18:22:53.309113] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T18:22:53.717726] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-22T18:22:54.517777] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-22T18:22:54.805450] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T18:22:54.949178] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T18:22:55.317819] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-22T18:22:56.117745] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-22T18:22:56.602279] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:22:56.917738] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-22T18:22:57.043691] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T18:22:57.717744] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-22T18:22:58.296853] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T18:22:58.517788] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-22T18:22:58.920444] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T18:22:59.317671] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-22T18:23:00.117756] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-22T18:23:00.917780] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-22T18:23:05.126601] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (6.61 seconds). [2025-10-22T18:23:05.128984] [INFO ] [REMOTE ] DSM: Full fetch complete (23985 records). [2025-10-22T18:23:05.129059] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-22T18:23:05.414622] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (6.10 seconds). [2025-10-22T18:23:05.433213] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-22T18:23:05.504810] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-22T18:23:05.504912] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-22T18:23:05.505398] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-22T18:23:05.505439] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-22T18:23:05.506843] [DEBUG] [LOCAL ] DSM: Trimmed 23985 records to 14178 (keeping 200 days of data) [2025-10-22T18:23:05.587901] [DEBUG] [LOCAL ] DSM: Primary data saved (14178 records). [2025-10-22T18:23:05.588045] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-22T18:23:05.588123] [INFO ] [MAIN ] Update Progress: 654/2367 symbols completed. DSM took 34.3s. Estimated remaining: 3h 37m 26s. Rate: 7.9 symbols/min [2025-10-22T18:23:05.755878] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:05.769563] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (4.85 seconds). [2025-10-22T18:23:05.774774] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-22T18:23:05.821305] [DEBUG] [LOCAL ] DT: Loaded 52954 existing records from primary storage. [2025-10-22T18:23:05.821603] [INFO ] [MAIN ] DT: Loaded 52954 existing records. [2025-10-22T18:23:05.997747] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:23:05.997940] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-22T18:23:05.997987] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-22T18:23:05.998171] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-22T18:23:05.998208] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-22T18:23:06.287268] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (6.17 seconds). [2025-10-22T18:23:06.298464] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T18:23:06.300410] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-22T18:23:06.301048] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-22T18:23:06.381243] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:06.381743] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-22T18:23:06.832578] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-22T18:23:06.833436] [INFO ] [REMOTE ] DSMC: Full fetch complete (2859 records). [2025-10-22T18:23:06.833503] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-22T18:23:06.833867] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:23:06.833947] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:23:06.833990] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:23:06.834029] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-22T18:23:06.834160] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-22T18:23:06.834211] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-22T18:23:06.834252] [DEBUG] [LOCAL ] DSMC: No derivative data file found to delete. [2025-10-22T18:23:06.834303] [INFO ] [MAIN ] Update Progress: 655/2367 symbols completed. DSMC took 34.0s. Estimated remaining: 3h 37m 2s. Rate: 7.9 symbols/min [2025-10-22T18:23:07.003168] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:07.019686] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T18:23:07.027827] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-22T18:23:07.031436] [DEBUG] [LOCAL ] DTB: Loaded 4919 existing records from primary storage. [2025-10-22T18:23:07.031668] [INFO ] [MAIN ] DTB: Loaded 4919 existing records. [2025-10-22T18:23:07.232743] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:23:07.232984] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-22T18:23:07.233033] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-22T18:23:07.233198] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-22T18:23:07.233256] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-22T18:23:07.584464] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:07.584833] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-22T18:23:07.854291] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T18:23:07.860171] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-22T18:23:08.065955] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-22T18:23:08.117615] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-22T18:23:08.328708] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T18:23:08.569039] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T18:23:08.648792] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T18:23:08.896347] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T18:23:08.900750] [INFO ] [REMOTE ] DSU: Full fetch complete (33150 records). [2025-10-22T18:23:08.900833] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-22T18:23:08.922841] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-22T18:23:09.284985] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-22T18:23:09.285068] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-22T18:23:09.285676] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-22T18:23:09.285738] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-22T18:23:09.286587] [DEBUG] [LOCAL ] DSU: Trimmed 33150 records to 22871 (keeping 200 days of data) [2025-10-22T18:23:09.425901] [DEBUG] [LOCAL ] DSU: Primary data saved (22871 records). [2025-10-22T18:23:09.426038] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-22T18:23:09.426160] [INFO ] [MAIN ] Update Progress: 656/2367 symbols completed. DSU took 36.0s. Estimated remaining: 3h 36m 42s. Rate: 7.9 symbols/min [2025-10-22T18:23:09.593759] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:09.637315] [DEBUG] [LOCAL ] DTE: Loaded 47181 existing records from primary storage. [2025-10-22T18:23:09.637706] [INFO ] [MAIN ] DTE: Loaded 47181 existing records. [2025-10-22T18:23:09.726271] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-22T18:23:09.816003] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:23:09.816239] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-22T18:23:09.816302] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-22T18:23:09.816514] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-22T18:23:09.816571] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-22T18:23:10.175228] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:10.464038] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T18:23:10.517683] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-22T18:23:11.227180] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-22T18:23:11.317620] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-22T18:23:12.117705] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-22T18:23:12.742288] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T18:23:12.924904] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-22T18:23:12.930168] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-22T18:23:13.500077] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T18:23:13.717710] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-22T18:23:14.297830] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-22T18:23:14.297599] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-22T18:23:14.517672] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-22T18:23:15.117950] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T18:23:15.317696] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-22T18:23:16.117716] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-22T18:23:16.472892] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T18:23:16.917716] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-22T18:23:17.621189] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T18:23:17.717641] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-22T18:23:18.098130] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T18:23:18.102292] [INFO ] [REMOTE ] DSX: Full fetch complete (35513 records). [2025-10-22T18:23:18.102372] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-22T18:23:18.479736] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-22T18:23:18.479825] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-22T18:23:18.480439] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-22T18:23:18.480487] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-22T18:23:18.481306] [DEBUG] [LOCAL ] DSX: Trimmed 35513 records to 23496 (keeping 200 days of data) [2025-10-22T18:23:18.530499] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-22T18:23:18.545214] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T18:23:18.625545] [DEBUG] [LOCAL ] DSX: Primary data saved (23496 records). [2025-10-22T18:23:18.625709] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-22T18:23:18.625800] [INFO ] [MAIN ] Update Progress: 657/2367 symbols completed. DSX took 30.2s. Estimated remaining: 3h 36m 38s. Rate: 7.9 symbols/min [2025-10-22T18:23:18.809059] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:18.809300] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-22T18:23:18.809356] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-22T18:23:18.809482] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-22T18:23:18.809535] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-22T18:23:18.809581] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-22T18:23:18.809614] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-22T18:23:19.171135] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:19.317740] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-22T18:23:19.897173] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T18:23:20.117723] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-22T18:23:20.564853] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T18:23:20.917715] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-22T18:23:21.434903] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-22T18:23:21.717683] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-22T18:23:21.850214] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:23:22.517637] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-22T18:23:22.590969] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T18:23:22.818842] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-22T18:23:23.317691] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-22T18:23:24.117688] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-22T18:23:24.573269] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-22T18:23:24.917698] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-22T18:23:25.240740] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T18:23:25.489130] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T18:23:25.490254] [INFO ] [REMOTE ] DTB: Full fetch complete (6512 records). [2025-10-22T18:23:25.490320] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-22T18:23:25.490756] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:23:25.490837] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:23:25.490878] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:23:25.490944] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-22T18:23:25.491005] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-22T18:23:25.491039] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-22T18:23:25.491190] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-10-22T18:23:25.491273] [INFO ] [MAIN ] Update Progress: 658/2367 symbols completed. DTB took 18.7s. Estimated remaining: 3h 36m 29s. Rate: 7.9 symbols/min [2025-10-22T18:23:25.663626] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:25.663828] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-22T18:23:25.663886] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-22T18:23:25.663997] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-22T18:23:25.664038] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-22T18:23:25.664120] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-22T18:23:25.664176] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-22T18:23:25.724695] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-22T18:23:26.023006] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:26.517594] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-22T18:23:27.036276] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T18:23:27.317760] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-22T18:23:27.526929] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T18:23:28.090882] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T18:23:28.117610] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-22T18:23:28.797691] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T18:23:28.917740] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-22T18:23:29.635108] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T18:23:29.717711] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-22T18:23:30.517727] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-22T18:23:31.241117] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T18:23:31.283137] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T18:23:31.317620] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-22T18:23:32.117713] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-22T18:23:32.607413] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-22T18:23:32.917679] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-22T18:23:33.055851] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T18:23:33.274242] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-22T18:23:33.717717] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-22T18:23:34.364081] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-22T18:23:34.517703] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-22T18:23:35.317710] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-22T18:23:35.753837] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T18:23:36.117677] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-22T18:23:36.389045] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:23:36.684123] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T18:23:36.917688] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-22T18:23:37.587099] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-22T18:23:37.717734] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-22T18:23:38.517729] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-22T18:23:39.317742] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-22T18:23:39.716792] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-22T18:23:39.859686] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T18:23:40.056360] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T18:23:40.117620] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-22T18:23:40.917738] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-22T18:23:41.422434] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-22T18:23:41.423263] [INFO ] [REMOTE ] DTF: Full fetch complete (1746 records). [2025-10-22T18:23:41.423333] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-22T18:23:41.613607] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-22T18:23:41.613839] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:23:41.613910] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:23:41.613990] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-22T18:23:41.614097] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-22T18:23:41.614167] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-22T18:23:41.614231] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-22T18:23:41.614306] [INFO ] [MAIN ] Update Progress: 659/2367 symbols completed. DTF took 23.0s. Estimated remaining: 3h 36m 43s. Rate: 7.9 symbols/min [2025-10-22T18:23:41.723947] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-22T18:23:41.799526] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:41.799928] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-22T18:23:41.800001] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-22T18:23:41.800118] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-22T18:23:41.800160] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-22T18:23:41.800204] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-22T18:23:41.800282] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-22T18:23:42.192620] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T18:23:42.196684] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:42.204753] [INFO ] [REMOTE ] DTE: Full fetch complete (68912 records). [2025-10-22T18:23:42.204909] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-22T18:23:42.518544] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-22T18:23:42.536548] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T18:23:42.620247] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-22T18:23:42.620327] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-22T18:23:42.621168] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-22T18:23:42.621230] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-22T18:23:42.622454] [DEBUG] [LOCAL ] DTE: Trimmed 68912 records to 47121 (keeping 200 days of data) [2025-10-22T18:23:42.907842] [DEBUG] [LOCAL ] DTE: Primary data saved (47121 records). [2025-10-22T18:23:42.907966] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-22T18:23:42.908042] [INFO ] [MAIN ] Update Progress: 660/2367 symbols completed. DTE took 33.5s. Estimated remaining: 3h 36m 19s. Rate: 7.9 symbols/min [2025-10-22T18:23:43.076185] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:43.118717] [DEBUG] [LOCAL ] DTM: Loaded 43736 existing records from primary storage. [2025-10-22T18:23:43.119085] [INFO ] [MAIN ] DTM: Loaded 43736 existing records. [2025-10-22T18:23:43.289557] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:23:43.289820] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-22T18:23:43.289891] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-22T18:23:43.290130] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-22T18:23:43.290320] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-22T18:23:43.322873] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-22T18:23:43.601270] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:23:43.635985] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-22T18:23:43.637717] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:23:43.640793] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:43.640915] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-22T18:23:43.641061] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:23:43.641403] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-22T18:23:43.641490] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-22T18:23:43.641530] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-22T18:23:43.641570] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-22T18:23:43.641621] [INFO ] [MAIN ] Update Progress: 661/2367 symbols completed. DTK took 2.0s. Estimated remaining: 3h 35m 54s. Rate: 7.9 symbols/min [2025-10-22T18:23:43.828431] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:43.828724] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-22T18:23:43.828781] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-22T18:23:43.828907] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-22T18:23:43.828955] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-22T18:23:43.829002] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-22T18:23:43.829037] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-22T18:23:44.118318] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-22T18:23:44.241392] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:44.274939] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T18:23:44.873218] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T18:23:44.917713] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-22T18:23:45.549959] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T18:23:45.717755] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-22T18:23:46.507712] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T18:23:46.517615] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-22T18:23:47.085759] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T18:23:47.317739] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-22T18:23:48.117766] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-22T18:23:48.917713] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-22T18:23:48.978095] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T18:23:49.646039] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T18:23:49.647747] [INFO ] [REMOTE ] DTG: Full fetch complete (8574 records). [2025-10-22T18:23:49.647822] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-22T18:23:49.727921] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-22T18:23:50.031822] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-22T18:23:50.031992] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-22T18:23:50.032429] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-22T18:23:50.050760] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-22T18:23:50.067605] [DEBUG] [LOCAL ] DTG: Trimmed 8574 records to 5687 (keeping 200 days of data) [2025-10-22T18:23:50.070882] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T18:23:50.122627] [DEBUG] [LOCAL ] DTG: Primary data saved (5687 records). [2025-10-22T18:23:50.122812] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-22T18:23:50.122890] [INFO ] [MAIN ] Update Progress: 662/2367 symbols completed. DTG took 24.6s. Estimated remaining: 3h 35m 43s. Rate: 7.9 symbols/min [2025-10-22T18:23:50.301637] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:50.367618] [DEBUG] [LOCAL ] DUK: Loaded 53437 existing records from primary storage. [2025-10-22T18:23:50.368009] [INFO ] [MAIN ] DUK: Loaded 53437 existing records. [2025-10-22T18:23:50.454917] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T18:23:50.522820] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-22T18:23:50.562954] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:23:50.563230] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-22T18:23:50.563288] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-22T18:23:50.563740] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-22T18:23:50.563796] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-22T18:23:50.909388] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:51.317728] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-22T18:23:51.989930] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-22T18:23:52.117793] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-22T18:23:52.709921] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T18:23:52.917726] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-22T18:23:53.511315] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T18:23:53.717671] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-22T18:23:53.903895] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T18:23:54.517706] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-22T18:23:55.317685] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-22T18:23:55.386993] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T18:23:56.117730] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-22T18:23:56.261417] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T18:23:56.634462] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-22T18:23:56.917673] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-22T18:23:56.994084] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:23:57.585217] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-22T18:23:57.717731] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-22T18:23:58.517693] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-22T18:23:59.317744] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-22T18:23:59.540238] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T18:23:59.951168] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T18:24:00.117688] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-22T18:24:00.284083] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:24:00.917696] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-22T18:24:01.722740] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-22T18:24:01.740938] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T18:24:01.750080] [INFO ] [REMOTE ] DT: Full fetch complete (76914 records). [2025-10-22T18:24:01.750207] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-22T18:24:02.138569] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-22T18:24:02.138673] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-22T18:24:02.139540] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-22T18:24:02.139582] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-22T18:24:02.140986] [DEBUG] [LOCAL ] DT: Trimmed 76914 records to 52954 (keeping 200 days of data) [2025-10-22T18:24:02.450738] [DEBUG] [LOCAL ] DT: Primary data saved (52954 records). [2025-10-22T18:24:02.450878] [INFO ] [MAIN ] DT: Full history saved. [2025-10-22T18:24:02.450983] [INFO ] [MAIN ] Update Progress: 663/2367 symbols completed. DT took 56.9s. Estimated remaining: 3h 35m 48s. Rate: 7.9 symbols/min [2025-10-22T18:24:02.525216] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-22T18:24:02.621516] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:02.629133] [DEBUG] [LOCAL ] DUKB: Loaded 6174 existing records from primary storage. [2025-10-22T18:24:02.629296] [INFO ] [MAIN ] DUKB: Loaded 6174 existing records. [2025-10-22T18:24:02.805812] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:24:02.806146] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-22T18:24:02.806275] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-22T18:24:02.806464] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-22T18:24:02.806579] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-22T18:24:03.191234] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:03.193140] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-22T18:24:03.208844] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T18:24:03.317620] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-22T18:24:03.550417] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T18:24:04.117725] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-22T18:24:04.804174] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:24:04.917735] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-22T18:24:05.531989] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-22T18:24:05.533361] [INFO ] [REMOTE ] DTW: Full fetch complete (6952 records). [2025-10-22T18:24:05.533465] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-22T18:24:05.728790] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-22T18:24:05.951070] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-22T18:24:05.951171] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-22T18:24:05.951370] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-22T18:24:05.951409] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-22T18:24:05.951854] [DEBUG] [LOCAL ] DTW: Trimmed 6952 records to 4713 (keeping 200 days of data) [2025-10-22T18:24:05.981312] [DEBUG] [LOCAL ] DTW: Primary data saved (4713 records). [2025-10-22T18:24:05.981446] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-22T18:24:05.981520] [INFO ] [MAIN ] Update Progress: 664/2367 symbols completed. DTW took 22.3s. Estimated remaining: 3h 35m 30s. Rate: 7.9 symbols/min [2025-10-22T18:24:06.150310] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-22T18:24:06.192904] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:06.242883] [DEBUG] [LOCAL ] DV: Loaded 51247 existing records from primary storage. [2025-10-22T18:24:06.243211] [INFO ] [MAIN ] DV: Loaded 51247 existing records. [2025-10-22T18:24:06.417758] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:24:06.418003] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-22T18:24:06.418052] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-22T18:24:06.418233] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-22T18:24:06.418271] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-22T18:24:06.520851] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-22T18:24:06.800711] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T18:24:06.804717] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:07.317686] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-22T18:24:08.117713] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-22T18:24:08.566071] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-22T18:24:08.917719] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-22T18:24:08.966398] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:24:09.527998] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T18:24:09.608699] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T18:24:09.717694] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-22T18:24:10.517759] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-22T18:24:11.133548] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T18:24:11.317712] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-22T18:24:11.850149] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-22T18:24:12.117742] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-22T18:24:12.917680] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-22T18:24:13.048280] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T18:24:13.315543] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T18:24:13.717716] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-22T18:24:14.517695] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-22T18:24:14.931279] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T18:24:15.317728] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-22T18:24:15.372600] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T18:24:16.117735] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-22T18:24:16.317023] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T18:24:16.917711] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-22T18:24:17.228390] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-22T18:24:17.325501] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T18:24:17.717687] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-22T18:24:18.440623] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T18:24:18.517702] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-22T18:24:19.089631] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T18:24:19.317728] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-22T18:24:20.117718] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-22T18:24:20.461621] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T18:24:20.470092] [INFO ] [REMOTE ] DUK: Full fetch complete (77182 records). [2025-10-22T18:24:20.470245] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-22T18:24:20.471116] [FATAL] [VALIDATOR ] DUK: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:24:20.471214] [FATAL] [MAIN ] DUK: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:24:20.471262] [WARN ] [MAIN ] DUK: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:24:20.471341] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-22T18:24:20.471421] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-22T18:24:20.471471] [INFO ] [LOCAL ] DUK: Starting deletion of derivative data. [2025-10-22T18:24:20.471710] [DEBUG] [LOCAL ] DUK: Deleted derivative data file. [2025-10-22T18:24:20.472422] [INFO ] [MAIN ] Update Progress: 665/2367 symbols completed. DUK took 30.3s. Estimated remaining: 3h 35m 40s. Rate: 7.9 symbols/min [2025-10-22T18:24:20.644488] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:20.687063] [DEBUG] [LOCAL ] DVA: Loaded 40739 existing records from primary storage. [2025-10-22T18:24:20.687338] [INFO ] [MAIN ] DVA: Loaded 40739 existing records. [2025-10-22T18:24:20.868897] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:24:20.869119] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-22T18:24:20.869276] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-22T18:24:20.869803] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-22T18:24:20.869861] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-22T18:24:20.928763] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-22T18:24:21.160677] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:24:21.280845] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:21.616128] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T18:24:21.717691] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-22T18:24:21.886204] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:24:21.894017] [INFO ] [REMOTE ] DTM: Full fetch complete (65140 records). [2025-10-22T18:24:21.894195] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-22T18:24:22.290528] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-22T18:24:22.296711] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-22T18:24:22.296935] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T18:24:22.300401] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-22T18:24:22.300469] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-22T18:24:22.301559] [DEBUG] [LOCAL ] DTM: Trimmed 65140 records to 43686 (keeping 200 days of data) [2025-10-22T18:24:22.520784] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-22T18:24:22.566752] [DEBUG] [LOCAL ] DTM: Primary data saved (43686 records). [2025-10-22T18:24:22.566852] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-22T18:24:22.566926] [INFO ] [MAIN ] Update Progress: 666/2367 symbols completed. DTM took 39.7s. Estimated remaining: 3h 35m 18s. Rate: 7.9 symbols/min [2025-10-22T18:24:22.732595] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:22.732787] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-22T18:24:22.732829] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-22T18:24:22.732934] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-22T18:24:22.732975] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-22T18:24:22.733016] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-22T18:24:22.733048] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-22T18:24:23.081587] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:23.317690] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-22T18:24:23.922548] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T18:24:23.996867] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T18:24:24.117669] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-22T18:24:24.917690] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-22T18:24:25.508558] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-22T18:24:25.717695] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-22T18:24:25.830452] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T18:24:26.517725] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-22T18:24:27.105033] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T18:24:27.317693] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-22T18:24:27.773518] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T18:24:28.117711] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-22T18:24:28.864390] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:24:28.917693] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-22T18:24:29.717680] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-22T18:24:30.041674] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T18:24:30.388136] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-22T18:24:30.389786] [INFO ] [REMOTE ] DUKB: Full fetch complete (8985 records). [2025-10-22T18:24:30.390017] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-22T18:24:30.519843] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-22T18:24:30.765144] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-22T18:24:30.773401] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-22T18:24:30.787915] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-22T18:24:30.788078] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-22T18:24:30.789888] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T18:24:30.799025] [DEBUG] [LOCAL ] DUKB: Trimmed 8985 records to 6134 (keeping 200 days of data) [2025-10-22T18:24:30.837158] [DEBUG] [LOCAL ] DUKB: Primary data saved (6134 records). [2025-10-22T18:24:30.837284] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-22T18:24:30.837361] [INFO ] [MAIN ] Update Progress: 667/2367 symbols completed. DUKB took 28.4s. Estimated remaining: 3h 35m 12s. Rate: 7.9 symbols/min [2025-10-22T18:24:31.001398] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:31.001554] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-22T18:24:31.001591] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-22T18:24:31.001749] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-22T18:24:31.001821] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-22T18:24:31.001876] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-22T18:24:31.001910] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-22T18:24:31.322816] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-22T18:24:31.354405] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:32.117728] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-22T18:24:32.413130] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T18:24:32.917738] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-22T18:24:33.070731] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:24:33.717717] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-22T18:24:33.925005] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:24:34.517716] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-22T18:24:34.914388] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T18:24:35.322747] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-22T18:24:35.343094] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T18:24:36.117690] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-22T18:24:36.220715] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T18:24:36.917724] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-22T18:24:36.951065] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:24:37.717738] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-22T18:24:38.282084] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-22T18:24:38.321358] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:24:38.517718] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-22T18:24:39.317685] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-22T18:24:39.646276] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T18:24:39.724895] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T18:24:40.117758] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-22T18:24:40.917707] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-22T18:24:41.279186] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T18:24:41.717727] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-22T18:24:42.159582] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T18:24:42.502484] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T18:24:42.517610] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-22T18:24:43.317714] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-22T18:24:43.934924] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T18:24:44.039274] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T18:24:44.117682] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-22T18:24:44.917697] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-22T18:24:45.249138] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:24:45.260764] [INFO ] [REMOTE ] DV: Full fetch complete (73883 records). [2025-10-22T18:24:45.260918] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-22T18:24:45.655473] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-22T18:24:45.655717] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-22T18:24:45.656670] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-22T18:24:45.656824] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-22T18:24:45.658331] [DEBUG] [LOCAL ] DV: Trimmed 73883 records to 51241 (keeping 200 days of data) [2025-10-22T18:24:45.720382] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-22T18:24:45.774900] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T18:24:45.785807] [INFO ] [REMOTE ] DVA: Full fetch complete (59594 records). [2025-10-22T18:24:45.787990] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-22T18:24:46.316525] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-22T18:24:46.316637] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-22T18:24:46.317511] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-22T18:24:46.321543] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-22T18:24:46.331723] [DEBUG] [LOCAL ] DVA: Trimmed 59594 records to 40649 (keeping 200 days of data) [2025-10-22T18:24:46.494619] [DEBUG] [LOCAL ] DV: Primary data saved (51241 records). [2025-10-22T18:24:46.496687] [INFO ] [MAIN ] DV: Full history saved. [2025-10-22T18:24:46.496840] [INFO ] [MAIN ] Update Progress: 668/2367 symbols completed. DV took 40.5s. Estimated remaining: 3h 35m 25s. Rate: 7.9 symbols/min [2025-10-22T18:24:46.748888] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:46.824856] [DEBUG] [LOCAL ] DVA: Primary data saved (40649 records). [2025-10-22T18:24:46.825168] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-22T18:24:46.825890] [INFO ] [MAIN ] Update Progress: 669/2367 symbols completed. DVA took 26.4s. Estimated remaining: 3h 34m 59s. Rate: 7.9 symbols/min [2025-10-22T18:24:47.007872] [DEBUG] [LOCAL ] DXC: Loaded 49925 existing records from primary storage. [2025-10-22T18:24:47.034511] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:47.034930] [DEBUG] [LOCAL ] DXYZ: No existing data file found in primary storage. [2025-10-22T18:24:47.035213] [INFO ] [MAIN ] DXC: Loaded 49925 existing records. [2025-10-22T18:24:47.035105] [WARN ] [MAIN ] DXYZ: No existing data found, performing full refresh instead. [2025-10-22T18:24:47.090951] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-22T18:24:47.111754] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-22T18:24:47.138737] [DEBUG] [LOCAL ] DXYZ: No primary data file found to delete. [2025-10-22T18:24:47.139060] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-22T18:24:47.343791] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-22T18:24:47.362833] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:24:47.394974] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-22T18:24:47.479719] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-22T18:24:47.480240] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-22T18:24:47.534458] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-22T18:24:47.534621] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-22T18:24:47.864517] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:47.897343] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-22T18:24:48.046335] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:48.081634] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-22T18:24:48.117720] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-22T18:24:48.917774] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-22T18:24:49.461292] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T18:24:49.567598] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T18:24:49.717720] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-22T18:24:50.375530] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T18:24:50.517667] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-22T18:24:50.580007] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-22T18:24:51.317723] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-22T18:24:51.351664] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:24:52.122728] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-22T18:24:52.134767] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:24:52.917731] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-22T18:24:52.988210] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T18:24:53.717711] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-22T18:24:54.417372] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T18:24:54.427327] [INFO ] [REMOTE ] DVN: Full fetch complete (77489 records). [2025-10-22T18:24:54.427563] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-22T18:24:54.429216] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:24:54.429382] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:24:54.429675] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:24:54.429756] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-22T18:24:54.429837] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-22T18:24:54.429879] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-22T18:24:54.429921] [DEBUG] [LOCAL ] DVN: No derivative data file found to delete. [2025-10-22T18:24:54.429999] [INFO ] [MAIN ] Update Progress: 670/2367 symbols completed. DVN took 31.9s. Estimated remaining: 3h 34m 52s. Rate: 7.9 symbols/min [2025-10-22T18:24:54.524817] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-22T18:24:54.628716] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:54.668238] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:24:54.701729] [DEBUG] [LOCAL ] DY: Loaded 28120 existing records from primary storage. [2025-10-22T18:24:54.702013] [INFO ] [MAIN ] DY: Loaded 28120 existing records. [2025-10-22T18:24:54.888058] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:24:54.888321] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-22T18:24:54.888380] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-22T18:24:54.888575] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-22T18:24:54.888632] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-22T18:24:55.263943] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:55.317640] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-22T18:24:55.602283] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T18:24:56.117743] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-22T18:24:56.502274] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T18:24:56.531970] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:24:56.917757] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-22T18:24:57.718632] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T18:24:57.717695] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-22T18:24:57.834248] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T18:24:58.517704] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-22T18:24:59.317722] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-22T18:24:59.747577] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T18:25:00.117783] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-22T18:25:00.748869] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-22T18:25:00.917721] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-22T18:25:01.217897] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T18:25:01.717724] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-22T18:25:02.517701] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-22T18:25:02.747509] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-22T18:25:03.317769] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-22T18:25:03.686785] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-10-22T18:25:03.726386] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T18:25:04.117705] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-22T18:25:04.378197] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T18:25:04.917765] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-22T18:25:05.717744] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-22T18:25:05.826436] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-22T18:25:06.466220] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:25:06.528195] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-22T18:25:06.529783] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-22T18:25:06.539125] [INFO ] [REMOTE ] DX: Full fetch complete (75506 records). [2025-10-22T18:25:06.539259] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-22T18:25:06.540061] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:25:06.540153] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:25:06.540211] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:25:06.540323] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-22T18:25:06.540565] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-22T18:25:06.540707] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-22T18:25:06.540788] [DEBUG] [LOCAL ] DX: No derivative data file found to delete. [2025-10-22T18:25:06.540870] [INFO ] [MAIN ] Update Progress: 671/2367 symbols completed. DX took 35.7s. Estimated remaining: 3h 34m 55s. Rate: 7.9 symbols/min [2025-10-22T18:25:06.708323] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:06.738716] [DEBUG] [LOCAL ] E: Loaded 33282 existing records from primary storage. [2025-10-22T18:25:06.739029] [INFO ] [MAIN ] E: Loaded 33282 existing records. [2025-10-22T18:25:06.913300] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:25:06.913575] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-22T18:25:06.913673] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-22T18:25:06.914014] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-22T18:25:06.914072] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-22T18:25:07.262138] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:07.317678] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-22T18:25:07.723351] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:25:08.117732] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-22T18:25:08.504838] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-22T18:25:08.729977] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:25:08.917700] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-22T18:25:09.238097] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T18:25:09.717728] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-22T18:25:10.517666] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-22T18:25:10.712687] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T18:25:11.063425] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T18:25:11.317732] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-22T18:25:12.117734] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-22T18:25:12.460877] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T18:25:12.917681] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-22T18:25:13.124202] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T18:25:13.361583] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T18:25:13.717694] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-22T18:25:14.162523] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T18:25:14.517710] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-22T18:25:14.958551] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T18:25:15.317687] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-22T18:25:16.102095] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:25:16.117608] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-22T18:25:16.631775] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T18:25:16.917712] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-22T18:25:17.567992] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T18:25:17.717673] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-22T18:25:18.517701] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-22T18:25:18.817696] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T18:25:18.826879] [INFO ] [REMOTE ] DXC: Full fetch complete (70315 records). [2025-10-22T18:25:18.827004] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-22T18:25:19.087065] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T18:25:19.243868] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-22T18:25:19.243945] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-22T18:25:19.244747] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-22T18:25:19.244811] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-22T18:25:19.246110] [DEBUG] [LOCAL ] DXC: Trimmed 70315 records to 49919 (keeping 200 days of data) [2025-10-22T18:25:19.327735] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-22T18:25:19.535115] [DEBUG] [LOCAL ] DXC: Primary data saved (49919 records). [2025-10-22T18:25:19.535257] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-22T18:25:19.535340] [INFO ] [MAIN ] Update Progress: 672/2367 symbols completed. DXC took 33.0s. Estimated remaining: 3h 35m 1s. Rate: 7.9 symbols/min [2025-10-22T18:25:19.729396] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:19.729632] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-10-22T18:25:19.729747] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-10-22T18:25:19.729912] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-22T18:25:19.729965] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-22T18:25:19.730010] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-22T18:25:19.730042] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-22T18:25:20.092614] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:20.117678] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-22T18:25:20.240954] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T18:25:20.885737] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T18:25:20.917611] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-22T18:25:21.292413] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T18:25:21.717713] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-22T18:25:22.247291] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T18:25:22.517707] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-22T18:25:22.868540] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T18:25:22.872394] [INFO ] [REMOTE ] DY: Full fetch complete (43274 records). [2025-10-22T18:25:22.872495] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-22T18:25:23.241180] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-22T18:25:23.241257] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-22T18:25:23.241900] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-22T18:25:23.241963] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-22T18:25:23.242817] [DEBUG] [LOCAL ] DY: Trimmed 43274 records to 28046 (keeping 200 days of data) [2025-10-22T18:25:23.326104] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-22T18:25:23.407601] [DEBUG] [LOCAL ] DY: Primary data saved (28046 records). [2025-10-22T18:25:23.407787] [INFO ] [MAIN ] DY: Full history saved. [2025-10-22T18:25:23.407875] [INFO ] [MAIN ] Update Progress: 673/2367 symbols completed. DY took 29.0s. Estimated remaining: 3h 34m 44s. Rate: 7.9 symbols/min [2025-10-22T18:25:23.576170] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:23.576351] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-10-22T18:25:23.576390] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-10-22T18:25:23.576501] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-22T18:25:23.576543] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-22T18:25:23.576585] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-22T18:25:23.576619] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-22T18:25:23.932021] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:24.117720] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-22T18:25:24.386498] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T18:25:24.685275] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T18:25:24.709284] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-22T18:25:24.917731] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-22T18:25:25.717712] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-22T18:25:26.484223] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T18:25:26.517620] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-22T18:25:27.317685] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-22T18:25:27.507045] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:25:28.117730] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-22T18:25:28.158953] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T18:25:28.568561] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:25:28.917738] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-22T18:25:29.717710] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-22T18:25:30.390291] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-22T18:25:30.394369] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T18:25:30.401876] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56824 records). [2025-10-22T18:25:30.402372] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-22T18:25:30.526918] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-22T18:25:30.687462] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T18:25:30.862052] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-22T18:25:30.862134] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-22T18:25:30.863005] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-22T18:25:30.863088] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-22T18:25:30.864255] [DEBUG] [LOCAL ] DXYZ: Trimmed 56824 records to 37126 (keeping 200 days of data) [2025-10-22T18:25:31.100250] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37126 records). [2025-10-22T18:25:31.100400] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-22T18:25:31.100474] [INFO ] [MAIN ] Update Progress: 674/2367 symbols completed. DXYZ took 44.3s. Estimated remaining: 3h 34m 37s. Rate: 7.9 symbols/min [2025-10-22T18:25:31.289287] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:31.289486] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-10-22T18:25:31.289535] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-10-22T18:25:31.289706] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-22T18:25:31.289774] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-22T18:25:31.289832] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-22T18:25:31.289877] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-22T18:25:31.328894] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-22T18:25:31.701701] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:31.962738] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T18:25:31.967979] [INFO ] [REMOTE ] E: Full fetch complete (47425 records). [2025-10-22T18:25:31.968105] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-22T18:25:31.968714] [FATAL] [VALIDATOR ] E: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:25:31.968808] [FATAL] [MAIN ] E: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:25:31.968851] [WARN ] [MAIN ] E: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:25:31.968925] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-22T18:25:31.968991] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-10-22T18:25:31.969028] [INFO ] [LOCAL ] E: Starting deletion of derivative data. [2025-10-22T18:25:31.969175] [DEBUG] [LOCAL ] E: Deleted derivative data file. [2025-10-22T18:25:31.969263] [INFO ] [MAIN ] Update Progress: 675/2367 symbols completed. E took 25.4s. Estimated remaining: 3h 34m 13s. Rate: 7.9 symbols/min [2025-10-22T18:25:32.123729] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-22T18:25:32.155458] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:32.202591] [DEBUG] [LOCAL ] EAT: Loaded 49741 existing records from primary storage. [2025-10-22T18:25:32.202959] [INFO ] [MAIN ] EAT: Loaded 49741 existing records. [2025-10-22T18:25:32.379739] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:25:32.380003] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-22T18:25:32.380073] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-22T18:25:32.380266] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-22T18:25:32.380302] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-22T18:25:32.744173] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:32.759175] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T18:25:32.917730] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-22T18:25:33.136235] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-22T18:25:33.287298] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-22T18:25:33.717743] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-22T18:25:34.520688] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-22T18:25:35.105421] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-22T18:25:35.317727] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-22T18:25:35.526511] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T18:25:36.117725] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-22T18:25:36.917726] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-22T18:25:37.355023] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T18:25:37.633927] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T18:25:37.717673] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-22T18:25:38.337612] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T18:25:38.517709] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-22T18:25:39.180554] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T18:25:39.317728] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-22T18:25:39.943838] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:25:40.117715] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-22T18:25:40.917682] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-22T18:25:40.950789] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:25:41.463230] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-22T18:25:41.717738] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-22T18:25:42.517618] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-22T18:25:42.796675] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T18:25:43.053279] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T18:25:43.058279] [INFO ] [REMOTE ] EAF: Full fetch complete (61911 records). [2025-10-22T18:25:43.058380] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-22T18:25:43.059096] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:25:43.059186] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:25:43.059229] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:25:43.059287] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-22T18:25:43.059383] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-22T18:25:43.059435] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-10-22T18:25:43.059491] [DEBUG] [LOCAL ] EAF: No derivative data file found to delete. [2025-10-22T18:25:43.059565] [INFO ] [MAIN ] Update Progress: 676/2367 symbols completed. EAF took 23.5s. Estimated remaining: 3h 34m 14s. Rate: 7.9 symbols/min [2025-10-22T18:25:43.226155] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:43.238368] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T18:25:43.266715] [DEBUG] [LOCAL ] EB: Loaded 36257 existing records from primary storage. [2025-10-22T18:25:43.266979] [INFO ] [MAIN ] EB: Loaded 36257 existing records. [2025-10-22T18:25:43.326757] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-22T18:25:43.446455] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:25:43.446691] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-22T18:25:43.446766] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-22T18:25:43.446968] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-22T18:25:43.447023] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-22T18:25:43.795233] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:44.117772] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-22T18:25:44.702848] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-22T18:25:44.917717] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-22T18:25:45.030404] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T18:25:45.717686] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-22T18:25:46.504951] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T18:25:46.517611] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-22T18:25:47.289822] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T18:25:47.317729] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-22T18:25:47.573608] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T18:25:47.875137] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T18:25:48.117729] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-22T18:25:48.539320] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-22T18:25:48.917690] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-22T18:25:49.482923] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T18:25:49.484491] [INFO ] [REMOTE ] EAI: Full fetch complete (5818 records). [2025-10-22T18:25:49.484580] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-22T18:25:49.485066] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:25:49.485163] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:25:49.485213] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:25:49.485288] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-22T18:25:49.485364] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-22T18:25:49.485416] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-22T18:25:49.485469] [DEBUG] [LOCAL ] EAI: No derivative data file found to delete. [2025-10-22T18:25:49.485534] [INFO ] [MAIN ] Update Progress: 677/2367 symbols completed. EAI took 26.1s. Estimated remaining: 3h 34m 3s. Rate: 7.9 symbols/min [2025-10-22T18:25:49.717750] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-22T18:25:50.517727] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-22T18:25:51.053088] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:25:51.317712] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-22T18:25:52.117809] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-22T18:25:52.437467] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T18:25:52.493763] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T18:25:52.917732] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-22T18:25:53.690715] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T18:25:53.717670] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-22T18:25:54.517672] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-22T18:25:54.627202] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T18:25:55.308863] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T18:25:55.317897] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-22T18:25:55.743427] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T18:25:56.117733] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-22T18:25:56.677293] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T18:25:56.917695] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-22T18:25:57.580267] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T18:25:57.717717] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-22T18:25:57.819417] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T18:25:58.517698] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-22T18:25:59.317683] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-22T18:25:59.427334] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T18:25:59.549458] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T18:26:00.117731] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-22T18:26:00.493611] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T18:26:00.917735] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-22T18:26:01.717785] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-22T18:26:02.368740] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-22T18:26:02.517705] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-22T18:26:02.994427] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T18:26:03.317731] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-22T18:26:03.600316] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T18:26:03.604968] [INFO ] [REMOTE ] EARN: Full fetch complete (45014 records). [2025-10-22T18:26:03.605049] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-22T18:26:03.605635] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:26:03.605772] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:26:03.605815] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:26:03.605854] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-22T18:26:03.605911] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-22T18:26:03.605947] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-10-22T18:26:03.605985] [DEBUG] [LOCAL ] EARN: No derivative data file found to delete. [2025-10-22T18:26:03.606040] [INFO ] [MAIN ] Update Progress: 678/2367 symbols completed. EARN took 32.5s. Estimated remaining: 3h 34m 12s. Rate: 7.9 symbols/min [2025-10-22T18:26:05.031334] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-22T18:26:05.041461] [INFO ] [REMOTE ] EAT: Full fetch complete (72394 records). [2025-10-22T18:26:05.041599] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-22T18:26:05.292152] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T18:26:05.363243] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-22T18:26:05.479076] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-22T18:26:05.479160] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-22T18:26:05.480059] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-22T18:26:05.480129] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-22T18:26:05.481554] [DEBUG] [LOCAL ] EAT: Trimmed 72394 records to 49719 (keeping 200 days of data) [2025-10-22T18:26:05.776624] [DEBUG] [LOCAL ] EAT: Primary data saved (49719 records). [2025-10-22T18:26:05.776911] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-22T18:26:05.776990] [INFO ] [MAIN ] Update Progress: 679/2367 symbols completed. EAT took 33.8s. Estimated remaining: 3h 33m 51s. Rate: 7.9 symbols/min [2025-10-22T18:26:06.854694] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T18:26:06.862129] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-22T18:26:08.209640] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T18:26:08.214796] [INFO ] [REMOTE ] EB: Full fetch complete (54722 records). [2025-10-22T18:26:08.214887] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-22T18:26:08.215466] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:26:08.215548] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:26:08.215591] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:26:08.215628] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-22T18:26:08.215721] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-22T18:26:08.215765] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-10-22T18:26:08.215960] [DEBUG] [LOCAL ] EB: Deleted derivative data file. [2025-10-22T18:26:08.216048] [INFO ] [MAIN ] Update Progress: 680/2367 symbols completed. EB took 25.2s. Estimated remaining: 3h 33m 30s. Rate: 7.9 symbols/min [2025-10-22T18:26:08.770445] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:08.859247] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:08.892873] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:08.920912] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-10-22T18:26:08.920435] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:08.921048] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-10-22T18:26:08.921946] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-22T18:26:08.922067] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-22T18:26:08.922127] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-22T18:26:08.922279] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-22T18:26:09.089439] [DEBUG] [LOCAL ] EBF: Loaded 19191 existing records from primary storage. [2025-10-22T18:26:09.119578] [INFO ] [MAIN ] EBF: Loaded 19191 existing records. [2025-10-22T18:26:09.346024] [DEBUG] [LOCAL ] EC: Loaded 48909 existing records from primary storage. [2025-10-22T18:26:09.432459] [DEBUG] [LOCAL ] EBR: Loaded 43373 existing records from primary storage. [2025-10-22T18:26:09.508786] [INFO ] [MAIN ] EBR: Loaded 43373 existing records. [2025-10-22T18:26:09.394513] [INFO ] [MAIN ] EC: Loaded 48909 existing records. [2025-10-22T18:26:09.534767] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:09.559118] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-22T18:26:09.604667] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:26:09.649663] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-22T18:26:09.649820] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-22T18:26:09.706612] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-22T18:26:09.734939] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-22T18:26:09.933065] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:26:10.013156] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-22T18:26:10.013046] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:26:10.031179] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-22T18:26:10.031286] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-22T18:26:10.034420] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-22T18:26:10.040116] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-22T18:26:10.034880] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-22T18:26:10.055627] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-22T18:26:10.078388] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-22T18:26:10.781664] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:10.838150] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-22T18:26:11.005419] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:11.008011] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-22T18:26:11.033329] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:11.033741] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-22T18:26:11.418408] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:26:11.427145] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-22T18:26:12.019230] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:26:12.022864] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-22T18:26:12.584529] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T18:26:12.594090] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-22T18:26:12.677855] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T18:26:12.686748] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-22T18:26:12.821188] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:26:12.831145] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-22T18:26:12.870189] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T18:26:12.917711] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-22T18:26:14.020320] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:26:14.028324] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-22T18:26:14.082591] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T18:26:14.134509] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:26:14.172299] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:26:14.517690] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-22T18:26:15.115917] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T18:26:15.317683] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-22T18:26:16.117760] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-22T18:26:16.441795] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T18:26:16.917707] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-22T18:26:17.456013] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-22T18:26:17.717726] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-22T18:26:18.240711] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T18:26:18.517786] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-22T18:26:18.680013] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-22T18:26:19.297574] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T18:26:19.317685] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-22T18:26:20.108969] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T18:26:20.117614] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-22T18:26:20.749490] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T18:26:20.917675] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-22T18:26:21.173684] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T18:26:21.717723] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-22T18:26:22.526801] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-22T18:26:22.529862] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T18:26:22.846661] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T18:26:23.317843] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-22T18:26:23.745155] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T18:26:24.117770] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-22T18:26:24.917692] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-22T18:26:25.131796] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T18:26:25.196924] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T18:26:25.717699] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-22T18:26:26.517721] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-22T18:26:26.874970] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T18:26:27.245701] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:26:27.317739] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-22T18:26:28.097210] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T18:26:28.117620] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-22T18:26:28.703755] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T18:26:28.917717] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-22T18:26:29.717725] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-22T18:26:29.926987] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T18:26:29.936091] [INFO ] [REMOTE ] EBS: Full fetch complete (67336 records). [2025-10-22T18:26:29.936259] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-22T18:26:30.331991] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-22T18:26:30.332096] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-22T18:26:30.332925] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-22T18:26:30.332992] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-22T18:26:30.334476] [DEBUG] [LOCAL ] EBS: Trimmed 67336 records to 46589 (keeping 200 days of data) [2025-10-22T18:26:30.522400] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-22T18:26:30.591911] [DEBUG] [LOCAL ] EBS: Primary data saved (46589 records). [2025-10-22T18:26:30.592078] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-22T18:26:30.592155] [INFO ] [MAIN ] Update Progress: 681/2367 symbols completed. EBS took 22.4s. Estimated remaining: 3h 33m 59s. Rate: 7.9 symbols/min [2025-10-22T18:26:30.766951] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:30.799385] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T18:26:30.841728] [DEBUG] [LOCAL ] ECAT: Loaded 29262 existing records from primary storage. [2025-10-22T18:26:30.842041] [INFO ] [MAIN ] ECAT: Loaded 29262 existing records. [2025-10-22T18:26:31.030949] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:26:31.031199] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-22T18:26:31.031397] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-22T18:26:31.031740] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-22T18:26:31.031809] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-22T18:26:31.182254] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T18:26:31.322326] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-22T18:26:31.438623] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:31.477509] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T18:26:32.117680] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-22T18:26:32.917733] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-22T18:26:33.106680] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T18:26:33.385172] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T18:26:33.717697] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-22T18:26:33.851986] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T18:26:33.856178] [INFO ] [REMOTE ] EBF: Full fetch complete (28312 records). [2025-10-22T18:26:33.856276] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-22T18:26:34.212188] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-22T18:26:34.212263] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-22T18:26:34.212756] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-22T18:26:34.212817] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-22T18:26:34.213443] [DEBUG] [LOCAL ] EBF: Trimmed 28312 records to 19250 (keeping 200 days of data) [2025-10-22T18:26:34.326965] [DEBUG] [LOCAL ] EBF: Primary data saved (19250 records). [2025-10-22T18:26:34.327075] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-22T18:26:34.327148] [INFO ] [MAIN ] Update Progress: 682/2367 symbols completed. EBF took 26.1s. Estimated remaining: 3h 33m 42s. Rate: 7.9 symbols/min [2025-10-22T18:26:34.491042] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:34.526620] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-22T18:26:34.529872] [DEBUG] [LOCAL ] ECC: Loaded 43432 existing records from primary storage. [2025-10-22T18:26:34.530189] [INFO ] [MAIN ] ECC: Loaded 43432 existing records. [2025-10-22T18:26:34.703111] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:26:34.703286] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-22T18:26:34.703334] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-22T18:26:34.703526] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-22T18:26:34.703563] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-22T18:26:35.045956] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:35.317775] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-22T18:26:35.509587] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T18:26:35.520001] [INFO ] [REMOTE ] EBR: Full fetch complete (62493 records). [2025-10-22T18:26:35.520160] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-22T18:26:35.901783] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-22T18:26:35.901893] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-22T18:26:35.902754] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-22T18:26:35.902818] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-22T18:26:35.904117] [DEBUG] [LOCAL ] EBR: Trimmed 62493 records to 43347 (keeping 200 days of data) [2025-10-22T18:26:36.119838] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-22T18:26:36.152870] [DEBUG] [LOCAL ] EBR: Primary data saved (43347 records). [2025-10-22T18:26:36.153066] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-22T18:26:36.153812] [INFO ] [MAIN ] Update Progress: 683/2367 symbols completed. EBR took 27.9s. Estimated remaining: 3h 33m 20s. Rate: 7.9 symbols/min [2025-10-22T18:26:36.347597] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:36.347917] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-22T18:26:36.348086] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-22T18:26:36.348272] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-22T18:26:36.348342] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-22T18:26:36.348457] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-22T18:26:36.348566] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-22T18:26:36.486414] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T18:26:36.734471] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T18:26:36.777073] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:36.917709] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-22T18:26:37.447683] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T18:26:37.717752] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-22T18:26:38.166310] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-22T18:26:38.369278] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T18:26:38.517704] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-22T18:26:39.317700] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-22T18:26:40.117764] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-22T18:26:40.172234] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T18:26:40.304524] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T18:26:40.485233] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-22T18:26:40.917812] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-22T18:26:41.287129] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-22T18:26:41.717723] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-22T18:26:42.069604] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-22T18:26:42.517726] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-22T18:26:43.317730] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-22T18:26:44.117710] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-22T18:26:44.351239] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T18:26:44.917710] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-22T18:26:44.960457] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:26:45.197589] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T18:26:45.248276] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-22T18:26:45.717726] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-22T18:26:46.517615] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-22T18:26:46.992619] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T18:26:47.317729] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-22T18:26:47.597982] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-22T18:26:48.117706] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-22T18:26:48.310216] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T18:26:48.318099] [INFO ] [REMOTE ] EC: Full fetch complete (71535 records). [2025-10-22T18:26:48.318220] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-22T18:26:48.319017] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:26:48.319105] [FATAL] [MAIN ] EC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:26:48.319146] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:26:48.319184] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-22T18:26:48.319240] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-22T18:26:48.319277] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-10-22T18:26:48.319395] [DEBUG] [LOCAL ] EC: Deleted derivative data file. [2025-10-22T18:26:48.319465] [INFO ] [MAIN ] Update Progress: 684/2367 symbols completed. EC took 40.1s. Estimated remaining: 3h 33m 24s. Rate: 7.9 symbols/min [2025-10-22T18:26:48.485026] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:48.485202] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-22T18:26:48.485238] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-22T18:26:48.485345] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-22T18:26:48.485386] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-22T18:26:48.485445] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-22T18:26:48.485477] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-22T18:26:48.835027] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:48.917717] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-22T18:26:49.183332] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T18:26:49.431793] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-22T18:26:49.717749] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-22T18:26:50.517720] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-22T18:26:50.915218] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T18:26:50.999484] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-22T18:26:51.317684] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-22T18:26:51.932665] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:26:52.117712] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-22T18:26:52.917711] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-22T18:26:53.631416] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T18:26:53.717689] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-22T18:26:54.025250] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T18:26:54.181531] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T18:26:54.517727] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-22T18:26:54.935084] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-22T18:26:55.317709] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-22T18:26:55.761490] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T18:26:56.117746] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-22T18:26:56.441679] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-22T18:26:56.917703] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-22T18:26:57.717728] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-22T18:26:58.123934] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-22T18:26:58.294273] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T18:26:58.517691] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-22T18:26:59.317697] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-22T18:26:59.673279] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T18:26:59.881973] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T18:27:00.117698] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-22T18:27:00.917689] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-22T18:27:01.051767] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T18:27:01.052506] [INFO ] [REMOTE ] ECCC: Full fetch complete (1309 records). [2025-10-22T18:27:01.052573] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-22T18:27:01.231284] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-22T18:27:01.231492] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:27:01.231542] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:27:01.231603] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-22T18:27:01.231687] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-22T18:27:01.231741] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-22T18:27:01.231784] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-22T18:27:01.231838] [INFO ] [MAIN ] Update Progress: 685/2367 symbols completed. ECCC took 25.1s. Estimated remaining: 3h 33m 29s. Rate: 7.9 symbols/min [2025-10-22T18:27:01.405760] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:01.405985] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-22T18:27:01.406032] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-22T18:27:01.406157] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-22T18:27:01.406209] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-22T18:27:01.406254] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-22T18:27:01.406287] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-22T18:27:01.722936] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-22T18:27:01.781512] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:02.517705] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-22T18:27:03.075173] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T18:27:03.317748] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-22T18:27:03.802088] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T18:27:04.117676] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-22T18:27:04.185710] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-22T18:27:04.331267] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T18:27:04.721509] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T18:27:04.722325] [INFO ] [REMOTE ] ECCU: Full fetch complete (4240 records). [2025-10-22T18:27:04.722393] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-22T18:27:04.922849] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-22T18:27:05.090040] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-22T18:27:05.090115] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-22T18:27:05.090244] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-22T18:27:05.090282] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-22T18:27:05.090614] [DEBUG] [LOCAL ] ECCU: Trimmed 4240 records to 2152 (keeping 200 days of data) [2025-10-22T18:27:05.103854] [DEBUG] [LOCAL ] ECCU: Primary data saved (2152 records). [2025-10-22T18:27:05.103929] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-22T18:27:05.103994] [INFO ] [MAIN ] Update Progress: 686/2367 symbols completed. ECCU took 16.8s. Estimated remaining: 3h 33m 12s. Rate: 7.9 symbols/min [2025-10-22T18:27:05.268621] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:05.268807] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-22T18:27:05.268849] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-22T18:27:05.268958] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-22T18:27:05.269000] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-22T18:27:05.269041] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-22T18:27:05.269092] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-22T18:27:05.341952] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-22T18:27:05.626347] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:05.717729] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-22T18:27:06.221205] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T18:27:06.517704] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-22T18:27:07.317713] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-22T18:27:07.606622] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-22T18:27:07.921089] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T18:27:07.925917] [INFO ] [REMOTE ] ECAT: Full fetch complete (42914 records). [2025-10-22T18:27:07.926035] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-22T18:27:08.122791] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-22T18:27:08.302439] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-22T18:27:08.302519] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-22T18:27:08.303187] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-22T18:27:08.303249] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-22T18:27:08.304324] [DEBUG] [LOCAL ] ECAT: Trimmed 42914 records to 29135 (keeping 200 days of data) [2025-10-22T18:27:08.482300] [DEBUG] [LOCAL ] ECAT: Primary data saved (29135 records). [2025-10-22T18:27:08.482440] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-22T18:27:08.482523] [INFO ] [MAIN ] Update Progress: 687/2367 symbols completed. ECAT took 37.9s. Estimated remaining: 3h 32m 54s. Rate: 7.9 symbols/min [2025-10-22T18:27:08.611977] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-22T18:27:08.720459] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:08.759177] [DEBUG] [LOCAL ] ECG: Loaded 32804 existing records from primary storage. [2025-10-22T18:27:08.759445] [INFO ] [MAIN ] ECG: Loaded 32804 existing records. [2025-10-22T18:27:08.927244] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-22T18:27:08.932141] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:08.933352] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-22T18:27:08.933455] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-22T18:27:08.933727] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-22T18:27:08.933794] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-22T18:27:09.290405] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:09.485001] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T18:27:09.717705] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-22T18:27:10.047022] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-22T18:27:10.517727] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-22T18:27:10.864211] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T18:27:11.317690] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-22T18:27:11.655020] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-22T18:27:12.117719] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-22T18:27:12.917703] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-22T18:27:13.448526] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-22T18:27:13.717708] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-22T18:27:13.919074] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T18:27:14.050768] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-22T18:27:14.517719] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-22T18:27:14.953635] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-22T18:27:14.954400] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-22T18:27:14.954466] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-22T18:27:15.142335] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-22T18:27:15.142544] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:27:15.142612] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:27:15.142706] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-22T18:27:15.142770] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-22T18:27:15.142807] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-22T18:27:15.142846] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-22T18:27:15.142900] [INFO ] [MAIN ] Update Progress: 688/2367 symbols completed. ECCW took 13.9s. Estimated remaining: 3h 32m 45s. Rate: 7.9 symbols/min [2025-10-22T18:27:15.308816] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:15.317711] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-22T18:27:15.353816] [DEBUG] [LOCAL ] ECL: Loaded 46734 existing records from primary storage. [2025-10-22T18:27:15.354135] [INFO ] [MAIN ] ECL: Loaded 46734 existing records. [2025-10-22T18:27:15.537411] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:15.537661] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-22T18:27:15.537725] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-22T18:27:15.537963] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-22T18:27:15.538021] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-22T18:27:15.809774] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T18:27:15.910696] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:16.117674] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-22T18:27:16.917698] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-22T18:27:17.425687] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T18:27:17.717704] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-22T18:27:17.916315] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T18:27:18.517739] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-22T18:27:19.317732] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-22T18:27:19.485670] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:27:19.672517] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-22T18:27:20.094842] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T18:27:20.117614] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-22T18:27:20.917759] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-22T18:27:21.719210] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-22T18:27:21.724272] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:27:22.517733] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-22T18:27:22.571441] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T18:27:22.946617] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T18:27:23.317740] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-22T18:27:23.386351] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T18:27:24.117701] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-22T18:27:24.781740] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T18:27:24.917713] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-22T18:27:25.647384] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:27:25.717698] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-22T18:27:26.517322] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:27:26.525835] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-22T18:27:26.893559] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T18:27:27.157007] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T18:27:27.317676] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-22T18:27:28.117699] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-22T18:27:28.917715] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-22T18:27:29.056120] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T18:27:29.532686] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T18:27:29.540322] [INFO ] [REMOTE ] ECC: Full fetch complete (61600 records). [2025-10-22T18:27:29.540449] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-22T18:27:29.718013] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-22T18:27:29.962870] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-22T18:27:29.962960] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-22T18:27:29.963771] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-22T18:27:29.963872] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-22T18:27:29.965161] [DEBUG] [LOCAL ] ECC: Trimmed 61600 records to 43377 (keeping 200 days of data) [2025-10-22T18:27:30.193960] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T18:27:30.254457] [DEBUG] [LOCAL ] ECC: Primary data saved (43377 records). [2025-10-22T18:27:30.254591] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-22T18:27:30.254690] [INFO ] [MAIN ] Update Progress: 689/2367 symbols completed. ECC took 55.9s. Estimated remaining: 3h 32m 55s. Rate: 7.9 symbols/min [2025-10-22T18:27:30.422331] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:30.440775] [DEBUG] [LOCAL ] ECO: Loaded 18099 existing records from primary storage. [2025-10-22T18:27:30.441022] [INFO ] [MAIN ] ECO: Loaded 18099 existing records. [2025-10-22T18:27:30.522937] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-22T18:27:30.618695] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:30.618914] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-22T18:27:30.618964] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-22T18:27:30.619145] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-22T18:27:30.619182] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-22T18:27:30.975757] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:31.020760] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T18:27:31.317729] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-22T18:27:31.521550] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T18:27:32.117723] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-22T18:27:32.748392] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T18:27:32.917756] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-22T18:27:33.246826] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-22T18:27:33.622350] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T18:27:33.717712] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-22T18:27:34.517689] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-22T18:27:34.874695] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-22T18:27:34.892166] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-22T18:27:35.317709] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-22T18:27:36.117723] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-22T18:27:36.322535] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-22T18:27:36.675888] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-22T18:27:36.676585] [INFO ] [REMOTE ] ECCX: Full fetch complete (1456 records). [2025-10-22T18:27:36.676674] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-22T18:27:36.856872] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-22T18:27:36.857070] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:27:36.857139] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:27:36.857212] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-22T18:27:36.857276] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-22T18:27:36.857312] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-22T18:27:36.857352] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-22T18:27:36.857406] [INFO ] [MAIN ] Update Progress: 690/2367 symbols completed. ECCX took 31.8s. Estimated remaining: 3h 32m 45s. Rate: 7.9 symbols/min [2025-10-22T18:27:36.922890] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-22T18:27:37.028234] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:37.028415] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-22T18:27:37.028469] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-22T18:27:37.028617] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-22T18:27:37.028710] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-22T18:27:37.028769] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-22T18:27:37.028803] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-22T18:27:37.389227] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:37.717618] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-22T18:27:38.115447] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T18:27:38.517740] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-22T18:27:39.317671] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-22T18:27:39.345355] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T18:27:39.923844] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T18:27:40.117723] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-22T18:27:40.694969] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T18:27:40.917791] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-22T18:27:41.292250] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T18:27:41.717719] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-22T18:27:42.481459] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T18:27:42.517611] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-22T18:27:43.317683] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-22T18:27:43.378008] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T18:27:43.764129] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:27:44.117621] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-22T18:27:44.174004] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T18:27:44.917734] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-22T18:27:45.502310] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:27:45.717713] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-22T18:27:46.517677] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-22T18:27:46.675746] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T18:27:47.170758] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:27:47.317681] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-22T18:27:47.705116] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T18:27:48.117704] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-22T18:27:48.917710] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-22T18:27:49.181283] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T18:27:49.189867] [INFO ] [REMOTE ] ECL: Full fetch complete (68395 records). [2025-10-22T18:27:49.195850] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-22T18:27:49.200805] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-22T18:27:49.600438] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-22T18:27:49.600520] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-22T18:27:49.601321] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-22T18:27:49.601384] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-22T18:27:49.602706] [DEBUG] [LOCAL ] ECL: Trimmed 68395 records to 46689 (keeping 200 days of data) [2025-10-22T18:27:49.718563] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-22T18:27:49.896364] [DEBUG] [LOCAL ] ECL: Primary data saved (46689 records). [2025-10-22T18:27:49.896490] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-22T18:27:49.897350] [INFO ] [MAIN ] Update Progress: 691/2367 symbols completed. ECL took 34.8s. Estimated remaining: 3h 32m 51s. Rate: 7.9 symbols/min [2025-10-22T18:27:50.072089] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:50.123903] [DEBUG] [LOCAL ] ED: Loaded 52606 existing records from primary storage. [2025-10-22T18:27:50.124202] [INFO ] [MAIN ] ED: Loaded 52606 existing records. [2025-10-22T18:27:50.298250] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:50.298486] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-22T18:27:50.298562] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-22T18:27:50.298909] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-22T18:27:50.298966] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-22T18:27:50.452159] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:27:50.530793] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-22T18:27:50.530989] [INFO ] [REMOTE ] ECG: Full fetch complete (50891 records). [2025-10-22T18:27:50.568282] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-22T18:27:50.804821] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:51.073887] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-22T18:27:51.073985] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-22T18:27:51.074734] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-22T18:27:51.074802] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-22T18:27:51.076001] [DEBUG] [LOCAL ] ECG: Trimmed 50891 records to 32780 (keeping 200 days of data) [2025-10-22T18:27:51.265414] [DEBUG] [LOCAL ] ECG: Primary data saved (32780 records). [2025-10-22T18:27:51.265566] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-22T18:27:51.265677] [INFO ] [MAIN ] Update Progress: 692/2367 symbols completed. ECG took 42.8s. Estimated remaining: 3h 32m 28s. Rate: 7.9 symbols/min [2025-10-22T18:27:51.328758] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-22T18:27:51.444984] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:51.471423] [DEBUG] [LOCAL ] EDD: Loaded 27227 existing records from primary storage. [2025-10-22T18:27:51.471816] [INFO ] [MAIN ] EDD: Loaded 27227 existing records. [2025-10-22T18:27:51.683918] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:51.687029] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T18:27:51.687869] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-22T18:27:51.691686] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-22T18:27:51.703406] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-22T18:27:51.709084] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-22T18:27:51.715771] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T18:27:52.072586] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:52.117711] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-22T18:27:52.917707] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-22T18:27:53.062085] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T18:27:53.223605] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T18:27:53.717751] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-22T18:27:54.390437] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T18:27:54.517673] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-22T18:27:55.317714] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-22T18:27:55.575691] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T18:27:55.941530] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T18:27:56.117677] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-22T18:27:56.478849] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T18:27:56.917694] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-22T18:27:57.717715] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-22T18:27:57.801168] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:27:58.510546] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T18:27:58.520126] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-22T18:27:58.847942] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-22T18:27:58.851508] [INFO ] [REMOTE ] ECO: Full fetch complete (28298 records). [2025-10-22T18:27:58.851596] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-22T18:27:59.223086] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-22T18:27:59.223227] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-22T18:27:59.224066] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-22T18:27:59.224129] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-22T18:27:59.224974] [DEBUG] [LOCAL ] ECO: Trimmed 28298 records to 18017 (keeping 200 days of data) [2025-10-22T18:27:59.317759] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-22T18:27:59.339954] [DEBUG] [LOCAL ] ECO: Primary data saved (18017 records). [2025-10-22T18:27:59.340154] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-22T18:27:59.340261] [INFO ] [MAIN ] Update Progress: 693/2367 symbols completed. ECO took 29.1s. Estimated remaining: 3h 32m 22s. Rate: 7.9 symbols/min [2025-10-22T18:27:59.516077] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:59.531128] [DEBUG] [LOCAL ] EDF: Loaded 12901 existing records from primary storage. [2025-10-22T18:27:59.531404] [INFO ] [MAIN ] EDF: Loaded 12901 existing records. [2025-10-22T18:27:59.732420] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:59.732818] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-22T18:27:59.732882] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-22T18:27:59.733140] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-22T18:27:59.733200] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-22T18:28:00.122785] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-22T18:28:00.189317] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:00.456063] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T18:28:00.467867] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T18:28:00.917716] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-22T18:28:01.717909] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-22T18:28:02.138614] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-22T18:28:02.517718] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-22T18:28:02.622559] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T18:28:03.320617] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-22T18:28:03.576413] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T18:28:04.112382] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T18:28:04.121311] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-22T18:28:04.158878] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T18:28:04.917763] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-22T18:28:05.717742] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-22T18:28:05.938593] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T18:28:06.142519] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T18:28:06.517746] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-22T18:28:06.638061] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T18:28:07.317721] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-22T18:28:08.117710] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-22T18:28:08.297879] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T18:28:08.491462] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T18:28:08.917697] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-22T18:28:09.717623] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-22T18:28:09.871531] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:28:09.878533] [INFO ] [REMOTE ] ECVT: Full fetch complete (60383 records). [2025-10-22T18:28:09.878670] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-22T18:28:10.253783] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-22T18:28:10.253866] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-22T18:28:10.254575] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-22T18:28:10.254612] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-22T18:28:10.255784] [DEBUG] [LOCAL ] ECVT: Trimmed 60383 records to 43112 (keeping 200 days of data) [2025-10-22T18:28:10.516900] [DEBUG] [LOCAL ] ECVT: Primary data saved (43112 records). [2025-10-22T18:28:10.517011] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-22T18:28:10.517089] [INFO ] [MAIN ] Update Progress: 694/2367 symbols completed. ECVT took 33.7s. Estimated remaining: 3h 32m 23s. Rate: 7.9 symbols/min [2025-10-22T18:28:10.540064] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-22T18:28:10.624422] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T18:28:10.708600] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:10.728510] [DEBUG] [LOCAL ] EDN: Loaded 19252 existing records from primary storage. [2025-10-22T18:28:10.728786] [INFO ] [MAIN ] EDN: Loaded 19252 existing records. [2025-10-22T18:28:10.876336] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-22T18:28:10.955256] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:28:10.955456] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-22T18:28:10.955503] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-22T18:28:10.955777] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-22T18:28:10.955836] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-22T18:28:11.294715] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:11.317604] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-22T18:28:11.860351] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T18:28:12.117712] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-22T18:28:12.761886] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T18:28:12.810746] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T18:28:12.917622] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-22T18:28:13.652724] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T18:28:13.717746] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-22T18:28:14.517699] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-22T18:28:15.303376] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T18:28:15.317596] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-22T18:28:15.580926] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T18:28:16.117689] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-22T18:28:16.917700] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-22T18:28:17.340957] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T18:28:17.542779] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-22T18:28:17.551634] [INFO ] [REMOTE ] ED: Full fetch complete (76351 records). [2025-10-22T18:28:17.551796] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-22T18:28:17.726815] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-22T18:28:17.861630] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T18:28:17.959563] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-22T18:28:17.959667] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-22T18:28:17.960517] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-22T18:28:17.960559] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-22T18:28:17.962007] [DEBUG] [LOCAL ] ED: Trimmed 76351 records to 52572 (keeping 200 days of data) [2025-10-22T18:28:18.281944] [DEBUG] [LOCAL ] ED: Primary data saved (52572 records). [2025-10-22T18:28:18.282118] [INFO ] [MAIN ] ED: Full history saved. [2025-10-22T18:28:18.282879] [INFO ] [MAIN ] Update Progress: 695/2367 symbols completed. ED took 28.4s. Estimated remaining: 3h 32m 15s. Rate: 7.9 symbols/min [2025-10-22T18:28:18.453124] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:18.499791] [DEBUG] [LOCAL ] EDU: Loaded 44834 existing records from primary storage. [2025-10-22T18:28:18.500132] [INFO ] [MAIN ] EDU: Loaded 44834 existing records. [2025-10-22T18:28:18.522908] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-22T18:28:18.678130] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:28:18.678342] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-22T18:28:18.678388] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-22T18:28:18.678615] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-22T18:28:18.678699] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-22T18:28:19.032506] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:19.067487] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-22T18:28:19.317699] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-22T18:28:19.372864] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T18:28:20.117718] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-22T18:28:20.920376] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-22T18:28:20.926863] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T18:28:20.949967] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T18:28:21.717702] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-22T18:28:21.954307] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T18:28:22.517677] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-22T18:28:23.029458] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T18:28:23.317711] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-22T18:28:24.117665] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-22T18:28:24.216751] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:28:24.469969] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T18:28:24.917781] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-22T18:28:25.136841] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T18:28:25.139871] [INFO ] [REMOTE ] EDF: Full fetch complete (20184 records). [2025-10-22T18:28:25.140050] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-22T18:28:25.586820] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-22T18:28:25.586897] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-22T18:28:25.587431] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-22T18:28:25.587473] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-22T18:28:25.588060] [DEBUG] [LOCAL ] EDF: Trimmed 20184 records to 12838 (keeping 200 days of data) [2025-10-22T18:28:25.665233] [DEBUG] [LOCAL ] EDF: Primary data saved (12838 records). [2025-10-22T18:28:25.665409] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-22T18:28:25.665517] [INFO ] [MAIN ] Update Progress: 696/2367 symbols completed. EDF took 26.3s. Estimated remaining: 3h 32m 7s. Rate: 7.9 symbols/min [2025-10-22T18:28:25.727245] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-22T18:28:25.838742] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:25.839161] [DEBUG] [LOCAL ] EE: No existing data file found in primary storage. [2025-10-22T18:28:25.839275] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-10-22T18:28:25.839497] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-22T18:28:25.839604] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-22T18:28:25.839801] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-22T18:28:25.839862] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-22T18:28:25.963829] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T18:28:26.220269] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:26.517667] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-22T18:28:26.535720] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T18:28:27.317730] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-22T18:28:27.766128] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:28:28.117722] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-22T18:28:28.917678] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-22T18:28:29.112747] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T18:28:29.134251] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T18:28:29.717724] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-22T18:28:29.955749] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T18:28:29.960697] [INFO ] [REMOTE ] EDD: Full fetch complete (39096 records). [2025-10-22T18:28:29.960801] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-22T18:28:30.329482] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-22T18:28:30.329563] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-22T18:28:30.330219] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-22T18:28:30.330282] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-22T18:28:30.331262] [DEBUG] [LOCAL ] EDD: Trimmed 39096 records to 27270 (keeping 200 days of data) [2025-10-22T18:28:30.491846] [DEBUG] [LOCAL ] EDD: Primary data saved (27270 records). [2025-10-22T18:28:30.492028] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-22T18:28:30.492147] [INFO ] [MAIN ] Update Progress: 697/2367 symbols completed. EDD took 39.2s. Estimated remaining: 3h 31m 53s. Rate: 7.9 symbols/min [2025-10-22T18:28:30.522868] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-22T18:28:30.663472] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:30.663626] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-22T18:28:30.663694] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-22T18:28:30.663807] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-22T18:28:30.663868] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-22T18:28:30.663935] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-22T18:28:30.664009] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-22T18:28:31.013064] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:31.317712] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-22T18:28:31.615292] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T18:28:31.815515] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T18:28:31.963107] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T18:28:32.117727] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-22T18:28:32.917716] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-22T18:28:33.120491] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T18:28:33.717743] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-22T18:28:34.012555] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T18:28:34.517690] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-22T18:28:35.222764] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T18:28:35.317740] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-22T18:28:35.828311] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T18:28:36.117699] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-22T18:28:36.422180] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T18:28:36.917750] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-22T18:28:37.530974] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T18:28:37.717706] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-22T18:28:38.445146] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:28:38.517719] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-22T18:28:38.612137] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T18:28:39.317710] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-22T18:28:39.769451] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T18:28:40.117689] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-22T18:28:40.229959] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T18:28:40.917743] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-22T18:28:41.476762] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T18:28:41.483261] [INFO ] [REMOTE ] EDN: Full fetch complete (29815 records). [2025-10-22T18:28:41.483412] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-22T18:28:41.723759] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-22T18:28:41.896412] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-22T18:28:41.896490] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-22T18:28:41.897008] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-22T18:28:41.897093] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-22T18:28:41.897794] [DEBUG] [LOCAL ] EDN: Trimmed 29815 records to 19304 (keeping 200 days of data) [2025-10-22T18:28:42.005191] [DEBUG] [LOCAL ] EDN: Primary data saved (19304 records). [2025-10-22T18:28:42.005320] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-22T18:28:42.005396] [INFO ] [MAIN ] Update Progress: 698/2367 symbols completed. EDN took 31.5s. Estimated remaining: 3h 31m 54s. Rate: 7.9 symbols/min [2025-10-22T18:28:42.170475] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:42.181479] [DEBUG] [LOCAL ] EEX: Loaded 9972 existing records from primary storage. [2025-10-22T18:28:42.181716] [INFO ] [MAIN ] EEX: Loaded 9972 existing records. [2025-10-22T18:28:42.366144] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T18:28:42.371312] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:28:42.373840] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-22T18:28:42.373963] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-22T18:28:42.374167] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-22T18:28:42.374226] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-22T18:28:42.521260] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-22T18:28:42.736214] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T18:28:42.768611] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:43.178116] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T18:28:43.317719] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-22T18:28:43.871904] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T18:28:44.117695] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-22T18:28:44.917709] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-22T18:28:45.464791] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T18:28:45.492248] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T18:28:45.717700] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-22T18:28:46.517689] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-22T18:28:46.830119] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T18:28:46.913010] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-22T18:28:47.317706] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-22T18:28:48.117753] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-22T18:28:48.732456] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T18:28:48.917764] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-22T18:28:49.717726] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-22T18:28:49.830585] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T18:28:50.288374] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T18:28:50.341508] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T18:28:50.517700] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-22T18:28:51.317723] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-22T18:28:52.117683] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-22T18:28:52.254368] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T18:28:52.262107] [INFO ] [REMOTE ] EDU: Full fetch complete (67193 records). [2025-10-22T18:28:52.262268] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-22T18:28:52.650154] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-22T18:28:52.650260] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-22T18:28:52.651200] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-22T18:28:52.651283] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-22T18:28:52.652759] [DEBUG] [LOCAL ] EDU: Trimmed 67193 records to 44813 (keeping 200 days of data) [2025-10-22T18:28:52.755255] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T18:28:52.923205] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-22T18:28:52.932166] [DEBUG] [LOCAL ] EDU: Primary data saved (44813 records). [2025-10-22T18:28:52.932303] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-22T18:28:52.932997] [INFO ] [MAIN ] Update Progress: 699/2367 symbols completed. EDU took 34.6s. Estimated remaining: 3h 31m 55s. Rate: 7.9 symbols/min [2025-10-22T18:28:53.101961] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:53.158442] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T18:28:53.159344] [DEBUG] [LOCAL ] EFC: Loaded 46334 existing records from primary storage. [2025-10-22T18:28:53.164823] [INFO ] [MAIN ] EFC: Loaded 46334 existing records. [2025-10-22T18:28:53.338694] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:28:53.338910] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-22T18:28:53.338958] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-22T18:28:53.339171] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-22T18:28:53.339227] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-22T18:28:53.694527] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:53.717703] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-22T18:28:54.386580] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T18:28:54.393231] [INFO ] [REMOTE ] EE: Full fetch complete (44516 records). [2025-10-22T18:28:54.393445] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-22T18:28:54.522948] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-22T18:28:54.815944] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-22T18:28:54.816626] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-22T18:28:54.817726] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-22T18:28:54.818338] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-22T18:28:54.818238] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T18:28:54.824278] [DEBUG] [LOCAL ] EE: Trimmed 44516 records to 32539 (keeping 200 days of data) [2025-10-22T18:28:55.041080] [DEBUG] [LOCAL ] EE: Primary data saved (32539 records). [2025-10-22T18:28:55.041286] [INFO ] [MAIN ] EE: Full history saved. [2025-10-22T18:28:55.041379] [INFO ] [MAIN ] Update Progress: 700/2367 symbols completed. EE took 29.4s. Estimated remaining: 3h 31m 34s. Rate: 7.9 symbols/min [2025-10-22T18:28:55.259317] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:55.278566] [DEBUG] [LOCAL ] EFR: Loaded 15065 existing records from primary storage. [2025-10-22T18:28:55.278931] [INFO ] [MAIN ] EFR: Loaded 15065 existing records. [2025-10-22T18:28:55.323008] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-22T18:28:55.460907] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:28:55.461196] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-22T18:28:55.461248] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-22T18:28:55.461447] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-22T18:28:55.461488] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-22T18:28:55.821385] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:56.117683] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-22T18:28:56.198409] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T18:28:56.218718] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T18:28:56.917685] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-22T18:28:57.040551] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T18:28:57.717681] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-22T18:28:57.870375] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T18:28:58.442220] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T18:28:58.517701] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-22T18:28:59.123587] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T18:28:59.317725] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-22T18:29:00.092911] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T18:29:00.117612] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-22T18:29:00.917689] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-22T18:29:01.397043] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T18:29:01.717706] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-22T18:29:02.431338] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T18:29:02.517620] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-22T18:29:02.610837] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T18:29:03.317690] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-22T18:29:03.851584] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-22T18:29:03.852368] [INFO ] [REMOTE ] EEA: Full fetch complete (3734 records). [2025-10-22T18:29:03.852434] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-22T18:29:03.852804] [FATAL] [VALIDATOR ] EEA: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:29:03.852884] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:29:03.852926] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:29:03.852992] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-22T18:29:03.853052] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-22T18:29:03.853086] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-22T18:29:03.853125] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-22T18:29:03.853174] [INFO ] [MAIN ] Update Progress: 701/2367 symbols completed. EEA took 33.4s. Estimated remaining: 3h 31m 29s. Rate: 7.9 symbols/min [2025-10-22T18:29:03.992313] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T18:29:04.056165] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:04.071087] [DEBUG] [LOCAL ] EFT: Loaded 13016 existing records from primary storage. [2025-10-22T18:29:04.071330] [INFO ] [MAIN ] EFT: Loaded 13016 existing records. [2025-10-22T18:29:04.125796] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-22T18:29:04.255723] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:04.256001] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-22T18:29:04.256058] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-22T18:29:04.256236] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-22T18:29:04.256290] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-22T18:29:04.614065] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:04.792612] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-22T18:29:04.917672] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-22T18:29:05.659015] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T18:29:05.717705] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-22T18:29:06.517714] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-22T18:29:06.712886] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T18:29:06.959978] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T18:29:07.317708] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-22T18:29:08.117707] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-22T18:29:08.920597] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-22T18:29:09.012017] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T18:29:09.013879] [INFO ] [REMOTE ] EEX: Full fetch complete (18293 records). [2025-10-22T18:29:09.013970] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-22T18:29:09.299906] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T18:29:09.409383] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-22T18:29:09.409465] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-22T18:29:09.409907] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-22T18:29:09.409971] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-22T18:29:09.410512] [DEBUG] [LOCAL ] EEX: Trimmed 18293 records to 9811 (keeping 200 days of data) [2025-10-22T18:29:09.464697] [DEBUG] [LOCAL ] EEX: Primary data saved (9811 records). [2025-10-22T18:29:09.464817] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-22T18:29:09.464892] [INFO ] [MAIN ] Update Progress: 702/2367 symbols completed. EEX took 27.5s. Estimated remaining: 3h 31m 17s. Rate: 7.9 symbols/min [2025-10-22T18:29:09.630274] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:09.670108] [DEBUG] [LOCAL ] EFX: Loaded 44767 existing records from primary storage. [2025-10-22T18:29:09.670407] [INFO ] [MAIN ] EFX: Loaded 44767 existing records. [2025-10-22T18:29:09.723137] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-22T18:29:09.848439] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:09.848619] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-22T18:29:09.848696] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-22T18:29:09.848886] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-22T18:29:09.848925] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-22T18:29:09.956692] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T18:29:10.207993] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:10.517749] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-22T18:29:11.317710] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-22T18:29:11.443236] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T18:29:11.646955] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T18:29:12.094810] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T18:29:12.117681] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-22T18:29:12.917705] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-22T18:29:13.717663] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-22T18:29:13.830775] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T18:29:13.960052] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T18:29:14.234549] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-22T18:29:14.517714] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-22T18:29:15.317673] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-22T18:29:15.372008] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T18:29:16.117681] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-22T18:29:16.339350] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T18:29:16.917695] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-22T18:29:17.717679] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-22T18:29:17.867823] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T18:29:17.950977] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T18:29:17.954365] [INFO ] [REMOTE ] EFR: Full fetch complete (19695 records). [2025-10-22T18:29:17.954467] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-22T18:29:18.363375] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-22T18:29:18.363468] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-22T18:29:18.363900] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-22T18:29:18.363960] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-22T18:29:18.364496] [DEBUG] [LOCAL ] EFR: Trimmed 19695 records to 15025 (keeping 200 days of data) [2025-10-22T18:29:18.453336] [DEBUG] [LOCAL ] EFR: Primary data saved (15025 records). [2025-10-22T18:29:18.453481] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-22T18:29:18.453561] [INFO ] [MAIN ] Update Progress: 703/2367 symbols completed. EFR took 23.4s. Estimated remaining: 3h 31m 13s. Rate: 7.9 symbols/min [2025-10-22T18:29:18.522860] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-22T18:29:18.629511] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:18.629741] [DEBUG] [LOCAL ] EFXT: No existing data file found in primary storage. [2025-10-22T18:29:18.629794] [WARN ] [MAIN ] EFXT: No existing data found, performing full refresh instead. [2025-10-22T18:29:18.629926] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-22T18:29:18.629971] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-22T18:29:18.630012] [DEBUG] [LOCAL ] EFXT: No primary data file found to delete. [2025-10-22T18:29:18.630044] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-22T18:29:18.973199] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:19.317759] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-22T18:29:19.365708] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T18:29:20.121497] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-22T18:29:20.140363] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:29:20.349989] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:29:20.917701] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-22T18:29:21.654781] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T18:29:21.717699] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-22T18:29:22.517675] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-22T18:29:22.569575] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T18:29:22.854070] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T18:29:23.317623] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-22T18:29:23.475469] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T18:29:24.117754] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-22T18:29:24.917684] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-22T18:29:25.139774] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T18:29:25.717684] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-22T18:29:25.980015] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T18:29:26.052276] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T18:29:26.517705] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-22T18:29:27.317707] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-22T18:29:27.566224] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T18:29:27.811167] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T18:29:28.117705] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-22T18:29:28.917622] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-22T18:29:29.040166] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:29:29.717733] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-22T18:29:29.799919] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T18:29:29.857580] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-22T18:29:30.517723] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-22T18:29:30.565637] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T18:29:31.317728] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-22T18:29:31.740712] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T18:29:32.117764] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-22T18:29:32.837474] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T18:29:32.917726] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-22T18:29:33.717662] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-22T18:29:33.881981] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T18:29:33.890550] [INFO ] [REMOTE ] EFC: Full fetch complete (66659 records). [2025-10-22T18:29:33.890699] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-22T18:29:34.197126] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T18:29:34.293716] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-22T18:29:34.293858] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-22T18:29:34.294756] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-22T18:29:34.294864] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-22T18:29:34.296216] [DEBUG] [LOCAL ] EFC: Trimmed 66659 records to 46280 (keeping 200 days of data) [2025-10-22T18:29:34.393608] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-22T18:29:34.517719] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-22T18:29:34.589482] [DEBUG] [LOCAL ] EFC: Primary data saved (46280 records). [2025-10-22T18:29:34.589625] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-22T18:29:34.590436] [INFO ] [MAIN ] Update Progress: 704/2367 symbols completed. EFC took 41.7s. Estimated remaining: 3h 31m 25s. Rate: 7.9 symbols/min [2025-10-22T18:29:34.771869] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:34.801392] [DEBUG] [LOCAL ] EG: Loaded 27710 existing records from primary storage. [2025-10-22T18:29:34.801704] [INFO ] [MAIN ] EG: Loaded 27710 existing records. [2025-10-22T18:29:34.988332] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:34.988543] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-22T18:29:34.988589] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-22T18:29:34.988814] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-22T18:29:34.988871] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-22T18:29:35.317674] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-22T18:29:35.337221] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:35.403196] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T18:29:36.117699] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-22T18:29:36.701215] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T18:29:36.917624] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-22T18:29:37.717712] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-22T18:29:37.877912] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:29:38.101506] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:29:38.517695] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-22T18:29:38.930172] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T18:29:39.317752] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-22T18:29:39.667448] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T18:29:40.117743] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-22T18:29:40.914193] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T18:29:40.922843] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-22T18:29:41.526601] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T18:29:41.717739] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-22T18:29:42.062160] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-22T18:29:42.064588] [INFO ] [REMOTE ] EFT: Full fetch complete (17666 records). [2025-10-22T18:29:42.064691] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-22T18:29:42.065147] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:29:42.065228] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:29:42.065297] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:29:42.065368] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-22T18:29:42.065430] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-22T18:29:42.065465] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-10-22T18:29:42.065623] [DEBUG] [LOCAL ] EFT: Deleted derivative data file. [2025-10-22T18:29:42.065732] [INFO ] [MAIN ] Update Progress: 705/2367 symbols completed. EFT took 38.2s. Estimated remaining: 3h 31m 17s. Rate: 7.9 symbols/min [2025-10-22T18:29:42.231394] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:42.279773] [DEBUG] [LOCAL ] EGO: Loaded 51738 existing records from primary storage. [2025-10-22T18:29:42.280095] [INFO ] [MAIN ] EGO: Loaded 51738 existing records. [2025-10-22T18:29:42.459871] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:42.460059] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-22T18:29:42.460101] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-22T18:29:42.460280] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-22T18:29:42.460319] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-22T18:29:42.522932] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-22T18:29:42.818424] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:43.326870] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-22T18:29:43.332476] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T18:29:44.009061] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T18:29:44.016874] [INFO ] [REMOTE ] EFXT: Full fetch complete (44270 records). [2025-10-22T18:29:44.017026] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-22T18:29:44.126042] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-22T18:29:44.406995] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-22T18:29:44.407070] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-22T18:29:44.407735] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-22T18:29:44.407795] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-22T18:29:44.408636] [DEBUG] [LOCAL ] EFXT: Trimmed 44270 records to 29466 (keeping 200 days of data) [2025-10-22T18:29:44.573537] [DEBUG] [LOCAL ] EFXT: Primary data saved (29466 records). [2025-10-22T18:29:44.573715] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-22T18:29:44.573833] [INFO ] [MAIN ] Update Progress: 706/2367 symbols completed. EFXT took 26.1s. Estimated remaining: 3h 30m 57s. Rate: 7.9 symbols/min [2025-10-22T18:29:44.753698] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:44.786103] [DEBUG] [LOCAL ] EGP: Loaded 30323 existing records from primary storage. [2025-10-22T18:29:44.786414] [INFO ] [MAIN ] EGP: Loaded 30323 existing records. [2025-10-22T18:29:44.933432] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-22T18:29:44.974248] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:44.974960] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-22T18:29:44.975046] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-22T18:29:44.975407] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-22T18:29:44.975481] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-22T18:29:45.291789] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T18:29:45.384681] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:45.455068] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T18:29:45.717713] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-22T18:29:46.517670] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-22T18:29:46.730915] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T18:29:46.738333] [INFO ] [REMOTE ] EFX: Full fetch complete (64777 records). [2025-10-22T18:29:46.738450] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-22T18:29:46.739249] [FATAL] [VALIDATOR ] EFX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:29:46.739332] [FATAL] [MAIN ] EFX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:29:46.739373] [WARN ] [MAIN ] EFX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:29:46.739448] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-22T18:29:46.739510] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-10-22T18:29:46.739544] [INFO ] [LOCAL ] EFX: Starting deletion of derivative data. [2025-10-22T18:29:46.739708] [DEBUG] [LOCAL ] EFX: Deleted derivative data file. [2025-10-22T18:29:46.739798] [INFO ] [MAIN ] Update Progress: 707/2367 symbols completed. EFX took 37.3s. Estimated remaining: 3h 30m 37s. Rate: 7.9 symbols/min [2025-10-22T18:29:46.910659] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:46.931177] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:29:46.967591] [DEBUG] [LOCAL ] EGY: Loaded 41354 existing records from primary storage. [2025-10-22T18:29:46.967917] [INFO ] [MAIN ] EGY: Loaded 41354 existing records. [2025-10-22T18:29:47.143249] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:47.143465] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-22T18:29:47.143511] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-22T18:29:47.143727] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-22T18:29:47.143782] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-22T18:29:47.328849] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-22T18:29:47.495869] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:48.117726] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-22T18:29:48.326502] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T18:29:48.917719] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-22T18:29:49.077617] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T18:29:49.717734] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-22T18:29:49.826576] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T18:29:50.517741] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-22T18:29:50.928454] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-22T18:29:50.995416] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-22T18:29:51.317697] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-22T18:29:51.968175] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T18:29:52.117706] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-22T18:29:52.561015] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T18:29:52.917714] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-22T18:29:53.609963] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T18:29:53.717712] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-22T18:29:54.402918] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T18:29:54.517675] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-22T18:29:55.096701] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:29:55.317695] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-22T18:29:55.998478] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T18:29:56.117679] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-22T18:29:56.760765] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T18:29:56.917687] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-22T18:29:57.700805] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:29:57.717616] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-22T18:29:58.062140] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T18:29:58.517770] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-22T18:29:59.317683] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-22T18:29:59.392948] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T18:30:00.117709] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-22T18:30:00.338526] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T18:30:00.917670] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-22T18:30:01.276863] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T18:30:01.717701] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-22T18:30:02.179185] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T18:30:02.517710] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-22T18:30:03.317708] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-22T18:30:04.833581] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T18:30:04.840113] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-22T18:30:06.189916] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T18:30:06.194144] [INFO ] [REMOTE ] EG: Full fetch complete (42936 records). [2025-10-22T18:30:06.194245] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-22T18:30:06.478413] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (5.56 seconds). [2025-10-22T18:30:06.517938] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-22T18:30:06.600959] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-22T18:30:06.601041] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-22T18:30:06.601616] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-22T18:30:06.601686] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-22T18:30:06.602590] [DEBUG] [LOCAL ] EG: Trimmed 42936 records to 27544 (keeping 200 days of data) [2025-10-22T18:30:06.777352] [DEBUG] [LOCAL ] EG: Primary data saved (27544 records). [2025-10-22T18:30:06.777589] [INFO ] [MAIN ] EG: Full history saved. [2025-10-22T18:30:06.777734] [INFO ] [MAIN ] Update Progress: 708/2367 symbols completed. EG took 32.2s. Estimated remaining: 3h 30m 58s. Rate: 7.9 symbols/min [2025-10-22T18:30:06.951786] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:06.979621] [DEBUG] [LOCAL ] EHAB: Loaded 29287 existing records from primary storage. [2025-10-22T18:30:06.979938] [INFO ] [MAIN ] EHAB: Loaded 29287 existing records. [2025-10-22T18:30:07.154983] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:30:07.155241] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-22T18:30:07.155288] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-22T18:30:07.155557] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-22T18:30:07.155613] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-22T18:30:07.525125] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:07.525547] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-22T18:30:07.774862] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (5.26 seconds). [2025-10-22T18:30:07.784067] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-22T18:30:07.842152] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T18:30:07.848905] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-22T18:30:07.909064] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (6.19 seconds). [2025-10-22T18:30:08.117759] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-22T18:30:08.684862] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T18:30:08.917686] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-22T18:30:09.308436] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T18:30:09.369881] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T18:30:09.598160] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T18:30:09.717681] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-22T18:30:10.198453] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T18:30:10.517733] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-22T18:30:11.317682] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-22T18:30:11.632117] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-22T18:30:11.740337] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T18:30:12.117683] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-22T18:30:12.917680] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-22T18:30:12.982073] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:30:13.428841] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T18:30:13.717716] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-22T18:30:14.517700] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-22T18:30:15.317667] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-22T18:30:15.541134] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T18:30:16.034826] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T18:30:16.042057] [INFO ] [REMOTE ] EGY: Full fetch complete (60732 records). [2025-10-22T18:30:16.042282] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-22T18:30:16.119989] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-22T18:30:16.342987] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:30:16.421319] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (3.50 seconds). [2025-10-22T18:30:16.467480] [INFO ] [REMOTE ] EGO: Full fetch complete (74574 records). [2025-10-22T18:30:16.488459] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-22T18:30:16.503179] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-22T18:30:16.503278] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-22T18:30:16.504118] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-22T18:30:16.504202] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-22T18:30:16.604846] [DEBUG] [LOCAL ] EGY: Trimmed 60732 records to 41231 (keeping 200 days of data) [2025-10-22T18:30:16.918358] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-22T18:30:17.005328] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-22T18:30:17.005940] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-22T18:30:17.007411] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-22T18:30:17.008063] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-22T18:30:17.012140] [DEBUG] [LOCAL ] EGO: Trimmed 74574 records to 51739 (keeping 200 days of data) [2025-10-22T18:30:17.355473] [DEBUG] [LOCAL ] EGY: Primary data saved (41231 records). [2025-10-22T18:30:17.356117] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-22T18:30:17.357005] [INFO ] [MAIN ] Update Progress: 709/2367 symbols completed. EGY took 30.6s. Estimated remaining: 3h 30m 58s. Rate: 7.9 symbols/min [2025-10-22T18:30:17.608143] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:17.610442] [DEBUG] [LOCAL ] EGO: Primary data saved (51739 records). [2025-10-22T18:30:17.610564] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-22T18:30:17.610759] [INFO ] [MAIN ] Update Progress: 710/2367 symbols completed. EGO took 35.5s. Estimated remaining: 3h 30m 33s. Rate: 7.9 symbols/min [2025-10-22T18:30:17.826673] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:17.840485] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:30:17.849809] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-22T18:30:17.864988] [DEBUG] [LOCAL ] EHC: Loaded 40976 existing records from primary storage. [2025-10-22T18:30:17.865558] [INFO ] [MAIN ] EHC: Loaded 40976 existing records. [2025-10-22T18:30:17.919983] [DEBUG] [LOCAL ] EHI: Loaded 10531 existing records from primary storage. [2025-10-22T18:30:17.953458] [INFO ] [MAIN ] EHI: Loaded 10531 existing records. [2025-10-22T18:30:18.179768] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:30:18.236771] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:30:18.236971] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-22T18:30:18.232566] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-22T18:30:18.237096] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-22T18:30:18.237263] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-22T18:30:18.242682] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-22T18:30:18.249929] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-22T18:30:18.251988] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-22T18:30:18.252087] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-22T18:30:18.318327] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:30:18.521318] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-22T18:30:18.960591] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:18.981427] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:19.317618] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-22T18:30:19.401630] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T18:30:19.406581] [INFO ] [REMOTE ] EGP: Full fetch complete (45594 records). [2025-10-22T18:30:19.406700] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-22T18:30:19.806850] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-22T18:30:19.807170] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-22T18:30:19.807863] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-22T18:30:19.807929] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-22T18:30:19.809051] [DEBUG] [LOCAL ] EGP: Trimmed 45594 records to 30227 (keeping 200 days of data) [2025-10-22T18:30:19.998756] [DEBUG] [LOCAL ] EGP: Primary data saved (30227 records). [2025-10-22T18:30:19.998925] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-22T18:30:19.999005] [INFO ] [MAIN ] Update Progress: 711/2367 symbols completed. EGP took 35.4s. Estimated remaining: 3h 30m 13s. Rate: 7.9 symbols/min [2025-10-22T18:30:20.122745] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-22T18:30:20.164732] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:20.186528] [DEBUG] [LOCAL ] EIC: Loaded 22643 existing records from primary storage. [2025-10-22T18:30:20.186786] [INFO ] [MAIN ] EIC: Loaded 22643 existing records. [2025-10-22T18:30:20.360554] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:30:20.360720] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-22T18:30:20.360787] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-22T18:30:20.361148] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-22T18:30:20.361204] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-22T18:30:20.709528] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:20.917610] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-22T18:30:21.721055] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:30:21.729185] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-22T18:30:21.972417] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-22T18:30:22.129855] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:30:22.284300] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (3.76 seconds). [2025-10-22T18:30:22.517788] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-22T18:30:22.815391] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T18:30:23.072673] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-22T18:30:23.317740] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-22T18:30:24.122122] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-22T18:30:24.127605] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T18:30:24.917758] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-22T18:30:25.717746] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-22T18:30:26.099410] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T18:30:26.290799] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T18:30:26.517714] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-22T18:30:27.067157] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T18:30:27.317737] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-22T18:30:28.117704] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-22T18:30:28.196285] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T18:30:28.473595] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T18:30:28.917719] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-22T18:30:29.419744] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T18:30:29.717765] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-22T18:30:30.517707] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-22T18:30:30.566000] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T18:30:30.605444] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T18:30:31.317693] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-22T18:30:31.703740] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T18:30:32.117724] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-22T18:30:32.841305] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T18:30:32.917613] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-22T18:30:33.053983] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T18:30:33.717723] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-22T18:30:34.522777] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-22T18:30:34.554038] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T18:30:34.574230] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T18:30:35.317762] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-22T18:30:35.915311] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T18:30:35.919959] [INFO ] [REMOTE ] EHAB: Full fetch complete (41200 records). [2025-10-22T18:30:35.920064] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-22T18:30:36.126360] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-22T18:30:36.292869] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-22T18:30:36.292944] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-22T18:30:36.293517] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-22T18:30:36.293556] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-22T18:30:36.294378] [DEBUG] [LOCAL ] EHAB: Trimmed 41200 records to 29342 (keeping 200 days of data) [2025-10-22T18:30:36.455090] [DEBUG] [LOCAL ] EHAB: Primary data saved (29342 records). [2025-10-22T18:30:36.455217] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-22T18:30:36.455295] [INFO ] [MAIN ] Update Progress: 712/2367 symbols completed. EHAB took 29.7s. Estimated remaining: 3h 30m 26s. Rate: 7.9 symbols/min [2025-10-22T18:30:36.623619] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:36.623867] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-22T18:30:36.623979] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-22T18:30:36.624115] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-22T18:30:36.624157] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-22T18:30:36.624197] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-22T18:30:36.624229] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-22T18:30:36.923594] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-22T18:30:37.029869] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:37.145903] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T18:30:37.553796] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T18:30:37.717694] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-22T18:30:37.758665] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T18:30:38.219256] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-22T18:30:38.517666] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-22T18:30:39.317755] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-22T18:30:39.327312] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T18:30:40.117694] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-22T18:30:40.657246] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T18:30:40.917720] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-22T18:30:41.525059] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T18:30:41.717687] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-22T18:30:41.762946] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T18:30:41.765569] [INFO ] [REMOTE ] EHI: Full fetch complete (15810 records). [2025-10-22T18:30:41.765672] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-22T18:30:42.130129] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-22T18:30:42.130236] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-22T18:30:42.130578] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-22T18:30:42.130617] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-22T18:30:42.131206] [DEBUG] [LOCAL ] EHI: Trimmed 15810 records to 10532 (keeping 200 days of data) [2025-10-22T18:30:42.189877] [DEBUG] [LOCAL ] EHI: Primary data saved (10532 records). [2025-10-22T18:30:42.190004] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-22T18:30:42.190086] [INFO ] [MAIN ] Update Progress: 713/2367 symbols completed. EHI took 24.6s. Estimated remaining: 3h 30m 14s. Rate: 7.9 symbols/min [2025-10-22T18:30:42.355092] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:42.355269] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-22T18:30:42.355353] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-22T18:30:42.355433] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-22T18:30:42.355468] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-22T18:30:42.355507] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-22T18:30:42.355537] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-22T18:30:42.525193] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-22T18:30:42.711661] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:42.928422] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T18:30:42.959941] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T18:30:43.317741] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-22T18:30:44.117746] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-22T18:30:44.460845] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-22T18:30:44.917742] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-22T18:30:45.090216] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:30:45.096603] [INFO ] [REMOTE ] EHC: Full fetch complete (58781 records). [2025-10-22T18:30:45.096733] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-22T18:30:45.487690] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-22T18:30:45.487789] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-22T18:30:45.488518] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-22T18:30:45.488561] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-22T18:30:45.489841] [DEBUG] [LOCAL ] EHC: Trimmed 58781 records to 40923 (keeping 200 days of data) [2025-10-22T18:30:45.721757] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-22T18:30:45.759017] [DEBUG] [LOCAL ] EHC: Primary data saved (40923 records). [2025-10-22T18:30:45.759142] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-22T18:30:45.759218] [INFO ] [MAIN ] Update Progress: 714/2367 symbols completed. EHC took 28.4s. Estimated remaining: 3h 29m 57s. Rate: 7.9 symbols/min [2025-10-22T18:30:45.925882] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:45.926125] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-22T18:30:45.926177] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-22T18:30:45.926283] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-22T18:30:45.926324] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-22T18:30:45.926365] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-22T18:30:45.926422] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-22T18:30:46.300730] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:46.307462] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-22T18:30:46.311520] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T18:30:46.517708] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-22T18:30:47.099604] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-22T18:30:47.317794] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-22T18:30:48.117736] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-22T18:30:48.495916] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-22T18:30:48.513855] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T18:30:48.917773] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-22T18:30:49.717748] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-22T18:30:49.890678] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T18:30:50.083066] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-22T18:30:50.517697] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-22T18:30:51.317747] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-22T18:30:51.669101] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T18:30:51.672905] [INFO ] [REMOTE ] EIC: Full fetch complete (34169 records). [2025-10-22T18:30:51.673035] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-22T18:30:51.794860] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-22T18:30:52.076269] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-22T18:30:52.076396] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-22T18:30:52.077003] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-22T18:30:52.077069] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-22T18:30:52.078108] [DEBUG] [LOCAL ] EIC: Trimmed 34169 records to 22441 (keeping 200 days of data) [2025-10-22T18:30:52.130887] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-22T18:30:52.220103] [DEBUG] [LOCAL ] EIC: Primary data saved (22441 records). [2025-10-22T18:30:52.220269] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-22T18:30:52.220365] [INFO ] [MAIN ] Update Progress: 715/2367 symbols completed. EIC took 32.2s. Estimated remaining: 3h 29m 47s. Rate: 7.9 symbols/min [2025-10-22T18:30:52.387275] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:52.407186] [DEBUG] [LOCAL ] EIG: Loaded 20185 existing records from primary storage. [2025-10-22T18:30:52.407444] [INFO ] [MAIN ] EIG: Loaded 20185 existing records. [2025-10-22T18:30:52.533815] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-22T18:30:52.594224] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:30:52.594535] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-22T18:30:52.594593] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-22T18:30:52.595001] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-22T18:30:52.595224] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-22T18:30:52.922868] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-22T18:30:52.963611] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:53.530883] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T18:30:53.717695] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-22T18:30:54.135696] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-22T18:30:54.517690] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-22T18:30:54.861384] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-22T18:30:55.317682] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-22T18:30:55.922734] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:30:56.117698] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-22T18:30:56.642608] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-22T18:30:56.917697] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-22T18:30:57.376171] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T18:30:57.717722] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-22T18:30:58.191732] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T18:30:58.517707] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-22T18:30:59.229214] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T18:30:59.317722] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-22T18:31:00.117692] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-22T18:31:00.296211] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T18:31:00.765691] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T18:31:00.917709] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-22T18:31:01.717702] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-22T18:31:02.486509] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:31:02.517625] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-22T18:31:03.119174] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T18:31:03.243543] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T18:31:03.317669] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-22T18:31:03.844126] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-22T18:31:04.117725] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-22T18:31:04.737782] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T18:31:04.917724] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-22T18:31:05.375360] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T18:31:05.717689] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-22T18:31:06.052090] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-22T18:31:06.517720] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-22T18:31:07.209924] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-22T18:31:07.317686] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-22T18:31:08.105958] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T18:31:08.117614] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-22T18:31:08.797275] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T18:31:08.917706] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-22T18:31:09.364713] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-22T18:31:09.365429] [INFO ] [REMOTE ] EICA: Full fetch complete (1252 records). [2025-10-22T18:31:09.365495] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-22T18:31:09.540070] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-22T18:31:09.540244] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:31:09.540311] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:31:09.540380] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-22T18:31:09.540443] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-22T18:31:09.540478] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-22T18:31:09.540517] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-22T18:31:09.540568] [INFO ] [MAIN ] Update Progress: 716/2367 symbols completed. EICA took 33.1s. Estimated remaining: 3h 30m 1s. Rate: 7.9 symbols/min [2025-10-22T18:31:09.716835] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:09.717007] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-10-22T18:31:09.717050] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-10-22T18:31:09.717160] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-22T18:31:09.717201] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-22T18:31:09.717243] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-22T18:31:09.717277] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-22T18:31:09.722750] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-22T18:31:10.079157] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:10.517710] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-22T18:31:10.941073] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T18:31:11.317729] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-22T18:31:11.940266] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-22T18:31:11.941147] [INFO ] [REMOTE ] EICB: Full fetch complete (2680 records). [2025-10-22T18:31:11.941215] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-22T18:31:11.941536] [FATAL] [VALIDATOR ] EICB: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:31:11.941616] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:31:11.941701] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:31:11.941771] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-22T18:31:11.941839] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-22T18:31:11.941874] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-22T18:31:11.941913] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-22T18:31:11.942001] [INFO ] [MAIN ] Update Progress: 717/2367 symbols completed. EICB took 29.8s. Estimated remaining: 3h 29m 42s. Rate: 7.9 symbols/min [2025-10-22T18:31:12.117725] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-22T18:31:12.674415] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-22T18:31:12.774991] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-22T18:31:12.776867] [INFO ] [REMOTE ] EICC: Full fetch complete (8463 records). [2025-10-22T18:31:12.776971] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-22T18:31:12.777381] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:31:12.777464] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:31:12.777514] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:31:12.777598] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-22T18:31:12.777737] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-22T18:31:12.777798] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-22T18:31:12.777859] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-22T18:31:12.777938] [INFO ] [MAIN ] Update Progress: 718/2367 symbols completed. EICC took 27.0s. Estimated remaining: 3h 29m 18s. Rate: 7.9 symbols/min [2025-10-22T18:31:12.917724] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-22T18:31:13.717701] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-22T18:31:14.796773] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T18:31:14.807971] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-22T18:31:14.839987] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T18:31:15.317727] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-22T18:31:16.417138] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T18:31:16.425105] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-22T18:31:16.739169] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T18:31:16.917842] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-22T18:31:17.417849] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T18:31:17.717691] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-22T18:31:18.674869] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T18:31:18.686792] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-22T18:31:18.779230] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T18:31:19.317773] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-22T18:31:20.475039] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T18:31:20.481809] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-22T18:31:20.572307] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T18:31:20.917733] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-22T18:31:21.616002] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T18:31:21.717820] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-22T18:31:22.615417] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-22T18:31:22.619358] [INFO ] [REMOTE ] EIG: Full fetch complete (27312 records). [2025-10-22T18:31:22.619523] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-22T18:31:23.068790] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-22T18:31:23.133913] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-22T18:31:23.134577] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-22T18:31:23.135141] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-22T18:31:23.134485] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-22T18:31:23.135302] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-22T18:31:23.137218] [DEBUG] [LOCAL ] EIG: Trimmed 27312 records to 20065 (keeping 200 days of data) [2025-10-22T18:31:23.261612] [DEBUG] [LOCAL ] EIG: Primary data saved (20065 records). [2025-10-22T18:31:23.261772] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-22T18:31:23.261854] [INFO ] [MAIN ] Update Progress: 719/2367 symbols completed. EIG took 31.0s. Estimated remaining: 3h 29m 17s. Rate: 7.9 symbols/min [2025-10-22T18:31:25.275008] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T18:31:25.288090] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-22T18:31:27.227879] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T18:31:27.239187] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-22T18:31:29.253500] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T18:31:29.264824] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-22T18:31:30.174018] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T18:31:30.182675] [INFO ] [REMOTE ] EIX: Full fetch complete (77445 records). [2025-10-22T18:31:30.182804] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-22T18:31:30.574463] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-22T18:31:30.574783] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-22T18:31:30.575673] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-22T18:31:30.575736] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-22T18:31:30.577182] [DEBUG] [LOCAL ] EIX: Trimmed 77445 records to 53348 (keeping 200 days of data) [2025-10-22T18:31:30.915349] [DEBUG] [LOCAL ] EIX: Primary data saved (53348 records). [2025-10-22T18:31:30.915504] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-22T18:31:30.915603] [INFO ] [MAIN ] Update Progress: 720/2367 symbols completed. EIX took 21.4s. Estimated remaining: 3h 29m 10s. Rate: 7.9 symbols/min [2025-10-22T18:31:31.474292] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:31.602150] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:31.634768] [DEBUG] [LOCAL ] EL: No existing data file found in primary storage. [2025-10-22T18:31:31.653184] [WARN ] [MAIN ] EL: No existing data found, performing full refresh instead. [2025-10-22T18:31:31.687593] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-22T18:31:31.701086] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-22T18:31:31.716027] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-10-22T18:31:31.740227] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-22T18:31:31.755165] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:31.772687] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:31.803546] [DEBUG] [LOCAL ] ELC: No existing data file found in primary storage. [2025-10-22T18:31:31.839060] [WARN ] [MAIN ] ELC: No existing data found, performing full refresh instead. [2025-10-22T18:31:31.860513] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-22T18:31:31.886139] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-22T18:31:31.886281] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-22T18:31:31.886425] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-22T18:31:32.042975] [DEBUG] [LOCAL ] ELAN: Loaded 53313 existing records from primary storage. [2025-10-22T18:31:32.115931] [INFO ] [MAIN ] ELAN: Loaded 53313 existing records. [2025-10-22T18:31:32.487463] [DEBUG] [LOCAL ] ELF: Loaded 51917 existing records from primary storage. [2025-10-22T18:31:32.518950] [INFO ] [MAIN ] ELF: Loaded 51917 existing records. [2025-10-22T18:31:32.750516] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:31:32.815964] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:32.853173] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-22T18:31:32.852797] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-22T18:31:32.853795] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-22T18:31:32.869432] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-22T18:31:32.874770] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-22T18:31:33.029615] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:31:33.039807] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:33.062022] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-22T18:31:33.071073] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-22T18:31:33.121425] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-22T18:31:33.160431] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-22T18:31:33.253157] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-22T18:31:33.518914] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:33.540358] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-22T18:31:33.781103] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:33.781502] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-22T18:31:33.806508] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-22T18:31:33.807950] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-22T18:31:34.295615] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T18:31:34.296920] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-22T18:31:34.859735] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-22T18:31:34.861083] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-22T18:31:35.041030] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T18:31:35.051488] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-22T18:31:35.214232] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T18:31:35.224800] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-22T18:31:35.424064] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T18:31:35.425819] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-22T18:31:35.912561] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T18:31:35.925027] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-22T18:31:36.051184] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T18:31:36.052745] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-22T18:31:36.440794] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-22T18:31:36.442459] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-22T18:31:36.858598] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:31:36.868976] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-22T18:31:36.885407] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T18:31:36.913114] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T18:31:36.925164] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-22T18:31:37.485521] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T18:31:37.717709] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-22T18:31:38.130949] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-22T18:31:38.517709] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-22T18:31:38.818616] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T18:31:39.317692] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-22T18:31:39.806783] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T18:31:39.809166] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-22T18:31:40.117709] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-22T18:31:40.473192] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T18:31:40.917680] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-22T18:31:41.522220] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T18:31:41.523317] [INFO ] [REMOTE ] ELC: Full fetch complete (4925 records). [2025-10-22T18:31:41.523386] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-22T18:31:41.718705] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-22T18:31:41.899570] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-22T18:31:41.899736] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-22T18:31:41.899897] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-22T18:31:41.899961] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-22T18:31:41.900336] [DEBUG] [LOCAL ] ELC: Trimmed 4925 records to 3431 (keeping 200 days of data) [2025-10-22T18:31:41.921079] [DEBUG] [LOCAL ] ELC: Primary data saved (3431 records). [2025-10-22T18:31:41.921142] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-22T18:31:41.921202] [INFO ] [MAIN ] Update Progress: 721/2367 symbols completed. ELC took 11.0s. Estimated remaining: 3h 29m 10s. Rate: 7.9 symbols/min [2025-10-22T18:31:42.100746] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:42.100879] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-22T18:31:42.100916] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-22T18:31:42.101056] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-22T18:31:42.101113] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-22T18:31:42.101157] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-22T18:31:42.101189] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-22T18:31:42.490814] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:42.492984] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-22T18:31:42.517604] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-22T18:31:43.317696] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-22T18:31:43.911490] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T18:31:44.117684] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-22T18:31:44.209492] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T18:31:44.813554] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T18:31:44.917676] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-22T18:31:45.717616] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-22T18:31:45.952634] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T18:31:46.021495] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T18:31:46.517700] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-22T18:31:47.317690] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-22T18:31:47.832027] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-22T18:31:48.117709] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-22T18:31:48.855008] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-22T18:31:48.917754] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-22T18:31:49.163151] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:31:49.717707] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-22T18:31:50.296597] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-22T18:31:50.413326] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T18:31:50.517732] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-22T18:31:51.317728] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-22T18:31:51.844901] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T18:31:52.117687] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-22T18:31:52.196900] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T18:31:52.917756] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-22T18:31:53.474017] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T18:31:53.717740] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-22T18:31:54.254425] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T18:31:54.379113] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T18:31:54.517718] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-22T18:31:55.324158] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-22T18:31:55.349823] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T18:31:56.117760] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-22T18:31:56.569690] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-22T18:31:56.901355] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T18:31:56.917623] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-22T18:31:57.717717] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-22T18:31:58.239337] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T18:31:58.429604] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T18:31:58.517749] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-22T18:31:59.317690] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-22T18:31:59.584385] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T18:32:00.117713] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-22T18:32:00.557930] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T18:32:00.917765] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-22T18:32:01.494555] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T18:32:01.717772] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-22T18:32:01.792807] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T18:32:02.517721] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-22T18:32:02.990432] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T18:32:02.999053] [INFO ] [REMOTE ] ELF: Full fetch complete (75145 records). [2025-10-22T18:32:02.999228] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-22T18:32:03.000046] [FATAL] [VALIDATOR ] ELF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:03.000150] [FATAL] [MAIN ] ELF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:03.000226] [WARN ] [MAIN ] ELF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:03.000302] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-22T18:32:03.000374] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-22T18:32:03.000414] [INFO ] [LOCAL ] ELF: Starting deletion of derivative data. [2025-10-22T18:32:03.000573] [DEBUG] [LOCAL ] ELF: Deleted derivative data file. [2025-10-22T18:32:03.000693] [INFO ] [MAIN ] Update Progress: 722/2367 symbols completed. ELF took 32.1s. Estimated remaining: 3h 29m 33s. Rate: 7.9 symbols/min [2025-10-22T18:32:03.181159] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:03.181370] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-10-22T18:32:03.181419] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-10-22T18:32:03.181900] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-22T18:32:03.182066] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-22T18:32:03.182234] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-22T18:32:03.182302] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-22T18:32:03.337396] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-22T18:32:03.437873] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:32:03.638867] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:03.668952] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T18:32:03.678958] [INFO ] [REMOTE ] EL: Full fetch complete (77439 records). [2025-10-22T18:32:03.679150] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-22T18:32:04.093691] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-22T18:32:04.093789] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-22T18:32:04.094676] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-22T18:32:04.094744] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-22T18:32:04.096217] [DEBUG] [LOCAL ] EL: Trimmed 77439 records to 53385 (keeping 200 days of data) [2025-10-22T18:32:04.151533] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-22T18:32:04.443927] [DEBUG] [LOCAL ] EL: Primary data saved (53385 records). [2025-10-22T18:32:04.444127] [INFO ] [MAIN ] EL: Full history saved. [2025-10-22T18:32:04.444250] [INFO ] [MAIN ] Update Progress: 723/2367 symbols completed. EL took 33.5s. Estimated remaining: 3h 29m 11s. Rate: 7.9 symbols/min [2025-10-22T18:32:04.628436] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:04.628694] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-22T18:32:04.628750] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-22T18:32:04.628863] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-22T18:32:04.628905] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-22T18:32:04.628947] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-22T18:32:04.628979] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-22T18:32:04.930330] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-22T18:32:05.054684] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:05.271283] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T18:32:05.471834] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T18:32:05.717735] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-22T18:32:06.285982] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T18:32:06.517742] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-22T18:32:06.676820] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:32:06.684317] [INFO ] [REMOTE ] ELME: Full fetch complete (56078 records). [2025-10-22T18:32:06.684517] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-22T18:32:07.062562] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-22T18:32:07.062663] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-22T18:32:07.063408] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-22T18:32:07.063452] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-22T18:32:07.064666] [DEBUG] [LOCAL ] ELME: Trimmed 56078 records to 39292 (keeping 200 days of data) [2025-10-22T18:32:07.307737] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T18:32:07.317891] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-22T18:32:07.333933] [DEBUG] [LOCAL ] ELME: Primary data saved (39292 records). [2025-10-22T18:32:07.334065] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-22T18:32:07.334159] [INFO ] [MAIN ] Update Progress: 724/2367 symbols completed. ELME took 25.4s. Estimated remaining: 3h 28m 53s. Rate: 7.9 symbols/min [2025-10-22T18:32:07.506333] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:07.506519] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-10-22T18:32:07.506556] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-10-22T18:32:07.506694] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-22T18:32:07.506746] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-22T18:32:07.506788] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-22T18:32:07.506819] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-22T18:32:07.850025] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:08.117719] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-22T18:32:08.917740] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-22T18:32:09.206407] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T18:32:09.252178] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:32:09.263892] [INFO ] [REMOTE ] ELAN: Full fetch complete (77098 records). [2025-10-22T18:32:09.264131] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-22T18:32:09.720519] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-22T18:32:09.841460] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-22T18:32:09.841574] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-22T18:32:09.842614] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-22T18:32:09.842708] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-22T18:32:09.844469] [DEBUG] [LOCAL ] ELAN: Trimmed 77098 records to 53314 (keeping 200 days of data) [2025-10-22T18:32:10.107875] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-22T18:32:10.231130] [DEBUG] [LOCAL ] ELAN: Primary data saved (53314 records). [2025-10-22T18:32:10.231334] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-22T18:32:10.231452] [INFO ] [MAIN ] Update Progress: 725/2367 symbols completed. ELAN took 39.3s. Estimated remaining: 3h 28m 35s. Rate: 7.9 symbols/min [2025-10-22T18:32:10.444125] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:10.444357] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-10-22T18:32:10.444402] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-10-22T18:32:10.444743] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-22T18:32:10.444800] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-22T18:32:10.444845] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-22T18:32:10.444879] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-22T18:32:10.522793] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-22T18:32:10.855111] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:10.857980] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T18:32:10.894246] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-22T18:32:11.320702] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-22T18:32:11.772952] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T18:32:12.117696] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-22T18:32:12.917705] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-22T18:32:13.346613] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-22T18:32:13.717718] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-22T18:32:14.083329] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-22T18:32:14.523106] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-22T18:32:14.537228] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:32:14.873203] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T18:32:15.317731] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-22T18:32:16.117879] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-22T18:32:16.696682] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-22T18:32:16.911506] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T18:32:16.920898] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-22T18:32:17.230383] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-22T18:32:17.717697] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-22T18:32:18.517724] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-22T18:32:18.758848] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-22T18:32:19.317715] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-22T18:32:19.648626] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T18:32:20.117725] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-22T18:32:20.460591] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-22T18:32:20.461475] [INFO ] [REMOTE ] ELPC: Full fetch complete (1348 records). [2025-10-22T18:32:20.461557] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-22T18:32:20.462045] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:20.462134] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:20.462217] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:20.462301] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-22T18:32:20.462374] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-22T18:32:20.462416] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-22T18:32:20.462463] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-22T18:32:20.462524] [INFO ] [MAIN ] Update Progress: 726/2367 symbols completed. ELPC took 16.0s. Estimated remaining: 3h 28m 33s. Rate: 7.9 symbols/min [2025-10-22T18:32:20.632092] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:20.632236] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-22T18:32:20.632272] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-22T18:32:20.632390] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-22T18:32:20.632455] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-22T18:32:20.632513] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-22T18:32:20.632565] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-22T18:32:20.922884] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-22T18:32:20.999068] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:21.153574] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T18:32:21.717735] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-22T18:32:22.517728] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-22T18:32:22.667240] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:32:23.067878] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T18:32:23.317741] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-22T18:32:23.860221] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T18:32:24.117615] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-22T18:32:24.153303] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T18:32:24.416269] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:32:24.416630] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-22T18:32:24.416784] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:32:24.416837] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-22T18:32:24.416877] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:32:24.416952] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-22T18:32:24.417045] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-22T18:32:24.417089] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-22T18:32:24.417138] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-22T18:32:24.417192] [INFO ] [MAIN ] Update Progress: 727/2367 symbols completed. EMA took 4.0s. Estimated remaining: 3h 28m 17s. Rate: 7.9 symbols/min [2025-10-22T18:32:24.620023] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:24.638838] [DEBUG] [LOCAL ] EMD: Loaded 20913 existing records from primary storage. [2025-10-22T18:32:24.639099] [INFO ] [MAIN ] EMD: Loaded 20913 existing records. [2025-10-22T18:32:24.852536] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:32:24.852779] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-22T18:32:24.852827] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-22T18:32:24.853915] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-22T18:32:24.853972] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-22T18:32:24.923055] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-22T18:32:25.250560] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:25.717744] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-22T18:32:26.517624] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-22T18:32:26.978684] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:32:27.197599] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-22T18:32:27.317678] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-22T18:32:27.894745] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T18:32:28.117729] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-22T18:32:28.144428] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T18:32:28.917695] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-22T18:32:29.717696] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-22T18:32:30.068612] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T18:32:30.242763] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T18:32:30.517696] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-22T18:32:31.317686] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-22T18:32:32.117838] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-22T18:32:32.210436] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-22T18:32:32.620427] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T18:32:32.917727] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-22T18:32:33.106238] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-22T18:32:33.717705] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-22T18:32:34.104194] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T18:32:34.139524] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T18:32:34.517733] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-22T18:32:35.317696] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-22T18:32:35.357555] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T18:32:36.058935] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T18:32:36.117685] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-22T18:32:36.527182] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T18:32:36.917698] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-22T18:32:37.717802] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-22T18:32:37.957285] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:32:37.961189] [INFO ] [REMOTE ] ELP: Full fetch complete (36643 records). [2025-10-22T18:32:37.961272] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-22T18:32:37.961791] [FATAL] [VALIDATOR ] ELP: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:37.961876] [FATAL] [MAIN ] ELP: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:37.961921] [WARN ] [MAIN ] ELP: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:37.961963] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-22T18:32:37.962020] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-22T18:32:37.962057] [INFO ] [LOCAL ] ELP: Starting deletion of derivative data. [2025-10-22T18:32:37.962148] [DEBUG] [LOCAL ] ELP: No derivative data file found to delete. [2025-10-22T18:32:37.962210] [INFO ] [MAIN ] Update Progress: 728/2367 symbols completed. ELP took 35.0s. Estimated remaining: 3h 28m 23s. Rate: 7.9 symbols/min [2025-10-22T18:32:38.129291] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:38.157950] [DEBUG] [LOCAL ] EME: Loaded 30734 existing records from primary storage. [2025-10-22T18:32:38.158235] [INFO ] [MAIN ] EME: Loaded 30734 existing records. [2025-10-22T18:32:38.338401] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:32:38.338636] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-22T18:32:38.338730] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-22T18:32:38.339233] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-22T18:32:38.339293] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-22T18:32:38.522722] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-22T18:32:38.703086] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:38.825592] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T18:32:39.317675] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-22T18:32:39.426761] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-22T18:32:40.117741] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-22T18:32:40.798543] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T18:32:40.917713] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-22T18:32:41.588843] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (3.07 seconds). [2025-10-22T18:32:41.717706] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-22T18:32:42.517625] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-22T18:32:42.768248] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-22T18:32:42.798223] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T18:32:43.317725] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-22T18:32:43.614965] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T18:32:44.117696] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-22T18:32:44.514572] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-22T18:32:44.917718] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-22T18:32:45.269684] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T18:32:45.717625] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-22T18:32:45.821195] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:32:46.517781] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-22T18:32:47.172301] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-22T18:32:47.180532] [INFO ] [REMOTE ] ELS: Full fetch complete (70919 records). [2025-10-22T18:32:47.180736] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-22T18:32:47.181580] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:47.181731] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:47.181823] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:47.181918] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-22T18:32:47.182002] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-22T18:32:47.182041] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-10-22T18:32:47.182084] [DEBUG] [LOCAL ] ELS: No derivative data file found to delete. [2025-10-22T18:32:47.182145] [INFO ] [MAIN ] Update Progress: 729/2367 symbols completed. ELS took 39.8s. Estimated remaining: 3h 28m 19s. Rate: 7.9 symbols/min [2025-10-22T18:32:47.325670] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-22T18:32:47.358681] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:47.363971] [DEBUG] [LOCAL ] EMF: Loaded 3131 existing records from primary storage. [2025-10-22T18:32:47.364143] [INFO ] [MAIN ] EMF: Loaded 3131 existing records. [2025-10-22T18:32:47.546454] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:32:47.546780] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-22T18:32:47.546889] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-22T18:32:47.547103] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-22T18:32:47.547172] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-22T18:32:47.738707] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T18:32:47.814768] [INFO ] [REMOTE ] ELV: Full fetch complete (72946 records). [2025-10-22T18:32:47.846800] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-22T18:32:47.873481] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:47.889245] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:47.894425] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:47.913032] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-22T18:32:47.923498] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-22T18:32:47.926436] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-10-22T18:32:47.934174] [DEBUG] [LOCAL ] ELV: No derivative data file found to delete. [2025-10-22T18:32:47.934274] [INFO ] [MAIN ] Update Progress: 730/2367 symbols completed. ELV took 37.7s. Estimated remaining: 3h 27m 56s. Rate: 7.9 symbols/min [2025-10-22T18:32:47.997266] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:48.127355] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:48.123532] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-22T18:32:48.174849] [DEBUG] [LOCAL ] EMN: Loaded 50825 existing records from primary storage. [2025-10-22T18:32:48.175250] [INFO ] [MAIN ] EMN: Loaded 50825 existing records. [2025-10-22T18:32:48.303891] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T18:32:48.387918] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:32:48.388127] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-22T18:32:48.388180] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-22T18:32:48.388365] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-22T18:32:48.388420] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-22T18:32:48.699020] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T18:32:48.764489] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:48.916378] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T18:32:48.918280] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-22T18:32:49.717690] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-22T18:32:50.235869] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T18:32:50.240398] [INFO ] [REMOTE ] EMD: Full fetch complete (31859 records). [2025-10-22T18:32:50.240568] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-22T18:32:50.241157] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:50.241245] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:50.241287] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:50.241326] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-22T18:32:50.241426] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-22T18:32:50.241468] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-10-22T18:32:50.241610] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-10-22T18:32:50.241724] [INFO ] [MAIN ] Update Progress: 731/2367 symbols completed. EMD took 25.8s. Estimated remaining: 3h 27m 36s. Rate: 7.9 symbols/min [2025-10-22T18:32:50.409518] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:50.423400] [DEBUG] [LOCAL ] EMO: Loaded 13345 existing records from primary storage. [2025-10-22T18:32:50.423587] [INFO ] [MAIN ] EMO: Loaded 13345 existing records. [2025-10-22T18:32:50.525575] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-22T18:32:50.528769] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T18:32:50.607600] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:32:50.610809] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-22T18:32:50.610882] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-22T18:32:50.611060] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-22T18:32:50.611114] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-22T18:32:50.960042] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:51.317620] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-22T18:32:51.994907] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T18:32:52.117685] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-22T18:32:52.168217] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T18:32:52.909019] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T18:32:52.917600] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-22T18:32:53.717624] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-22T18:32:53.779682] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T18:32:54.519695] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-22T18:32:54.521559] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T18:32:55.317697] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-22T18:32:55.845074] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-22T18:32:56.117690] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-22T18:32:56.523547] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T18:32:56.917717] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-22T18:32:57.717699] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-22T18:32:58.270577] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T18:32:58.397474] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-22T18:32:58.517706] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-22T18:32:59.171720] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-22T18:32:59.317709] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-22T18:33:00.117755] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-22T18:33:00.213090] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:33:00.823199] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:33:00.823800] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T18:33:00.917693] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-22T18:33:01.717709] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-22T18:33:02.522250] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-22T18:33:02.526367] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T18:33:03.317709] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-22T18:33:03.348038] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T18:33:03.582476] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T18:33:03.877214] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T18:33:04.117691] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-22T18:33:04.917722] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-22T18:33:04.936420] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T18:33:05.513165] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:33:05.717708] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-22T18:33:06.508574] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T18:33:06.517602] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-22T18:33:07.134339] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-22T18:33:07.135379] [INFO ] [REMOTE ] EMF: Full fetch complete (6089 records). [2025-10-22T18:33:07.135446] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-22T18:33:07.327160] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-22T18:33:07.484532] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-22T18:33:07.484605] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-22T18:33:07.484788] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-22T18:33:07.484849] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-22T18:33:07.485201] [DEBUG] [LOCAL ] EMF: Trimmed 6089 records to 3081 (keeping 200 days of data) [2025-10-22T18:33:07.503714] [DEBUG] [LOCAL ] EMF: Primary data saved (3081 records). [2025-10-22T18:33:07.503786] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-22T18:33:07.503853] [INFO ] [MAIN ] Update Progress: 732/2367 symbols completed. EMF took 20.3s. Estimated remaining: 3h 27m 50s. Rate: 7.9 symbols/min [2025-10-22T18:33:07.673301] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:07.673472] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-10-22T18:33:07.673520] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-10-22T18:33:07.673634] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-22T18:33:07.673715] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-22T18:33:07.673764] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-22T18:33:07.673802] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-22T18:33:08.014302] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:08.117624] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-22T18:33:08.589537] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-22T18:33:08.917708] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-22T18:33:09.428615] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-22T18:33:09.717617] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-22T18:33:10.070497] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T18:33:10.517714] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-22T18:33:11.317619] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-22T18:33:11.357592] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T18:33:11.389310] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T18:33:11.770250] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T18:33:12.117684] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-22T18:33:12.917810] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-22T18:33:13.385309] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T18:33:13.717675] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-22T18:33:14.170093] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T18:33:14.517625] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-22T18:33:14.872029] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T18:33:15.317677] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-22T18:33:16.117721] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-22T18:33:16.161101] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:33:16.371755] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T18:33:16.638237] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T18:33:16.917729] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-22T18:33:17.717747] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-22T18:33:18.475785] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T18:33:18.480844] [INFO ] [REMOTE ] EME: Full fetch complete (47067 records). [2025-10-22T18:33:18.480927] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-22T18:33:18.522871] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-22T18:33:18.787302] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T18:33:18.811019] [INFO ] [REMOTE ] EMO: Full fetch complete (17601 records). [2025-10-22T18:33:18.829712] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-22T18:33:18.850362] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:33:18.850944] [FATAL] [MAIN ] EMO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:33:18.871257] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:33:18.880352] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-22T18:33:18.882837] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-22T18:33:18.883056] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-22T18:33:18.882987] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-10-22T18:33:18.883204] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-22T18:33:18.884039] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-22T18:33:18.884122] [DEBUG] [LOCAL ] EMO: Deleted derivative data file. [2025-10-22T18:33:18.884320] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-22T18:33:18.884256] [INFO ] [MAIN ] Update Progress: 733/2367 symbols completed. EMO took 28.6s. Estimated remaining: 3h 27m 51s. Rate: 7.9 symbols/min [2025-10-22T18:33:18.987333] [DEBUG] [LOCAL ] EME: Trimmed 47067 records to 30650 (keeping 200 days of data) [2025-10-22T18:33:19.186911] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:19.193305] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T18:33:19.302241] [DEBUG] [LOCAL ] EME: Primary data saved (30650 records). [2025-10-22T18:33:19.302439] [INFO ] [MAIN ] EME: Full history saved. [2025-10-22T18:33:19.302541] [INFO ] [MAIN ] Update Progress: 734/2367 symbols completed. EME took 41.3s. Estimated remaining: 3h 27m 27s. Rate: 7.9 symbols/min [2025-10-22T18:33:19.324052] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-22T18:33:19.426987] [DEBUG] [LOCAL ] EMR: Loaded 53171 existing records from primary storage. [2025-10-22T18:33:19.443048] [INFO ] [MAIN ] EMR: Loaded 53171 existing records. [2025-10-22T18:33:19.599186] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:19.680218] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:33:19.680483] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-22T18:33:19.680534] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-22T18:33:19.680838] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-22T18:33:19.680937] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-22T18:33:19.914635] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T18:33:20.014945] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-22T18:33:20.026038] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-22T18:33:20.124345] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-22T18:33:20.189373] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:20.282910] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:33:20.283101] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-22T18:33:20.283147] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-22T18:33:20.283334] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-22T18:33:20.283371] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-22T18:33:20.625065] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:20.917709] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-22T18:33:21.717685] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-22T18:33:22.035258] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T18:33:22.517695] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-22T18:33:22.801292] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T18:33:23.317733] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-22T18:33:23.693243] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T18:33:24.117693] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-22T18:33:24.288633] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T18:33:24.524676] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T18:33:24.917711] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-22T18:33:25.717732] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-22T18:33:25.927114] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T18:33:26.517687] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-22T18:33:26.639374] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:33:27.317693] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-22T18:33:27.349231] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T18:33:27.638973] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T18:33:28.117733] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-22T18:33:28.917733] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-22T18:33:29.113940] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T18:33:29.379710] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T18:33:29.717683] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-22T18:33:30.011688] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T18:33:30.019404] [INFO ] [REMOTE ] EMN: Full fetch complete (72040 records). [2025-10-22T18:33:30.019521] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-22T18:33:30.020296] [FATAL] [VALIDATOR ] EMN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:33:30.020425] [FATAL] [MAIN ] EMN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:33:30.020492] [WARN ] [MAIN ] EMN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:33:30.020571] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-22T18:33:30.020668] [DEBUG] [LOCAL ] EMN: No primary data file found to delete. [2025-10-22T18:33:30.020727] [INFO ] [LOCAL ] EMN: Starting deletion of derivative data. [2025-10-22T18:33:30.020846] [DEBUG] [LOCAL ] EMN: Deleted derivative data file. [2025-10-22T18:33:30.020915] [INFO ] [MAIN ] Update Progress: 735/2367 symbols completed. EMN took 42.1s. Estimated remaining: 3h 27m 26s. Rate: 7.9 symbols/min [2025-10-22T18:33:30.187861] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:30.188014] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-10-22T18:33:30.188053] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-10-22T18:33:30.188163] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-22T18:33:30.188206] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-22T18:33:30.188248] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-22T18:33:30.188281] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-22T18:33:30.317103] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:33:30.529184] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-22T18:33:30.548984] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:31.129563] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T18:33:31.130503] [INFO ] [REMOTE ] EMP: Full fetch complete (4061 records). [2025-10-22T18:33:31.130572] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-22T18:33:31.326352] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-22T18:33:31.492894] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-22T18:33:31.492974] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-22T18:33:31.493117] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-22T18:33:31.493157] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-22T18:33:31.493502] [DEBUG] [LOCAL ] EMP: Trimmed 4061 records to 2888 (keeping 200 days of data) [2025-10-22T18:33:31.511288] [DEBUG] [LOCAL ] EMP: Primary data saved (2888 records). [2025-10-22T18:33:31.511356] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-22T18:33:31.511414] [INFO ] [MAIN ] Update Progress: 736/2367 symbols completed. EMP took 24.0s. Estimated remaining: 3h 27m 5s. Rate: 7.9 symbols/min [2025-10-22T18:33:31.678600] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:31.678775] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-22T18:33:31.678819] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-22T18:33:31.678954] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-22T18:33:31.679012] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-22T18:33:31.679057] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-22T18:33:31.679092] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-22T18:33:32.039307] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:32.117692] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-22T18:33:32.671217] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-22T18:33:32.919624] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-22T18:33:32.924074] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:33:33.717682] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-22T18:33:34.237171] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T18:33:34.517678] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-22T18:33:34.768730] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T18:33:35.317689] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-22T18:33:35.745314] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T18:33:36.117712] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-22T18:33:36.582712] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T18:33:36.917671] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-22T18:33:37.193450] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T18:33:37.717756] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-22T18:33:38.307873] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-22T18:33:38.329595] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T18:33:38.517775] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-22T18:33:39.317732] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-22T18:33:40.117726] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-22T18:33:40.409927] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T18:33:40.729396] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T18:33:40.917789] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-22T18:33:41.717890] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-22T18:33:42.002478] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T18:33:42.410570] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:33:42.517624] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-22T18:33:43.317681] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-22T18:33:43.539465] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:33:43.864425] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:33:44.117718] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-22T18:33:44.799978] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T18:33:44.917684] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-22T18:33:45.717705] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-22T18:33:46.354350] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T18:33:46.517699] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-22T18:33:46.665719] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-22T18:33:47.060549] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-22T18:33:47.317711] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-22T18:33:47.791606] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T18:33:47.946155] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T18:33:48.117711] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-22T18:33:48.917689] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-22T18:33:49.449048] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-22T18:33:49.514327] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T18:33:49.717724] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-22T18:33:50.517733] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-22T18:33:51.152281] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T18:33:51.317703] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-22T18:33:52.117698] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-22T18:33:52.354445] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T18:33:52.790607] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T18:33:52.796208] [INFO ] [REMOTE ] ENIC: Full fetch complete (51296 records). [2025-10-22T18:33:52.796334] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-22T18:33:52.922926] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-22T18:33:53.234547] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-22T18:33:53.234674] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-22T18:33:53.235593] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-22T18:33:53.235656] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-22T18:33:53.236963] [DEBUG] [LOCAL ] ENIC: Trimmed 51296 records to 36415 (keeping 200 days of data) [2025-10-22T18:33:53.461787] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-22T18:33:53.466086] [DEBUG] [LOCAL ] ENIC: Primary data saved (36415 records). [2025-10-22T18:33:53.467872] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-22T18:33:53.467984] [INFO ] [MAIN ] Update Progress: 737/2367 symbols completed. ENIC took 23.4s. Estimated remaining: 3h 27m 29s. Rate: 7.9 symbols/min [2025-10-22T18:33:53.647837] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:53.648032] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-10-22T18:33:53.648089] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-10-22T18:33:53.648228] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-22T18:33:53.648289] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-22T18:33:53.648337] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-22T18:33:53.648371] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-22T18:33:53.718597] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-22T18:33:54.020349] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:54.054280] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T18:33:54.517730] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-22T18:33:55.317718] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-22T18:33:55.347490] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T18:33:55.355826] [INFO ] [REMOTE ] EMR: Full fetch complete (76831 records). [2025-10-22T18:33:55.356001] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-22T18:33:55.356916] [FATAL] [VALIDATOR ] EMR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:33:55.357035] [FATAL] [MAIN ] EMR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:33:55.357078] [WARN ] [MAIN ] EMR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:33:55.357170] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-22T18:33:55.357239] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-22T18:33:55.357274] [INFO ] [LOCAL ] EMR: Starting deletion of derivative data. [2025-10-22T18:33:55.357393] [DEBUG] [LOCAL ] EMR: Deleted derivative data file. [2025-10-22T18:33:55.357470] [INFO ] [MAIN ] Update Progress: 738/2367 symbols completed. EMR took 36.5s. Estimated remaining: 3h 27m 9s. Rate: 7.9 symbols/min [2025-10-22T18:33:55.525838] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:55.565015] [DEBUG] [LOCAL ] ENR: Loaded 43882 existing records from primary storage. [2025-10-22T18:33:55.565283] [INFO ] [MAIN ] ENR: Loaded 43882 existing records. [2025-10-22T18:33:55.735988] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:33:55.736217] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-22T18:33:55.736264] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-22T18:33:55.736477] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-22T18:33:55.736532] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-22T18:33:56.096145] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:56.117679] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-22T18:33:56.179010] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T18:33:56.917736] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-22T18:33:57.149695] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T18:33:57.717670] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-22T18:33:57.795309] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T18:33:58.517721] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-22T18:33:58.766169] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T18:33:58.940874] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-22T18:33:59.109212] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:33:59.317710] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-22T18:34:00.117712] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-22T18:34:00.917723] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-22T18:34:01.559375] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T18:34:01.560291] [INFO ] [REMOTE ] ENO: Full fetch complete (2991 records). [2025-10-22T18:34:01.560362] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-22T18:34:01.721409] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-22T18:34:01.990388] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-22T18:34:01.990911] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-22T18:34:01.991092] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-22T18:34:01.992909] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-22T18:34:01.992822] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-22T18:34:02.002091] [DEBUG] [LOCAL ] ENO: Trimmed 2991 records to 1737 (keeping 200 days of data) [2025-10-22T18:34:02.014163] [DEBUG] [LOCAL ] ENO: Primary data saved (1737 records). [2025-10-22T18:34:02.014232] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-22T18:34:02.014298] [INFO ] [MAIN ] Update Progress: 739/2367 symbols completed. ENO took 30.5s. Estimated remaining: 3h 26m 59s. Rate: 7.9 symbols/min [2025-10-22T18:34:02.190292] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:02.219682] [DEBUG] [LOCAL ] ENS: Loaded 29741 existing records from primary storage. [2025-10-22T18:34:02.219950] [INFO ] [MAIN ] ENS: Loaded 29741 existing records. [2025-10-22T18:34:02.393141] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:02.393348] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-22T18:34:02.393399] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-22T18:34:02.393588] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-22T18:34:02.393676] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-22T18:34:02.529153] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-22T18:34:02.744311] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:03.317715] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-22T18:34:05.573600] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (3.85 seconds). [2025-10-22T18:34:05.580901] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-22T18:34:06.200853] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-22T18:34:06.206402] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-22T18:34:07.328823] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (6.41 seconds). [2025-10-22T18:34:07.337521] [INFO ] [REMOTE ] ENB: Full fetch complete (77662 records). [2025-10-22T18:34:07.337700] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-22T18:34:07.728997] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-22T18:34:07.729076] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-22T18:34:07.729936] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-22T18:34:07.729999] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-22T18:34:07.731375] [DEBUG] [LOCAL ] ENB: Trimmed 77662 records to 53511 (keeping 200 days of data) [2025-10-22T18:34:08.054079] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-10-22T18:34:08.054211] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-22T18:34:08.054292] [INFO ] [MAIN ] Update Progress: 740/2367 symbols completed. ENB took 48.8s. Estimated remaining: 3h 26m 48s. Rate: 7.9 symbols/min [2025-10-22T18:34:08.218899] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:08.244254] [DEBUG] [LOCAL ] ENVA: Loaded 25267 existing records from primary storage. [2025-10-22T18:34:08.244496] [INFO ] [MAIN ] ENVA: Loaded 25267 existing records. [2025-10-22T18:34:08.419549] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:08.419863] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-22T18:34:08.419992] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-22T18:34:08.420251] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-22T18:34:08.420323] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-22T18:34:08.534093] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (6.00 seconds). [2025-10-22T18:34:08.554139] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-22T18:34:08.828256] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:08.828619] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-22T18:34:09.493713] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (3.91 seconds). [2025-10-22T18:34:09.502903] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-22T18:34:09.614630] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (3.41 seconds). [2025-10-22T18:34:09.622218] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-22T18:34:11.244243] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-22T18:34:11.253885] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-22T18:34:11.467973] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T18:34:11.474393] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-22T18:34:11.517305] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-22T18:34:11.522049] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-22T18:34:12.049457] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-22T18:34:12.058621] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-22T18:34:12.700202] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T18:34:12.706791] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-22T18:34:12.826579] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T18:34:12.864076] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T18:34:12.917674] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-22T18:34:13.401497] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T18:34:13.468970] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T18:34:13.717700] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-22T18:34:14.332844] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:34:14.517686] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-22T18:34:15.036576] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T18:34:15.317709] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-22T18:34:16.116583] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T18:34:16.125887] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-22T18:34:16.917679] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-22T18:34:17.341369] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T18:34:17.620629] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:34:17.717753] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-22T18:34:18.446889] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:34:18.517691] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-22T18:34:19.317621] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-22T18:34:19.388579] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T18:34:19.758561] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T18:34:20.117677] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-22T18:34:20.394129] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:34:20.917685] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-22T18:34:21.438567] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T18:34:21.717701] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-22T18:34:22.170447] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T18:34:22.517725] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-22T18:34:23.081262] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T18:34:23.317702] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-22T18:34:23.855629] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T18:34:24.117706] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-22T18:34:24.924385] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-22T18:34:24.925532] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T18:34:24.932856] [INFO ] [REMOTE ] ENOV: Full fetch complete (63077 records). [2025-10-22T18:34:24.933002] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-22T18:34:24.933956] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:34:24.934052] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:34:24.934098] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:34:24.934139] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-22T18:34:24.934196] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-22T18:34:24.934232] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-10-22T18:34:24.934273] [DEBUG] [LOCAL ] ENOV: No derivative data file found to delete. [2025-10-22T18:34:24.934334] [INFO ] [MAIN ] Update Progress: 741/2367 symbols completed. ENOV took 31.5s. Estimated remaining: 3h 27m 1s. Rate: 7.9 symbols/min [2025-10-22T18:34:25.108983] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:25.124821] [DEBUG] [LOCAL ] EOD: Loaded 15024 existing records from primary storage. [2025-10-22T18:34:25.125031] [INFO ] [MAIN ] EOD: Loaded 15024 existing records. [2025-10-22T18:34:25.303224] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:25.303453] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-22T18:34:25.303505] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-22T18:34:25.303688] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-22T18:34:25.303744] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-22T18:34:25.665353] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:25.693080] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T18:34:25.717617] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-22T18:34:25.850147] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T18:34:26.517722] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-22T18:34:27.021312] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T18:34:27.317692] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-22T18:34:28.003738] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T18:34:28.117673] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-22T18:34:28.237514] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T18:34:28.917681] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-22T18:34:29.281119] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T18:34:29.717733] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-22T18:34:30.517734] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-22T18:34:30.563588] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T18:34:30.606505] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T18:34:30.613539] [INFO ] [REMOTE ] ENR: Full fetch complete (59703 records). [2025-10-22T18:34:30.613701] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-22T18:34:30.997266] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-22T18:34:30.997335] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-22T18:34:30.998171] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-22T18:34:30.998237] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-22T18:34:30.999504] [DEBUG] [LOCAL ] ENR: Trimmed 59703 records to 43819 (keeping 200 days of data) [2025-10-22T18:34:31.260447] [DEBUG] [LOCAL ] ENR: Primary data saved (43819 records). [2025-10-22T18:34:31.260570] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-22T18:34:31.260666] [INFO ] [MAIN ] Update Progress: 742/2367 symbols completed. ENR took 35.9s. Estimated remaining: 3h 26m 50s. Rate: 7.9 symbols/min [2025-10-22T18:34:31.327021] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-22T18:34:31.438522] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:31.489306] [DEBUG] [LOCAL ] EOG: Loaded 53390 existing records from primary storage. [2025-10-22T18:34:31.489626] [INFO ] [MAIN ] EOG: Loaded 53390 existing records. [2025-10-22T18:34:31.666944] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:31.667152] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-22T18:34:31.667200] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-22T18:34:31.667385] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-22T18:34:31.667424] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-22T18:34:32.011134] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T18:34:32.098092] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:32.117713] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-22T18:34:32.858375] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:34:32.863744] [INFO ] [REMOTE ] ENS: Full fetch complete (42573 records). [2025-10-22T18:34:32.864035] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-22T18:34:32.864584] [FATAL] [VALIDATOR ] ENS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:34:32.864691] [FATAL] [MAIN ] ENS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:34:32.864758] [WARN ] [MAIN ] ENS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:34:32.864829] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-22T18:34:32.864892] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-22T18:34:32.864927] [INFO ] [LOCAL ] ENS: Starting deletion of derivative data. [2025-10-22T18:34:32.865079] [DEBUG] [LOCAL ] ENS: Deleted derivative data file. [2025-10-22T18:34:32.865163] [INFO ] [MAIN ] Update Progress: 743/2367 symbols completed. ENS took 30.9s. Estimated remaining: 3h 26m 29s. Rate: 7.9 symbols/min [2025-10-22T18:34:32.936669] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-22T18:34:32.997719] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T18:34:33.046731] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:33.057974] [DEBUG] [LOCAL ] EOI: Loaded 10545 existing records from primary storage. [2025-10-22T18:34:33.058150] [INFO ] [MAIN ] EOI: Loaded 10545 existing records. [2025-10-22T18:34:33.233809] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:33.234032] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-22T18:34:33.234096] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-22T18:34:33.234264] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-22T18:34:33.234302] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-22T18:34:33.577337] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:33.717717] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-22T18:34:34.517696] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-22T18:34:34.777908] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T18:34:34.809405] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T18:34:35.317698] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-22T18:34:35.809964] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T18:34:35.813963] [INFO ] [REMOTE ] ENVA: Full fetch complete (36595 records). [2025-10-22T18:34:35.814046] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-22T18:34:36.122736] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-22T18:34:36.194988] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-22T18:34:36.200667] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-22T18:34:36.202546] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-22T18:34:36.203440] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T18:34:36.203564] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-22T18:34:36.208629] [DEBUG] [LOCAL ] ENVA: Trimmed 36595 records to 25234 (keeping 200 days of data) [2025-10-22T18:34:36.362453] [DEBUG] [LOCAL ] ENVA: Primary data saved (25234 records). [2025-10-22T18:34:36.362608] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-22T18:34:36.362721] [INFO ] [MAIN ] Update Progress: 744/2367 symbols completed. ENVA took 28.3s. Estimated remaining: 3h 26m 13s. Rate: 7.9 symbols/min [2025-10-22T18:34:36.533184] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:36.549274] [DEBUG] [LOCAL ] EOS: Loaded 14817 existing records from primary storage. [2025-10-22T18:34:36.549523] [INFO ] [MAIN ] EOS: Loaded 14817 existing records. [2025-10-22T18:34:36.724496] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:36.724730] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-22T18:34:36.724784] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-22T18:34:36.724943] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-22T18:34:36.724982] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-22T18:34:36.932564] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-22T18:34:37.082466] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:37.236253] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T18:34:37.717698] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-22T18:34:38.517698] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-22T18:34:38.652315] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T18:34:38.828662] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T18:34:39.074222] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-22T18:34:39.317692] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-22T18:34:40.117670] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-22T18:34:40.277421] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-22T18:34:40.917700] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-22T18:34:41.510396] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T18:34:41.579467] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T18:34:41.717725] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-22T18:34:42.438206] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T18:34:42.517696] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-22T18:34:43.291154] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T18:34:43.317620] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-22T18:34:44.056885] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T18:34:44.117761] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-22T18:34:44.917686] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-22T18:34:45.084258] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T18:34:45.717712] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-22T18:34:46.517729] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-22T18:34:46.761862] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T18:34:46.927188] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T18:34:47.298698] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T18:34:47.317606] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-22T18:34:48.117676] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-22T18:34:48.433353] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T18:34:48.917671] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-22T18:34:49.142715] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T18:34:49.145093] [INFO ] [REMOTE ] EOI: Full fetch complete (16074 records). [2025-10-22T18:34:49.145167] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-22T18:34:49.503063] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-22T18:34:49.503166] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-22T18:34:49.503668] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-22T18:34:49.503730] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-22T18:34:49.504199] [DEBUG] [LOCAL ] EOI: Trimmed 16074 records to 10436 (keeping 200 days of data) [2025-10-22T18:34:49.565915] [DEBUG] [LOCAL ] EOI: Primary data saved (10436 records). [2025-10-22T18:34:49.566047] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-22T18:34:49.566129] [INFO ] [MAIN ] Update Progress: 745/2367 symbols completed. EOI took 16.7s. Estimated remaining: 3h 26m 17s. Rate: 7.9 symbols/min [2025-10-22T18:34:49.733419] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:49.729570] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-22T18:34:49.742474] [DEBUG] [LOCAL ] EOT: Loaded 7050 existing records from primary storage. [2025-10-22T18:34:49.742680] [INFO ] [MAIN ] EOT: Loaded 7050 existing records. [2025-10-22T18:34:49.928164] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:49.938241] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-22T18:34:49.938138] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T18:34:49.938427] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-22T18:34:49.941697] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-22T18:34:49.942432] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-22T18:34:50.302251] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:50.517789] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-22T18:34:50.751808] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T18:34:51.323857] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-22T18:34:51.327154] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T18:34:52.117694] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-22T18:34:52.357872] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-22T18:34:52.917703] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-22T18:34:53.717678] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-22T18:34:53.908807] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T18:34:54.173087] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T18:34:54.517679] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-22T18:34:54.732549] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T18:34:54.735684] [INFO ] [REMOTE ] EOD: Full fetch complete (20733 records). [2025-10-22T18:34:54.735774] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-22T18:34:54.736234] [FATAL] [VALIDATOR ] EOD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:34:54.736335] [FATAL] [MAIN ] EOD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:34:54.736378] [WARN ] [MAIN ] EOD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:34:54.736418] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-22T18:34:54.736473] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-22T18:34:54.736508] [INFO ] [LOCAL ] EOD: Starting deletion of derivative data. [2025-10-22T18:34:54.736814] [DEBUG] [LOCAL ] EOD: Deleted derivative data file. [2025-10-22T18:34:54.736902] [INFO ] [MAIN ] Update Progress: 746/2367 symbols completed. EOD took 29.8s. Estimated remaining: 3h 26m 4s. Rate: 7.9 symbols/min [2025-10-22T18:34:54.915900] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:54.947307] [DEBUG] [LOCAL ] EPAC: Loaded 26483 existing records from primary storage. [2025-10-22T18:34:54.947599] [INFO ] [MAIN ] EPAC: Loaded 26483 existing records. [2025-10-22T18:34:55.124723] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:55.124923] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-22T18:34:55.124970] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-22T18:34:55.125196] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-22T18:34:55.125250] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-22T18:34:55.325530] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-22T18:34:55.509389] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:56.090805] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T18:34:56.117615] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-22T18:34:56.387789] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T18:34:56.514310] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T18:34:56.917699] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-22T18:34:57.717697] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-22T18:34:57.739231] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T18:34:58.517623] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-22T18:34:58.596300] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T18:34:59.132953] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T18:34:59.317722] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-22T18:35:00.117708] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-22T18:35:00.917728] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-22T18:35:01.717765] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-22T18:35:01.890415] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-22T18:35:02.006241] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:35:02.517716] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-22T18:35:03.305793] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T18:35:03.317602] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-22T18:35:03.439818] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-22T18:35:04.117700] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-22T18:35:04.920536] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-22T18:35:05.268894] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-22T18:35:05.671607] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-22T18:35:05.717626] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-22T18:35:06.006320] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T18:35:06.060043] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T18:35:06.517692] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-22T18:35:07.317710] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-22T18:35:07.799487] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-22T18:35:08.096911] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T18:35:08.117997] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T18:35:08.118071] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-22T18:35:08.917748] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-22T18:35:09.169801] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T18:35:09.717703] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-22T18:35:10.025825] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T18:35:10.517673] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-22T18:35:11.261416] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T18:35:11.263274] [INFO ] [REMOTE ] EOT: Full fetch complete (10631 records). [2025-10-22T18:35:11.263424] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-22T18:35:11.263851] [FATAL] [VALIDATOR ] EOT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:35:11.263932] [FATAL] [MAIN ] EOT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:35:11.263975] [WARN ] [MAIN ] EOT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:35:11.264015] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-22T18:35:11.264069] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-22T18:35:11.264103] [INFO ] [LOCAL ] EOT: Starting deletion of derivative data. [2025-10-22T18:35:11.264270] [DEBUG] [LOCAL ] EOT: Deleted derivative data file. [2025-10-22T18:35:11.264352] [INFO ] [MAIN ] Update Progress: 747/2367 symbols completed. EOT took 21.7s. Estimated remaining: 3h 26m 16s. Rate: 7.9 symbols/min [2025-10-22T18:35:11.325953] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-22T18:35:11.433810] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:11.434012] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-10-22T18:35:11.434066] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-10-22T18:35:11.434278] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-22T18:35:11.434426] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-22T18:35:11.434491] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-22T18:35:11.434603] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-22T18:35:11.829008] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:11.831171] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T18:35:12.117724] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-22T18:35:12.594749] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T18:35:12.917670] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-22T18:35:13.717749] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-22T18:35:13.941003] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T18:35:14.334102] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-22T18:35:14.342981] [INFO ] [REMOTE ] EOG: Full fetch complete (77466 records). [2025-10-22T18:35:14.343124] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-22T18:35:14.519464] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-22T18:35:14.756994] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-22T18:35:14.757736] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-22T18:35:14.759268] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-22T18:35:14.759359] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-22T18:35:14.758247] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T18:35:14.766579] [DEBUG] [LOCAL ] EOG: Trimmed 77466 records to 53390 (keeping 200 days of data) [2025-10-22T18:35:15.101227] [DEBUG] [LOCAL ] EOG: Primary data saved (53390 records). [2025-10-22T18:35:15.101356] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-22T18:35:15.101434] [INFO ] [MAIN ] Update Progress: 748/2367 symbols completed. EOG took 43.8s. Estimated remaining: 3h 25m 60s. Rate: 7.9 symbols/min [2025-10-22T18:35:15.271225] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:15.306744] [DEBUG] [LOCAL ] EPC: Loaded 39777 existing records from primary storage. [2025-10-22T18:35:15.307013] [INFO ] [MAIN ] EPC: Loaded 39777 existing records. [2025-10-22T18:35:15.327234] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-22T18:35:15.481740] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:15.481960] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-22T18:35:15.482007] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-22T18:35:15.482181] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-22T18:35:15.482217] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-22T18:35:15.825058] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:16.117676] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-22T18:35:16.254583] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:35:16.917729] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-22T18:35:16.996397] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:35:17.431086] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T18:35:17.434091] [INFO ] [REMOTE ] EOS: Full fetch complete (22853 records). [2025-10-22T18:35:17.434160] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-22T18:35:17.721539] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-22T18:35:17.805399] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-22T18:35:17.805480] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-22T18:35:17.805997] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-22T18:35:17.806060] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-22T18:35:17.806633] [DEBUG] [LOCAL ] EOS: Trimmed 22853 records to 14668 (keeping 200 days of data) [2025-10-22T18:35:17.902197] [DEBUG] [LOCAL ] EOS: Primary data saved (14668 records). [2025-10-22T18:35:17.902355] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-22T18:35:17.902458] [INFO ] [MAIN ] Update Progress: 749/2367 symbols completed. EOS took 41.5s. Estimated remaining: 3h 25m 42s. Rate: 7.9 symbols/min [2025-10-22T18:35:18.066908] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:18.115135] [DEBUG] [LOCAL ] EPD: Loaded 53609 existing records from primary storage. [2025-10-22T18:35:18.115450] [INFO ] [MAIN ] EPD: Loaded 53609 existing records. [2025-10-22T18:35:18.292321] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:18.293130] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-22T18:35:18.293412] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-22T18:35:18.293824] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-22T18:35:18.293884] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-22T18:35:18.503377] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T18:35:18.522768] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-22T18:35:18.687103] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:19.202563] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T18:35:19.317627] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-22T18:35:19.779459] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T18:35:20.117698] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-22T18:35:20.675063] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T18:35:20.917694] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-22T18:35:21.717704] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-22T18:35:22.126543] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T18:35:22.201429] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T18:35:22.517695] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-22T18:35:23.284233] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:35:23.317700] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-22T18:35:23.774153] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T18:35:23.781396] [INFO ] [REMOTE ] EPAC: Full fetch complete (38732 records). [2025-10-22T18:35:23.781759] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-22T18:35:23.782993] [FATAL] [VALIDATOR ] EPAC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:35:23.783176] [FATAL] [MAIN ] EPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:35:23.783242] [WARN ] [MAIN ] EPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:35:23.783334] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-22T18:35:23.783432] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-10-22T18:35:23.783489] [INFO ] [LOCAL ] EPAC: Starting deletion of derivative data. [2025-10-22T18:35:23.783708] [DEBUG] [LOCAL ] EPAC: Deleted derivative data file. [2025-10-22T18:35:23.784011] [INFO ] [MAIN ] Update Progress: 750/2367 symbols completed. EPAC took 29.0s. Estimated remaining: 3h 25m 31s. Rate: 7.9 symbols/min [2025-10-22T18:35:23.954817] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:23.996302] [DEBUG] [LOCAL ] EPR: Loaded 43777 existing records from primary storage. [2025-10-22T18:35:23.996622] [INFO ] [MAIN ] EPR: Loaded 43777 existing records. [2025-10-22T18:35:24.122804] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-22T18:35:24.180671] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:24.180880] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-22T18:35:24.180930] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-22T18:35:24.181115] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-22T18:35:24.181155] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-22T18:35:24.538782] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:24.838177] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T18:35:24.917740] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-22T18:35:25.717698] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-22T18:35:26.023529] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T18:35:26.517731] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-22T18:35:26.574967] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T18:35:27.317682] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-22T18:35:27.551959] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T18:35:28.117776] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-22T18:35:28.461979] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T18:35:28.917780] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-22T18:35:28.949753] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T18:35:29.651234] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:35:29.717716] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-22T18:35:30.517692] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-22T18:35:31.027323] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T18:35:31.065994] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:35:31.317709] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-22T18:35:32.092225] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T18:35:32.117690] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-22T18:35:32.876169] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:35:32.917619] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-22T18:35:33.643932] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T18:35:33.717700] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-22T18:35:34.517688] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-22T18:35:34.551280] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:35:34.974969] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:35:35.317695] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-22T18:35:36.117734] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-22T18:35:36.423606] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T18:35:36.503688] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T18:35:36.917721] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-22T18:35:37.717716] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-22T18:35:37.822201] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T18:35:38.517758] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-22T18:35:38.732005] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T18:35:39.317736] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-22T18:35:39.609866] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T18:35:39.801935] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T18:35:39.808167] [INFO ] [REMOTE ] EPAM: Full fetch complete (56623 records). [2025-10-22T18:35:39.808307] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-22T18:35:40.122854] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-22T18:35:40.195252] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-22T18:35:40.195338] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-22T18:35:40.196133] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-22T18:35:40.196197] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-22T18:35:40.197397] [DEBUG] [LOCAL ] EPAM: Trimmed 56623 records to 39328 (keeping 200 days of data) [2025-10-22T18:35:40.441101] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T18:35:40.461270] [DEBUG] [LOCAL ] EPAM: Primary data saved (39328 records). [2025-10-22T18:35:40.461415] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-22T18:35:40.461487] [INFO ] [MAIN ] Update Progress: 751/2367 symbols completed. EPAM took 29.2s. Estimated remaining: 3h 25m 42s. Rate: 7.9 symbols/min [2025-10-22T18:35:40.643232] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:40.685756] [DEBUG] [LOCAL ] EPRT: Loaded 48476 existing records from primary storage. [2025-10-22T18:35:40.686041] [INFO ] [MAIN ] EPRT: Loaded 48476 existing records. [2025-10-22T18:35:40.867191] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:40.867396] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-22T18:35:40.867444] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-22T18:35:40.867671] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-22T18:35:40.867730] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-22T18:35:40.923010] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-22T18:35:41.231051] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:41.717720] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-22T18:35:42.185223] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T18:35:42.226889] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T18:35:42.517708] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-22T18:35:43.002064] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T18:35:43.317719] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-22T18:35:44.117737] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-22T18:35:44.511163] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T18:35:44.917717] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-22T18:35:44.962593] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T18:35:44.971158] [INFO ] [REMOTE ] EPC: Full fetch complete (57372 records). [2025-10-22T18:35:44.971350] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-22T18:35:45.363799] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-22T18:35:45.363900] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-22T18:35:45.365177] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-22T18:35:45.365295] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-22T18:35:45.366969] [DEBUG] [LOCAL ] EPC: Trimmed 57372 records to 39741 (keeping 200 days of data) [2025-10-22T18:35:45.625916] [DEBUG] [LOCAL ] EPC: Primary data saved (39741 records). [2025-10-22T18:35:45.626060] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-22T18:35:45.626142] [INFO ] [MAIN ] Update Progress: 752/2367 symbols completed. EPC took 30.5s. Estimated remaining: 3h 25m 29s. Rate: 7.9 symbols/min [2025-10-22T18:35:45.734806] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-22T18:35:45.807456] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:45.835349] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T18:35:45.852401] [DEBUG] [LOCAL ] EQBK: Loaded 11388 existing records from primary storage. [2025-10-22T18:35:45.852671] [INFO ] [MAIN ] EQBK: Loaded 11388 existing records. [2025-10-22T18:35:46.036074] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:46.036331] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-22T18:35:46.036381] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-22T18:35:46.036548] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-22T18:35:46.036604] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-22T18:35:46.379761] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:46.517675] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-22T18:35:46.883543] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T18:35:47.317681] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-22T18:35:47.383476] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:35:48.090752] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T18:35:48.117683] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-22T18:35:48.392252] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T18:35:48.917710] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-22T18:35:49.717670] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-22T18:35:49.894613] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T18:35:50.489135] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T18:35:50.517691] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-22T18:35:50.945064] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-22T18:35:50.954169] [INFO ] [REMOTE ] EPD: Full fetch complete (77776 records). [2025-10-22T18:35:50.954308] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-22T18:35:51.318358] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-22T18:35:51.338392] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-22T18:35:51.338474] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-22T18:35:51.339383] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-22T18:35:51.339587] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-22T18:35:51.341054] [DEBUG] [LOCAL ] EPD: Trimmed 77776 records to 53608 (keeping 200 days of data) [2025-10-22T18:35:51.658236] [DEBUG] [LOCAL ] EPD: Primary data saved (53608 records). [2025-10-22T18:35:51.658424] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-22T18:35:51.659046] [INFO ] [MAIN ] Update Progress: 753/2367 symbols completed. EPD took 33.8s. Estimated remaining: 3h 25m 18s. Rate: 7.9 symbols/min [2025-10-22T18:35:51.827341] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:51.876689] [DEBUG] [LOCAL ] EQH: Loaded 52705 existing records from primary storage. [2025-10-22T18:35:51.877007] [INFO ] [MAIN ] EQH: Loaded 52705 existing records. [2025-10-22T18:35:52.056771] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:52.057079] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-22T18:35:52.057131] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-22T18:35:52.057364] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-22T18:35:52.057533] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-22T18:35:52.120315] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-22T18:35:52.188992] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T18:35:52.453973] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T18:35:52.457617] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:52.917691] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-22T18:35:53.720739] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-22T18:35:53.725247] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T18:35:54.517743] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-22T18:35:54.595474] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T18:35:54.620421] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T18:35:55.317735] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-22T18:35:56.053262] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T18:35:56.117711] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-22T18:35:56.578522] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T18:35:56.917709] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-22T18:35:57.648276] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:35:57.717609] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-22T18:35:57.731999] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T18:35:58.517706] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-22T18:35:59.258137] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T18:35:59.317613] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-22T18:35:59.621281] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T18:36:00.117697] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-22T18:36:00.917716] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-22T18:36:01.717836] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-22T18:36:02.082928] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-22T18:36:02.517626] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-22T18:36:02.693579] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-22T18:36:03.317751] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-22T18:36:04.548414] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (3.63 seconds). [2025-10-22T18:36:04.551551] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-22T18:36:06.016186] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T18:36:06.019803] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-22T18:36:06.047040] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (3.53 seconds). [2025-10-22T18:36:06.057975] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-22T18:36:06.139815] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (4.42 seconds). [2025-10-22T18:36:06.146825] [INFO ] [REMOTE ] EPR: Full fetch complete (63331 records). [2025-10-22T18:36:06.146947] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-22T18:36:06.494838] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (3.18 seconds). [2025-10-22T18:36:06.546712] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-22T18:36:06.583453] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-22T18:36:06.583582] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-22T18:36:06.584426] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-22T18:36:06.584491] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-22T18:36:06.585844] [DEBUG] [LOCAL ] EPR: Trimmed 63331 records to 43707 (keeping 200 days of data) [2025-10-22T18:36:06.850956] [DEBUG] [LOCAL ] EPR: Primary data saved (43707 records). [2025-10-22T18:36:06.851110] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-22T18:36:06.851203] [INFO ] [MAIN ] Update Progress: 754/2367 symbols completed. EPR took 43.1s. Estimated remaining: 3h 25m 27s. Rate: 7.9 symbols/min [2025-10-22T18:36:07.026523] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:07.034053] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T18:36:07.036999] [INFO ] [REMOTE ] EQBK: Full fetch complete (15698 records). [2025-10-22T18:36:07.037082] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-22T18:36:07.381706] [DEBUG] [LOCAL ] EQNR: Loaded 53055 existing records from primary storage. [2025-10-22T18:36:07.411721] [INFO ] [MAIN ] EQNR: Loaded 53055 existing records. [2025-10-22T18:36:07.474793] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-22T18:36:07.486900] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-22T18:36:07.498997] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-22T18:36:07.512698] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-22T18:36:07.546224] [DEBUG] [LOCAL ] EQBK: Trimmed 15698 records to 11303 (keeping 200 days of data) [2025-10-22T18:36:07.679259] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:07.681313] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-22T18:36:07.681952] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-22T18:36:07.682392] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-22T18:36:07.683088] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-22T18:36:07.839024] [DEBUG] [LOCAL ] EQBK: Primary data saved (11303 records). [2025-10-22T18:36:07.844577] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-22T18:36:07.844898] [INFO ] [MAIN ] Update Progress: 755/2367 symbols completed. EQBK took 22.2s. Estimated remaining: 3h 25m 5s. Rate: 7.9 symbols/min [2025-10-22T18:36:07.851975] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T18:36:07.997461] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-22T18:36:08.275336] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:08.279996] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:08.280693] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-22T18:36:08.327325] [DEBUG] [LOCAL ] EQR: Loaded 51808 existing records from primary storage. [2025-10-22T18:36:08.327702] [INFO ] [MAIN ] EQR: Loaded 51808 existing records. [2025-10-22T18:36:08.505343] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:08.505590] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-22T18:36:08.505665] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-22T18:36:08.505882] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-22T18:36:08.505943] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-22T18:36:08.876145] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:08.917609] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-22T18:36:09.374095] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-22T18:36:09.717723] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-22T18:36:09.884507] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T18:36:10.342119] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T18:36:10.517680] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-22T18:36:10.749465] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T18:36:11.317711] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-22T18:36:11.419114] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T18:36:12.117739] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-22T18:36:12.917718] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-22T18:36:13.397815] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-22T18:36:13.717724] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-22T18:36:14.031104] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-22T18:36:14.517695] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-22T18:36:14.822408] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-22T18:36:15.317731] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-22T18:36:15.636566] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-22T18:36:15.693006] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T18:36:15.702780] [INFO ] [REMOTE ] EPRT: Full fetch complete (69540 records). [2025-10-22T18:36:15.702977] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-22T18:36:16.085636] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-22T18:36:16.085742] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-22T18:36:16.086596] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-22T18:36:16.086636] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-22T18:36:16.087904] [DEBUG] [LOCAL ] EPRT: Trimmed 69540 records to 48479 (keeping 200 days of data) [2025-10-22T18:36:16.140344] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-22T18:36:16.379835] [DEBUG] [LOCAL ] EPRT: Primary data saved (48479 records). [2025-10-22T18:36:16.380075] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-22T18:36:16.380193] [INFO ] [MAIN ] Update Progress: 756/2367 symbols completed. EPRT took 35.9s. Estimated remaining: 3h 24m 59s. Rate: 7.9 symbols/min [2025-10-22T18:36:16.549884] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:16.550107] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-22T18:36:16.550178] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-22T18:36:16.550328] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-22T18:36:16.550396] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-22T18:36:16.550548] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-22T18:36:16.550599] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-22T18:36:16.691080] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T18:36:16.922729] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-22T18:36:16.961499] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:17.192513] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T18:36:17.631086] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T18:36:17.717679] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-22T18:36:18.517776] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-22T18:36:18.723102] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T18:36:19.317747] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-22T18:36:19.682730] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T18:36:20.117678] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-22T18:36:20.206439] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T18:36:20.917751] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-22T18:36:21.119793] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T18:36:21.717732] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-22T18:36:22.077292] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T18:36:22.517687] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-22T18:36:22.616187] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T18:36:23.331760] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-22T18:36:23.334520] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:36:24.083228] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-22T18:36:24.117688] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-22T18:36:24.364468] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T18:36:24.917737] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-22T18:36:25.314181] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T18:36:25.717699] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-22T18:36:25.877808] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:36:26.517733] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-22T18:36:27.317730] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-22T18:36:27.710934] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T18:36:27.719526] [INFO ] [REMOTE ] EQH: Full fetch complete (76641 records). [2025-10-22T18:36:27.719717] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-22T18:36:28.102078] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-22T18:36:28.102166] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-22T18:36:28.103399] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-22T18:36:28.103484] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-22T18:36:28.105078] [DEBUG] [LOCAL ] EQH: Trimmed 76641 records to 52699 (keeping 200 days of data) [2025-10-22T18:36:28.117684] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-22T18:36:28.434274] [DEBUG] [LOCAL ] EQH: Primary data saved (52699 records). [2025-10-22T18:36:28.434413] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-22T18:36:28.435003] [INFO ] [MAIN ] Update Progress: 757/2367 symbols completed. EQH took 36.8s. Estimated remaining: 3h 25m 1s. Rate: 7.9 symbols/min [2025-10-22T18:36:28.677906] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T18:36:28.850705] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T18:36:28.917623] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-22T18:36:29.125306] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T18:36:29.717755] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-22T18:36:30.022228] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-22T18:36:30.518085] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-22T18:36:30.520687] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:36:31.317741] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-22T18:36:32.117717] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-22T18:36:32.475782] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-22T18:36:32.695181] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T18:36:32.917695] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-22T18:36:33.267600] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T18:36:33.276865] [INFO ] [REMOTE ] EQR: Full fetch complete (74602 records). [2025-10-22T18:36:33.276996] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-22T18:36:33.700951] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-22T18:36:33.701056] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-22T18:36:33.702006] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-22T18:36:33.702070] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-22T18:36:33.703507] [DEBUG] [LOCAL ] EQR: Trimmed 74602 records to 51810 (keeping 200 days of data) [2025-10-22T18:36:33.760252] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-22T18:36:34.030902] [DEBUG] [LOCAL ] EQR: Primary data saved (51810 records). [2025-10-22T18:36:34.031037] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-22T18:36:34.031117] [INFO ] [MAIN ] Update Progress: 758/2367 symbols completed. EQR took 26.2s. Estimated remaining: 3h 24m 49s. Rate: 7.9 symbols/min [2025-10-22T18:36:34.262549] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-22T18:36:34.517743] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-22T18:36:34.686254] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T18:36:34.909102] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-22T18:36:35.317732] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-22T18:36:35.926759] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T18:36:36.117730] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-22T18:36:36.787945] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T18:36:36.917738] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-22T18:36:37.437409] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-22T18:36:37.438280] [INFO ] [REMOTE ] EQS: Full fetch complete (2379 records). [2025-10-22T18:36:37.438347] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-22T18:36:37.438707] [FATAL] [VALIDATOR ] EQS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:36:37.438788] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:36:37.438830] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:36:37.438891] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-22T18:36:37.438951] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-22T18:36:37.438987] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-22T18:36:37.439025] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-22T18:36:37.439075] [INFO ] [MAIN ] Update Progress: 759/2367 symbols completed. EQS took 21.1s. Estimated remaining: 3h 24m 33s. Rate: 7.9 symbols/min [2025-10-22T18:36:37.717730] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-22T18:36:39.839732] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T18:36:39.848541] [INFO ] [REMOTE ] EQNR: Full fetch complete (77014 records). [2025-10-22T18:36:39.848697] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-22T18:36:40.230530] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-22T18:36:40.230618] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-22T18:36:40.231496] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-22T18:36:40.231553] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-22T18:36:40.233069] [DEBUG] [LOCAL ] EQNR: Trimmed 77014 records to 53050 (keeping 200 days of data) [2025-10-22T18:36:40.553016] [DEBUG] [LOCAL ] EQNR: Primary data saved (53050 records). [2025-10-22T18:36:40.553157] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-22T18:36:40.553237] [INFO ] [MAIN ] Update Progress: 760/2367 symbols completed. EQNR took 33.7s. Estimated remaining: 3h 24m 15s. Rate: 7.9 symbols/min [2025-10-22T18:36:41.201303] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:41.226959] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:41.277777] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:41.280764] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:41.284190] [DEBUG] [LOCAL ] EQV: Loaded 2740 existing records from primary storage. [2025-10-22T18:36:41.284807] [INFO ] [MAIN ] EQV: Loaded 2740 existing records. [2025-10-22T18:36:41.488842] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:41.498471] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-22T18:36:41.498554] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-22T18:36:41.498742] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-22T18:36:41.498808] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-22T18:36:41.626172] [DEBUG] [LOCAL ] ERO: Loaded 42158 existing records from primary storage. [2025-10-22T18:36:41.659492] [DEBUG] [LOCAL ] ERJ: Loaded 50293 existing records from primary storage. [2025-10-22T18:36:41.666102] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-22T18:36:41.676768] [INFO ] [MAIN ] ERO: Loaded 42158 existing records. [2025-10-22T18:36:41.682193] [INFO ] [MAIN ] EQT: Loaded 53685 existing records. [2025-10-22T18:36:41.711115] [INFO ] [MAIN ] ERJ: Loaded 50293 existing records. [2025-10-22T18:36:42.309700] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:42.406520] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:42.397475] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:42.422081] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-22T18:36:42.440427] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-22T18:36:42.440690] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-22T18:36:42.460274] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-22T18:36:42.460156] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-22T18:36:42.454306] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-22T18:36:42.479337] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-22T18:36:42.482600] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-22T18:36:42.479248] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-22T18:36:42.479295] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-22T18:36:42.482512] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:42.499449] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-22T18:36:42.525217] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-22T18:36:42.573063] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-22T18:36:43.515365] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:43.521736] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-22T18:36:43.597526] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:43.613510] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-22T18:36:43.638069] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T18:36:43.667994] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:43.671007] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-22T18:36:43.671867] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-22T18:36:44.264595] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T18:36:44.267043] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-22T18:36:44.831735] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-22T18:36:44.833250] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-22T18:36:45.327149] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:36:45.335311] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-22T18:36:45.361376] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T18:36:45.371320] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-22T18:36:45.459536] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T18:36:45.717707] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-22T18:36:45.893506] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T18:36:46.045031] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-22T18:36:46.517754] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-22T18:36:46.637820] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T18:36:47.192886] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T18:36:47.317711] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-22T18:36:48.117683] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-22T18:36:48.314890] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T18:36:48.917719] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-22T18:36:49.229195] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T18:36:49.575570] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T18:36:49.717626] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-22T18:36:50.517701] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-22T18:36:51.050742] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-22T18:36:51.317720] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-22T18:36:51.529733] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T18:36:51.986774] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-22T18:36:52.013539] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T18:36:52.117712] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-22T18:36:52.917686] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-22T18:36:53.717746] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-22T18:36:53.919635] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T18:36:54.356112] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T18:36:54.517717] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-22T18:36:55.293940] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:36:55.317616] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-22T18:36:56.117709] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-22T18:36:56.296163] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:36:56.547239] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T18:36:56.667387] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:36:56.917720] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-22T18:36:57.717720] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-22T18:36:58.517724] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-22T18:36:58.769265] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T18:36:59.171804] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-22T18:36:59.317734] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-22T18:36:59.793543] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T18:36:59.799297] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-22T18:37:00.117683] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-22T18:37:00.917713] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-22T18:37:01.717779] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-22T18:37:01.749426] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T18:37:01.751109] [INFO ] [REMOTE ] EQV: Full fetch complete (4878 records). [2025-10-22T18:37:01.751203] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-22T18:37:02.265876] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-22T18:37:02.265993] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-22T18:37:02.266170] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-22T18:37:02.266216] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-22T18:37:02.266633] [DEBUG] [LOCAL ] EQV: Trimmed 4878 records to 2702 (keeping 200 days of data) [2025-10-22T18:37:02.284035] [DEBUG] [LOCAL ] EQV: Primary data saved (2702 records). [2025-10-22T18:37:02.284176] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-22T18:37:02.284262] [INFO ] [MAIN ] Update Progress: 761/2367 symbols completed. EQV took 21.7s. Estimated remaining: 3h 24m 37s. Rate: 7.8 symbols/min [2025-10-22T18:37:02.454912] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:02.455087] [DEBUG] [LOCAL ] ES: No existing data file found in primary storage. [2025-10-22T18:37:02.455125] [WARN ] [MAIN ] ES: No existing data found, performing full refresh instead. [2025-10-22T18:37:02.455310] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-22T18:37:02.455360] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-22T18:37:02.455403] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-10-22T18:37:02.455435] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-22T18:37:02.523298] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-22T18:37:02.802809] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:03.317706] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-22T18:37:05.855741] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-22T18:37:05.866551] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-22T18:37:05.974714] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (5.06 seconds). [2025-10-22T18:37:05.984322] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-22T18:37:06.271116] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (4.55 seconds). [2025-10-22T18:37:06.282113] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-22T18:37:06.885271] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (4.36 seconds). [2025-10-22T18:37:06.901868] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-22T18:37:08.659892] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-22T18:37:08.676172] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-22T18:37:08.738128] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T18:37:08.753316] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-22T18:37:08.753940] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-22T18:37:08.806950] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-10-22T18:37:08.917723] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-22T18:37:09.717740] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-22T18:37:10.712155] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T18:37:10.722080] [INFO ] [REMOTE ] ERJ: Full fetch complete (73050 records). [2025-10-22T18:37:10.722328] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-22T18:37:11.191096] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-22T18:37:11.191210] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-22T18:37:11.192332] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-22T18:37:11.197892] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T18:37:11.198153] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-22T18:37:11.216076] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-22T18:37:11.224115] [DEBUG] [LOCAL ] ERJ: Trimmed 73050 records to 50289 (keeping 200 days of data) [2025-10-22T18:37:11.241353] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-22T18:37:11.351982] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-22T18:37:11.503562] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:37:11.602332] [DEBUG] [LOCAL ] ERJ: Primary data saved (50289 records). [2025-10-22T18:37:11.602500] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-22T18:37:11.602591] [INFO ] [MAIN ] Update Progress: 762/2367 symbols completed. ERJ took 31.0s. Estimated remaining: 3h 24m 33s. Rate: 7.8 symbols/min [2025-10-22T18:37:11.768596] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:11.795085] [DEBUG] [LOCAL ] ESAB: Loaded 25989 existing records from primary storage. [2025-10-22T18:37:11.795350] [INFO ] [MAIN ] ESAB: Loaded 25989 existing records. [2025-10-22T18:37:11.989910] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:11.990141] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-22T18:37:11.990186] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-22T18:37:11.990392] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-22T18:37:11.990446] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-22T18:37:12.125424] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-22T18:37:12.341011] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:12.917798] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-22T18:37:13.078532] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T18:37:13.566559] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T18:37:13.717617] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-22T18:37:14.062746] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T18:37:14.070754] [INFO ] [REMOTE ] ERO: Full fetch complete (60648 records). [2025-10-22T18:37:14.070855] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-22T18:37:14.232023] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T18:37:14.463616] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-22T18:37:14.463729] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-22T18:37:14.464479] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-22T18:37:14.464522] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-22T18:37:14.465785] [DEBUG] [LOCAL ] ERO: Trimmed 60648 records to 42159 (keeping 200 days of data) [2025-10-22T18:37:14.522753] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-22T18:37:14.710287] [DEBUG] [LOCAL ] ERO: Primary data saved (42159 records). [2025-10-22T18:37:14.710626] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-22T18:37:14.710745] [INFO ] [MAIN ] Update Progress: 763/2367 symbols completed. ERO took 34.1s. Estimated remaining: 3h 24m 16s. Rate: 7.9 symbols/min [2025-10-22T18:37:14.872383] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:14.888831] [DEBUG] [LOCAL ] ESE: Loaded 16514 existing records from primary storage. [2025-10-22T18:37:14.889061] [INFO ] [MAIN ] ESE: Loaded 16514 existing records. [2025-10-22T18:37:15.059415] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:15.059615] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-22T18:37:15.059691] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-22T18:37:15.060216] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-22T18:37:15.060272] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-22T18:37:15.323799] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-22T18:37:15.405922] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:15.861470] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-22T18:37:15.870440] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-22T18:37:15.870591] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-22T18:37:16.123285] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-22T18:37:16.258493] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-22T18:37:16.258706] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-22T18:37:16.259707] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-22T18:37:16.259811] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-22T18:37:16.261225] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 53685 (keeping 200 days of data) [2025-10-22T18:37:16.608283] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T18:37:16.632393] [DEBUG] [LOCAL ] EQT: Primary data saved (53685 records). [2025-10-22T18:37:16.638320] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-22T18:37:16.638860] [INFO ] [MAIN ] Update Progress: 764/2367 symbols completed. EQT took 36.1s. Estimated remaining: 3h 23m 57s. Rate: 7.9 symbols/min [2025-10-22T18:37:16.645544] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T18:37:16.810926] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:16.818461] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T18:37:16.862302] [DEBUG] [LOCAL ] ESI: Loaded 50624 existing records from primary storage. [2025-10-22T18:37:16.862615] [INFO ] [MAIN ] ESI: Loaded 50624 existing records. [2025-10-22T18:37:16.922856] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-22T18:37:17.036701] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:17.036948] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-22T18:37:17.036995] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-22T18:37:17.037271] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-22T18:37:17.037326] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-22T18:37:17.386501] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:17.717731] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-22T18:37:18.199740] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:37:18.517745] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-22T18:37:18.778740] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T18:37:19.317736] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-22T18:37:20.117726] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-22T18:37:20.280917] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T18:37:20.517756] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T18:37:20.917764] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-22T18:37:21.717699] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-22T18:37:22.124036] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T18:37:22.367067] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T18:37:22.517686] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-22T18:37:23.317709] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-22T18:37:23.698536] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T18:37:24.117709] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-22T18:37:24.212026] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T18:37:24.264972] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T18:37:24.917685] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-22T18:37:25.276264] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T18:37:25.717711] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-22T18:37:26.517708] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-22T18:37:26.825881] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T18:37:27.317676] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-22T18:37:27.466489] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:37:27.579037] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T18:37:28.120515] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-22T18:37:28.917707] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-22T18:37:29.075522] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T18:37:29.351960] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T18:37:29.717766] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-22T18:37:30.517725] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-22T18:37:30.679566] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T18:37:30.935429] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T18:37:31.317736] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-22T18:37:32.117711] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-22T18:37:32.550452] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-22T18:37:32.559299] [INFO ] [REMOTE ] ES: Full fetch complete (76477 records). [2025-10-22T18:37:32.559439] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-22T18:37:32.918991] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-22T18:37:32.985094] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-22T18:37:32.985760] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-22T18:37:32.986897] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-22T18:37:32.987058] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-22T18:37:32.988789] [DEBUG] [LOCAL ] ES: Trimmed 76477 records to 52699 (keeping 200 days of data) [2025-10-22T18:37:33.228323] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T18:37:33.267594] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T18:37:33.386516] [DEBUG] [LOCAL ] ES: Primary data saved (52699 records). [2025-10-22T18:37:33.386725] [INFO ] [MAIN ] ES: Full history saved. [2025-10-22T18:37:33.386851] [INFO ] [MAIN ] Update Progress: 765/2367 symbols completed. ES took 31.1s. Estimated remaining: 3h 24m 8s. Rate: 7.8 symbols/min [2025-10-22T18:37:33.552341] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:33.587519] [DEBUG] [LOCAL ] ESNT: Loaded 38064 existing records from primary storage. [2025-10-22T18:37:33.587843] [INFO ] [MAIN ] ESNT: Loaded 38064 existing records. [2025-10-22T18:37:33.727420] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-22T18:37:33.769585] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:33.769882] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-22T18:37:33.769938] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-22T18:37:33.770138] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-22T18:37:33.770194] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-22T18:37:34.121465] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:34.353687] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T18:37:34.517700] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-22T18:37:35.317741] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-22T18:37:35.448784] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:37:35.957276] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T18:37:36.117749] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-22T18:37:36.917677] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-22T18:37:37.172071] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T18:37:37.522006] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T18:37:37.717702] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-22T18:37:37.828440] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T18:37:38.517678] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-22T18:37:38.997537] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T18:37:39.004499] [INFO ] [REMOTE ] ESAB: Full fetch complete (36440 records). [2025-10-22T18:37:39.004718] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-22T18:37:39.322866] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-22T18:37:39.397589] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-22T18:37:39.397702] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-22T18:37:39.398256] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-22T18:37:39.398295] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-22T18:37:39.399057] [DEBUG] [LOCAL ] ESAB: Trimmed 36440 records to 25928 (keeping 200 days of data) [2025-10-22T18:37:39.561437] [DEBUG] [LOCAL ] ESAB: Primary data saved (25928 records). [2025-10-22T18:37:39.561597] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-22T18:37:39.561728] [INFO ] [MAIN ] Update Progress: 766/2367 symbols completed. ESAB took 28.0s. Estimated remaining: 3h 23m 57s. Rate: 7.8 symbols/min [2025-10-22T18:37:39.730759] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:39.749812] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T18:37:39.790162] [DEBUG] [LOCAL ] ESRT: Loaded 46538 existing records from primary storage. [2025-10-22T18:37:39.790462] [INFO ] [MAIN ] ESRT: Loaded 46538 existing records. [2025-10-22T18:37:39.968732] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:39.968944] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-22T18:37:39.968992] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-22T18:37:39.969284] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-22T18:37:39.969341] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-22T18:37:40.122936] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-22T18:37:40.345204] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:40.917733] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-22T18:37:40.950908] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:37:41.657309] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:37:41.717726] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-22T18:37:42.517749] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-22T18:37:42.764416] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T18:37:43.243457] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:37:43.317695] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-22T18:37:44.117713] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-22T18:37:44.239964] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:37:44.902802] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T18:37:44.917620] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-22T18:37:45.333518] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:37:45.717715] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-22T18:37:46.020967] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T18:37:46.520579] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-22T18:37:47.309184] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T18:37:47.317696] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-22T18:37:47.319016] [INFO ] [REMOTE ] ESI: Full fetch complete (73266 records). [2025-10-22T18:37:47.319158] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-22T18:37:47.741847] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-22T18:37:47.741925] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-22T18:37:47.742772] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-22T18:37:47.742834] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-22T18:37:47.744125] [DEBUG] [LOCAL ] ESI: Trimmed 73266 records to 50618 (keeping 200 days of data) [2025-10-22T18:37:48.049972] [DEBUG] [LOCAL ] ESI: Primary data saved (50618 records). [2025-10-22T18:37:48.050175] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-22T18:37:48.050818] [INFO ] [MAIN ] Update Progress: 767/2367 symbols completed. ESI took 31.4s. Estimated remaining: 3h 23m 51s. Rate: 7.8 symbols/min [2025-10-22T18:37:48.122240] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-22T18:37:48.260843] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:37:48.259220] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:48.311842] [DEBUG] [LOCAL ] ESS: Loaded 30188 existing records from primary storage. [2025-10-22T18:37:48.312122] [INFO ] [MAIN ] ESS: Loaded 30188 existing records. [2025-10-22T18:37:48.491736] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:48.500678] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-22T18:37:48.500542] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T18:37:48.500980] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-22T18:37:48.504531] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-22T18:37:48.504627] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-22T18:37:48.504476] [INFO ] [REMOTE ] ESE: Full fetch complete (22948 records). [2025-10-22T18:37:48.548584] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-22T18:37:48.942863] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-22T18:37:49.227366] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:49.269332] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-22T18:37:49.269453] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-22T18:37:49.270048] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-22T18:37:49.270112] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-22T18:37:49.270753] [DEBUG] [LOCAL ] ESE: Trimmed 22948 records to 16465 (keeping 200 days of data) [2025-10-22T18:37:49.372230] [DEBUG] [LOCAL ] ESE: Primary data saved (16465 records). [2025-10-22T18:37:49.372371] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-22T18:37:49.372452] [INFO ] [MAIN ] Update Progress: 768/2367 symbols completed. ESE took 34.7s. Estimated remaining: 3h 23m 31s. Rate: 7.9 symbols/min [2025-10-22T18:37:49.549765] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:49.550122] [DEBUG] [LOCAL ] ESTC: No existing data file found in primary storage. [2025-10-22T18:37:49.550175] [WARN ] [MAIN ] ESTC: No existing data found, performing full refresh instead. [2025-10-22T18:37:49.550285] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-22T18:37:49.550329] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-22T18:37:49.550371] [DEBUG] [LOCAL ] ESTC: No primary data file found to delete. [2025-10-22T18:37:49.550405] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-22T18:37:49.729390] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:37:49.723895] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-22T18:37:49.943460] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:50.517675] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-22T18:37:50.650572] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T18:37:51.322826] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-22T18:37:51.334326] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T18:37:52.117703] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-22T18:37:52.593617] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T18:37:52.917691] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-22T18:37:53.058922] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T18:37:53.563311] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:37:53.717743] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-22T18:37:54.517720] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-22T18:37:54.656081] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:37:55.317669] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-22T18:37:55.449394] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:37:55.991486] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T18:37:56.117611] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-22T18:37:56.240195] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T18:37:56.917702] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-22T18:37:57.324406] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T18:37:57.330803] [INFO ] [REMOTE ] ESNT: Full fetch complete (57199 records). [2025-10-22T18:37:57.330896] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-22T18:37:57.719908] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-22T18:37:57.720152] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-22T18:37:57.720263] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-22T18:37:57.721753] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-22T18:37:57.721896] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-22T18:37:57.723029] [DEBUG] [LOCAL ] ESNT: Trimmed 57199 records to 37977 (keeping 200 days of data) [2025-10-22T18:37:57.944013] [DEBUG] [LOCAL ] ESNT: Primary data saved (37977 records). [2025-10-22T18:37:57.944145] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-22T18:37:57.944243] [INFO ] [MAIN ] Update Progress: 769/2367 symbols completed. ESNT took 24.6s. Estimated remaining: 3h 23m 25s. Rate: 7.9 symbols/min [2025-10-22T18:37:58.110193] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:58.110377] [DEBUG] [LOCAL ] ET: No existing data file found in primary storage. [2025-10-22T18:37:58.110426] [WARN ] [MAIN ] ET: No existing data found, performing full refresh instead. [2025-10-22T18:37:58.110536] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-22T18:37:58.110576] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-22T18:37:58.110618] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-10-22T18:37:58.110712] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-22T18:37:58.458451] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:58.482487] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T18:37:58.517612] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-22T18:37:59.317725] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-22T18:37:59.468957] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:38:00.042623] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:38:00.117608] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-22T18:38:00.698068] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T18:38:00.917683] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-22T18:38:01.717714] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-22T18:38:02.517709] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-22T18:38:02.991585] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-22T18:38:03.317707] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-22T18:38:05.293728] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (4.38 seconds). [2025-10-22T18:38:05.301138] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-22T18:38:05.520810] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-10-22T18:38:05.531301] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-22T18:38:05.976416] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (4.26 seconds). [2025-10-22T18:38:05.986823] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-22T18:38:06.870088] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T18:38:06.876000] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-22T18:38:07.266364] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (3.95 seconds). [2025-10-22T18:38:07.317605] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-22T18:38:07.683418] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T18:38:08.117715] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-22T18:38:08.351356] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T18:38:08.721236] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T18:38:08.917620] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-22T18:38:09.206972] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (3.22 seconds). [2025-10-22T18:38:09.717626] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-22T18:38:09.862885] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T18:38:10.323164] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T18:38:10.517733] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-22T18:38:11.317686] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-22T18:38:11.485187] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:38:11.493329] [INFO ] [REMOTE ] ESRT: Full fetch complete (66741 records). [2025-10-22T18:38:11.493480] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-22T18:38:11.880719] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-22T18:38:11.880804] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-22T18:38:11.881576] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-22T18:38:11.881615] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-22T18:38:11.882883] [DEBUG] [LOCAL ] ESRT: Trimmed 66741 records to 46546 (keeping 200 days of data) [2025-10-22T18:38:12.118337] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-22T18:38:12.155097] [DEBUG] [LOCAL ] ESRT: Primary data saved (46546 records). [2025-10-22T18:38:12.155254] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-22T18:38:12.155385] [INFO ] [MAIN ] Update Progress: 770/2367 symbols completed. ESRT took 32.6s. Estimated remaining: 3h 23m 31s. Rate: 7.8 symbols/min [2025-10-22T18:38:12.352731] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T18:38:12.355217] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:12.365951] [DEBUG] [LOCAL ] ETB: No existing data file found in primary storage. [2025-10-22T18:38:12.366008] [WARN ] [MAIN ] ETB: No existing data found, performing full refresh instead. [2025-10-22T18:38:12.366471] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-22T18:38:12.366525] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-22T18:38:12.366568] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-10-22T18:38:12.366599] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-22T18:38:12.715059] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:12.917693] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-22T18:38:13.428443] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T18:38:13.465316] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T18:38:13.717689] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-22T18:38:14.517715] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-22T18:38:14.733707] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T18:38:15.150127] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T18:38:15.317698] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-22T18:38:16.117760] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-22T18:38:16.880302] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-22T18:38:16.917678] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-22T18:38:16.975771] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:38:17.683291] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T18:38:17.689479] [INFO ] [REMOTE ] ESS: Full fetch complete (43882 records). [2025-10-22T18:38:17.689614] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-22T18:38:17.723026] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-22T18:38:18.062167] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-22T18:38:18.062244] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-22T18:38:18.062863] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-22T18:38:18.062928] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-22T18:38:18.063889] [DEBUG] [LOCAL ] ESS: Trimmed 43882 records to 30164 (keeping 200 days of data) [2025-10-22T18:38:18.254771] [DEBUG] [LOCAL ] ESS: Primary data saved (30164 records). [2025-10-22T18:38:18.254919] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-22T18:38:18.255009] [INFO ] [MAIN ] Update Progress: 771/2367 symbols completed. ESS took 30.2s. Estimated remaining: 3h 23m 20s. Rate: 7.8 symbols/min [2025-10-22T18:38:18.421166] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:18.446776] [DEBUG] [LOCAL ] ETD: Loaded 27258 existing records from primary storage. [2025-10-22T18:38:18.447017] [INFO ] [MAIN ] ETD: Loaded 27258 existing records. [2025-10-22T18:38:18.522833] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-22T18:38:18.626343] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:38:18.626507] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-22T18:38:18.626554] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-22T18:38:18.626780] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-22T18:38:18.626838] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-22T18:38:18.979772] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:19.317708] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-22T18:38:19.359693] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-22T18:38:19.654608] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T18:38:19.767908] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:38:19.776212] [INFO ] [REMOTE ] ESTC: Full fetch complete (72495 records). [2025-10-22T18:38:19.776321] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-22T18:38:20.124275] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-22T18:38:20.163601] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-22T18:38:20.163716] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-22T18:38:20.164802] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-22T18:38:20.164866] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-22T18:38:20.166617] [DEBUG] [LOCAL ] ESTC: Trimmed 72495 records to 50253 (keeping 200 days of data) [2025-10-22T18:38:20.460595] [DEBUG] [LOCAL ] ESTC: Primary data saved (50253 records). [2025-10-22T18:38:20.460751] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-22T18:38:20.460839] [INFO ] [MAIN ] Update Progress: 772/2367 symbols completed. ESTC took 31.1s. Estimated remaining: 3h 23m 1s. Rate: 7.9 symbols/min [2025-10-22T18:38:20.651993] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:20.670181] [DEBUG] [LOCAL ] ETG: Loaded 16586 existing records from primary storage. [2025-10-22T18:38:20.670453] [INFO ] [MAIN ] ETG: Loaded 16586 existing records. [2025-10-22T18:38:20.914850] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:38:20.915146] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-22T18:38:20.915223] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-22T18:38:20.920578] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-22T18:38:20.929330] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-22T18:38:20.929477] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-22T18:38:20.953491] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T18:38:21.291130] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T18:38:21.362724] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:21.717698] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-22T18:38:22.517740] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-22T18:38:23.157471] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-22T18:38:23.262627] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T18:38:23.317743] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-22T18:38:23.331316] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T18:38:24.117684] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-22T18:38:24.345297] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T18:38:24.917704] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-22T18:38:25.074431] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T18:38:25.717701] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-22T18:38:25.873578] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T18:38:26.517705] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-22T18:38:26.971363] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T18:38:27.317721] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-22T18:38:28.117764] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-22T18:38:28.301577] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T18:38:28.917720] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-22T18:38:28.991448] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-22T18:38:29.164995] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T18:38:29.717720] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-22T18:38:29.994446] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T18:38:30.517681] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-22T18:38:30.676344] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T18:38:31.317735] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-22T18:38:31.931569] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T18:38:32.117702] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-22T18:38:32.917699] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-22T18:38:33.168796] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T18:38:33.609097] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-22T18:38:33.717719] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-22T18:38:34.166279] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T18:38:34.517698] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-22T18:38:35.317745] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-22T18:38:35.597763] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T18:38:36.020556] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-22T18:38:36.117717] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-22T18:38:36.487354] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T18:38:36.917721] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-22T18:38:37.717702] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-22T18:38:37.897704] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T18:38:38.481397] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-22T18:38:38.490322] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-22T18:38:38.490482] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-22T18:38:38.522948] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-22T18:38:38.911000] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-22T18:38:38.911068] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-22T18:38:38.911956] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-22T18:38:38.912019] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-22T18:38:38.913497] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 53789 (keeping 200 days of data) [2025-10-22T18:38:39.047864] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T18:38:39.276400] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-22T18:38:39.276553] [INFO ] [MAIN ] ET: Full history saved. [2025-10-22T18:38:39.276631] [INFO ] [MAIN ] Update Progress: 773/2367 symbols completed. ET took 41.3s. Estimated remaining: 3h 23m 17s. Rate: 7.8 symbols/min [2025-10-22T18:38:39.334422] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-22T18:38:39.456433] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:39.468131] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T18:38:39.485613] [DEBUG] [LOCAL ] ETJ: Loaded 16565 existing records from primary storage. [2025-10-22T18:38:39.485908] [INFO ] [MAIN ] ETJ: Loaded 16565 existing records. [2025-10-22T18:38:39.667622] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:38:39.667873] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-22T18:38:39.667921] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-22T18:38:39.668074] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-22T18:38:39.668111] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-22T18:38:40.023938] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:40.117710] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-22T18:38:40.293535] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T18:38:40.917734] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-22T18:38:41.471611] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T18:38:41.544766] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T18:38:41.717737] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-22T18:38:42.517771] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-22T18:38:43.205250] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T18:38:43.317686] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-22T18:38:43.474275] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T18:38:43.478790] [INFO ] [REMOTE ] ETG: Full fetch complete (24513 records). [2025-10-22T18:38:43.478908] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-22T18:38:43.479513] [FATAL] [VALIDATOR ] ETG: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:38:43.479618] [FATAL] [MAIN ] ETG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:38:43.479716] [WARN ] [MAIN ] ETG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:38:43.479782] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-22T18:38:43.479864] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-10-22T18:38:43.479913] [INFO ] [LOCAL ] ETG: Starting deletion of derivative data. [2025-10-22T18:38:43.480104] [DEBUG] [LOCAL ] ETG: Deleted derivative data file. [2025-10-22T18:38:43.480221] [INFO ] [MAIN ] Update Progress: 774/2367 symbols completed. ETG took 23.0s. Estimated remaining: 3h 23m 2s. Rate: 7.8 symbols/min [2025-10-22T18:38:43.653859] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:43.704584] [DEBUG] [LOCAL ] ETN: Loaded 52573 existing records from primary storage. [2025-10-22T18:38:43.704973] [INFO ] [MAIN ] ETN: Loaded 52573 existing records. [2025-10-22T18:38:43.876679] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:38:43.876879] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-22T18:38:43.876925] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-22T18:38:43.877110] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-22T18:38:43.877147] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-22T18:38:44.125589] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-22T18:38:44.233779] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:44.286301] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T18:38:44.917681] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-22T18:38:45.118917] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T18:38:45.123371] [INFO ] [REMOTE ] ETD: Full fetch complete (38603 records). [2025-10-22T18:38:45.123456] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-22T18:38:45.503629] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-22T18:38:45.504016] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-22T18:38:45.513160] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-22T18:38:45.513280] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-22T18:38:45.514498] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T18:38:45.519362] [DEBUG] [LOCAL ] ETD: Trimmed 38603 records to 27141 (keeping 200 days of data) [2025-10-22T18:38:45.683129] [DEBUG] [LOCAL ] ETD: Primary data saved (27141 records). [2025-10-22T18:38:45.683270] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-22T18:38:45.683350] [INFO ] [MAIN ] Update Progress: 775/2367 symbols completed. ETD took 27.4s. Estimated remaining: 3h 22m 43s. Rate: 7.9 symbols/min [2025-10-22T18:38:45.722878] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-22T18:38:45.926955] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:45.940260] [DEBUG] [LOCAL ] ETO: Loaded 6981 existing records from primary storage. [2025-10-22T18:38:45.940562] [INFO ] [MAIN ] ETO: Loaded 6981 existing records. [2025-10-22T18:38:46.224228] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:38:46.224508] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-22T18:38:46.224580] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-22T18:38:46.224975] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-22T18:38:46.225048] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-22T18:38:46.523004] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-22T18:38:46.657560] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:47.317795] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-22T18:38:47.663506] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T18:38:47.846501] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-22T18:38:48.117620] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-22T18:38:48.389040] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T18:38:48.917729] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-22T18:38:49.012887] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T18:38:49.717726] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-22T18:38:50.517735] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-22T18:38:50.759091] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T18:38:50.848741] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T18:38:51.119329] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T18:38:51.317710] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-22T18:38:52.117684] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-22T18:38:52.260481] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-22T18:38:52.917725] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-22T18:38:53.717695] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-22T18:38:53.811869] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T18:38:54.152867] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T18:38:54.361747] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T18:38:54.517702] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-22T18:38:55.317673] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-22T18:38:56.117673] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-22T18:38:56.309788] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T18:38:56.572605] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-22T18:38:56.699031] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-22T18:38:56.917686] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-22T18:38:57.711569] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T18:38:57.717605] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-22T18:38:58.517681] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-22T18:38:58.571582] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T18:38:59.317720] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-22T18:39:00.117686] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-22T18:39:00.275441] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T18:39:00.278102] [INFO ] [REMOTE ] ETB: Full fetch complete (18472 records). [2025-10-22T18:39:00.278175] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-22T18:39:00.647294] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-22T18:39:00.647392] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-22T18:39:00.647832] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-22T18:39:00.647911] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-22T18:39:00.648564] [DEBUG] [LOCAL ] ETB: Trimmed 18472 records to 11764 (keeping 200 days of data) [2025-10-22T18:39:00.751350] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-22T18:39:00.769728] [DEBUG] [LOCAL ] ETB: Primary data saved (11764 records). [2025-10-22T18:39:00.769864] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-22T18:39:00.769936] [INFO ] [MAIN ] Update Progress: 776/2367 symbols completed. ETB took 48.6s. Estimated remaining: 3h 22m 51s. Rate: 7.8 symbols/min [2025-10-22T18:39:00.918566] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-22T18:39:00.941489] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:01.000317] [DEBUG] [LOCAL ] ETR: Loaded 53193 existing records from primary storage. [2025-10-22T18:39:01.000702] [INFO ] [MAIN ] ETR: Loaded 53193 existing records. [2025-10-22T18:39:01.249613] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:01.249941] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-22T18:39:01.250003] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-22T18:39:01.250235] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-22T18:39:01.250306] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-22T18:39:01.672952] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:01.717709] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-22T18:39:02.043939] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T18:39:02.517761] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-22T18:39:03.317684] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-22T18:39:04.171622] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (3.25 seconds). [2025-10-22T18:39:04.175702] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-22T18:39:04.710127] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-22T18:39:04.917710] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-22T18:39:05.308628] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (3.59 seconds). [2025-10-22T18:39:05.415738] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T18:39:05.434389] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T18:39:05.548409] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T18:39:05.717678] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-22T18:39:06.517731] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-22T18:39:06.778989] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T18:39:06.783054] [INFO ] [REMOTE ] ETJ: Full fetch complete (25557 records). [2025-10-22T18:39:06.783291] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-22T18:39:07.158516] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-22T18:39:07.158615] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-22T18:39:07.159253] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-22T18:39:07.159304] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-22T18:39:07.160333] [DEBUG] [LOCAL ] ETJ: Trimmed 25557 records to 16449 (keeping 200 days of data) [2025-10-22T18:39:07.258866] [DEBUG] [LOCAL ] ETJ: Primary data saved (16449 records). [2025-10-22T18:39:07.259012] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-22T18:39:07.259098] [INFO ] [MAIN ] Update Progress: 777/2367 symbols completed. ETJ took 28.0s. Estimated remaining: 3h 22m 41s. Rate: 7.8 symbols/min [2025-10-22T18:39:07.323583] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-22T18:39:07.436729] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:07.485712] [DEBUG] [LOCAL ] ETSY: Loaded 53569 existing records from primary storage. [2025-10-22T18:39:07.486020] [INFO ] [MAIN ] ETSY: Loaded 53569 existing records. [2025-10-22T18:39:07.659742] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:07.659954] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-22T18:39:07.659999] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-22T18:39:07.660181] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-22T18:39:07.660218] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-22T18:39:08.016494] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:08.021263] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T18:39:08.117606] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-22T18:39:08.238726] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T18:39:08.917731] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-22T18:39:09.096894] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:39:09.099281] [INFO ] [REMOTE ] ETO: Full fetch complete (9709 records). [2025-10-22T18:39:09.099404] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-22T18:39:09.472561] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-22T18:39:09.472683] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-22T18:39:09.472984] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-22T18:39:09.473033] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-22T18:39:09.473753] [DEBUG] [LOCAL ] ETO: Trimmed 9709 records to 6892 (keeping 200 days of data) [2025-10-22T18:39:09.523698] [DEBUG] [LOCAL ] ETO: Primary data saved (6892 records). [2025-10-22T18:39:09.523844] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-22T18:39:09.523926] [INFO ] [MAIN ] Update Progress: 778/2367 symbols completed. ETO took 23.8s. Estimated remaining: 3h 22m 22s. Rate: 7.9 symbols/min [2025-10-22T18:39:09.704212] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:09.704463] [DEBUG] [LOCAL ] ETV: No existing data file found in primary storage. [2025-10-22T18:39:09.704514] [WARN ] [MAIN ] ETV: No existing data found, performing full refresh instead. [2025-10-22T18:39:09.704671] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-22T18:39:09.704725] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-22T18:39:09.704806] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-22T18:39:09.704854] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-22T18:39:09.725230] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-22T18:39:10.055549] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:10.517723] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-22T18:39:11.044633] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-22T18:39:11.317698] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-22T18:39:11.739257] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T18:39:12.117623] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-22T18:39:12.420701] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T18:39:12.917751] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-22T18:39:13.635087] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-22T18:39:13.717621] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-22T18:39:13.905515] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T18:39:14.517716] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-22T18:39:14.814130] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T18:39:15.297586] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T18:39:15.317623] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-22T18:39:15.970039] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:39:16.117685] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-22T18:39:16.917762] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-22T18:39:17.549914] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-22T18:39:17.717678] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-22T18:39:18.513051] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-22T18:39:18.523433] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-22T18:39:19.091095] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-22T18:39:19.099795] [INFO ] [REMOTE ] ETN: Full fetch complete (76646 records). [2025-10-22T18:39:19.099963] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-22T18:39:19.332412] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-22T18:39:19.503393] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-22T18:39:19.503511] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-22T18:39:19.504456] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-22T18:39:19.504545] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-22T18:39:19.506700] [DEBUG] [LOCAL ] ETN: Trimmed 76646 records to 52571 (keeping 200 days of data) [2025-10-22T18:39:19.656250] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T18:39:19.664864] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T18:39:19.892761] [DEBUG] [LOCAL ] ETN: Primary data saved (52571 records). [2025-10-22T18:39:19.892905] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-22T18:39:19.892987] [INFO ] [MAIN ] Update Progress: 779/2367 symbols completed. ETN took 36.4s. Estimated remaining: 3h 22m 20s. Rate: 7.8 symbols/min [2025-10-22T18:39:20.057034] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:20.081841] [DEBUG] [LOCAL ] ETW: Loaded 25249 existing records from primary storage. [2025-10-22T18:39:20.082219] [INFO ] [MAIN ] ETW: Loaded 25249 existing records. [2025-10-22T18:39:20.123745] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-22T18:39:20.261594] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:20.261834] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-22T18:39:20.261880] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-22T18:39:20.262243] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-22T18:39:20.262300] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-22T18:39:20.603849] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:20.917738] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-22T18:39:21.352293] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T18:39:21.717878] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-22T18:39:21.956785] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T18:39:22.068167] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T18:39:22.517730] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-22T18:39:23.317759] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-22T18:39:23.804328] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T18:39:24.033392] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T18:39:24.084845] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T18:39:24.117626] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-22T18:39:24.917698] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-22T18:39:25.106270] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T18:39:25.717719] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-22T18:39:26.517698] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-22T18:39:26.573835] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T18:39:26.938420] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T18:39:27.241597] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T18:39:27.317682] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-22T18:39:27.961315] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T18:39:28.117720] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-22T18:39:28.917730] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-22T18:39:29.717703] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-22T18:39:29.942447] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T18:39:30.376936] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T18:39:30.517742] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-22T18:39:30.801914] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T18:39:31.317761] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-22T18:39:32.117733] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-22T18:39:32.432124] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T18:39:32.440754] [INFO ] [REMOTE ] ETR: Full fetch complete (76888 records). [2025-10-22T18:39:32.440950] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-22T18:39:32.441782] [FATAL] [VALIDATOR ] ETR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:39:32.441872] [FATAL] [MAIN ] ETR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:39:32.441915] [WARN ] [MAIN ] ETR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:39:32.441956] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-22T18:39:32.442013] [DEBUG] [LOCAL ] ETR: No primary data file found to delete. [2025-10-22T18:39:32.442048] [INFO ] [LOCAL ] ETR: Starting deletion of derivative data. [2025-10-22T18:39:32.442219] [DEBUG] [LOCAL ] ETR: Deleted derivative data file. [2025-10-22T18:39:32.442308] [INFO ] [MAIN ] Update Progress: 780/2367 symbols completed. ETR took 31.7s. Estimated remaining: 3h 22m 22s. Rate: 7.8 symbols/min [2025-10-22T18:39:32.617265] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:32.632355] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T18:39:32.642928] [DEBUG] [LOCAL ] ETX: Loaded 5311 existing records from primary storage. [2025-10-22T18:39:32.643154] [INFO ] [MAIN ] ETX: Loaded 5311 existing records. [2025-10-22T18:39:32.822609] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:32.822834] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-22T18:39:32.822881] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-22T18:39:32.823041] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-22T18:39:32.823096] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-22T18:39:32.921882] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-22T18:39:33.178929] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:33.717709] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-22T18:39:33.883919] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T18:39:33.911503] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T18:39:34.517782] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-22T18:39:34.634443] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T18:39:35.317757] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-22T18:39:35.755961] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T18:39:35.765774] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T18:39:36.117727] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-22T18:39:36.627049] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T18:39:36.917710] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-22T18:39:37.480634] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T18:39:37.717744] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-22T18:39:38.359630] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T18:39:38.517757] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-22T18:39:39.232098] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T18:39:39.317628] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-22T18:39:40.117759] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-22T18:39:40.732490] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T18:39:40.917719] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-22T18:39:41.239120] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T18:39:41.717721] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-22T18:39:42.234850] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T18:39:42.517731] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-22T18:39:42.767116] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T18:39:43.317744] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-22T18:39:44.117710] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-22T18:39:44.542590] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T18:39:44.569082] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:39:44.917742] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-22T18:39:45.166342] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T18:39:45.717711] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-22T18:39:46.157210] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T18:39:46.162371] [INFO ] [REMOTE ] ETW: Full fetch complete (36495 records). [2025-10-22T18:39:46.162526] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-22T18:39:46.524597] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-22T18:39:46.526932] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-22T18:39:46.527943] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-22T18:39:46.528571] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-22T18:39:46.528634] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-22T18:39:46.529699] [DEBUG] [LOCAL ] ETW: Trimmed 36495 records to 25106 (keeping 200 days of data) [2025-10-22T18:39:46.677438] [DEBUG] [LOCAL ] ETW: Primary data saved (25106 records). [2025-10-22T18:39:46.677572] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-22T18:39:46.677693] [INFO ] [MAIN ] Update Progress: 781/2367 symbols completed. ETW took 26.8s. Estimated remaining: 3h 22m 28s. Rate: 7.8 symbols/min [2025-10-22T18:39:46.850000] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:46.865324] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T18:39:46.888888] [DEBUG] [LOCAL ] ETY: Loaded 22546 existing records from primary storage. [2025-10-22T18:39:46.889164] [INFO ] [MAIN ] ETY: Loaded 22546 existing records. [2025-10-22T18:39:47.060519] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:47.060756] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-22T18:39:47.060813] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-22T18:39:47.060997] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-22T18:39:47.061052] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-22T18:39:47.320231] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-22T18:39:47.427777] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T18:39:47.427428] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:48.117723] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-22T18:39:48.369442] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T18:39:48.374283] [INFO ] [REMOTE ] ETV: Full fetch complete (32259 records). [2025-10-22T18:39:48.374388] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-22T18:39:48.749370] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-22T18:39:48.749445] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-22T18:39:48.749980] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-22T18:39:48.750041] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-22T18:39:48.750828] [DEBUG] [LOCAL ] ETV: Trimmed 32259 records to 21830 (keeping 200 days of data) [2025-10-22T18:39:48.884602] [DEBUG] [LOCAL ] ETV: Primary data saved (21830 records). [2025-10-22T18:39:48.884761] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-22T18:39:48.884851] [INFO ] [MAIN ] Update Progress: 782/2367 symbols completed. ETV took 39.4s. Estimated remaining: 3h 22m 9s. Rate: 7.8 symbols/min [2025-10-22T18:39:48.927246] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-22T18:39:49.058466] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:49.075240] [DEBUG] [LOCAL ] EVC: Loaded 17976 existing records from primary storage. [2025-10-22T18:39:49.075482] [INFO ] [MAIN ] EVC: Loaded 17976 existing records. [2025-10-22T18:39:49.254075] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:49.254266] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-22T18:39:49.254312] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-22T18:39:49.254582] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-22T18:39:49.254637] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-22T18:39:49.619801] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:49.663706] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T18:39:49.717711] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-22T18:39:49.729798] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T18:39:50.517721] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-22T18:39:51.163167] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:39:51.212882] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T18:39:51.214765] [INFO ] [REMOTE ] ETX: Full fetch complete (6815 records). [2025-10-22T18:39:51.214852] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-22T18:39:51.319168] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-22T18:39:51.567175] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-22T18:39:51.567249] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-22T18:39:51.567427] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-22T18:39:51.567466] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-22T18:39:51.567874] [DEBUG] [LOCAL ] ETX: Trimmed 6815 records to 5336 (keeping 200 days of data) [2025-10-22T18:39:51.598926] [DEBUG] [LOCAL ] ETX: Primary data saved (5336 records). [2025-10-22T18:39:51.599010] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-22T18:39:51.599082] [INFO ] [MAIN ] Update Progress: 783/2367 symbols completed. ETX took 19.2s. Estimated remaining: 3h 21m 52s. Rate: 7.8 symbols/min [2025-10-22T18:39:51.764869] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:51.794865] [DEBUG] [LOCAL ] EVEX: Loaded 33007 existing records from primary storage. [2025-10-22T18:39:51.795162] [INFO ] [MAIN ] EVEX: Loaded 33007 existing records. [2025-10-22T18:39:51.965990] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:51.966235] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-22T18:39:51.966317] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-22T18:39:51.966490] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-22T18:39:51.966529] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-22T18:39:52.119207] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-22T18:39:52.311183] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:52.478559] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T18:39:52.917706] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-22T18:39:53.717696] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-22T18:39:53.824276] [DEBUG] [REMOTE ] ETY: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-22T18:39:53.824581] [WARN ] [REMOTE ] ETY: No data returned for month 2025-02 [2025-10-22T18:39:53.824827] [FATAL] [REMOTE ] ETY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:39:53.824924] [FATAL] [MAIN ] ETY: Failed to fetch primary data. [2025-10-22T18:39:53.824991] [WARN ] [MAIN ] ETY: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:39:53.825061] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-22T18:39:53.825124] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-22T18:39:53.825161] [INFO ] [LOCAL ] ETY: Starting deletion of derivative data. [2025-10-22T18:39:53.825285] [DEBUG] [LOCAL ] ETY: Deleted derivative data file. [2025-10-22T18:39:53.825347] [INFO ] [MAIN ] Update Progress: 784/2367 symbols completed. ETY took 7.1s. Estimated remaining: 3h 21m 33s. Rate: 7.9 symbols/min [2025-10-22T18:39:54.002927] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:54.015008] [DEBUG] [LOCAL ] EVF: Loaded 9793 existing records from primary storage. [2025-10-22T18:39:54.015418] [INFO ] [MAIN ] EVF: Loaded 9793 existing records. [2025-10-22T18:39:54.202557] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:54.202937] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-22T18:39:54.203165] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-22T18:39:54.203537] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-22T18:39:54.203673] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-22T18:39:54.263243] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T18:39:54.400522] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-22T18:39:54.521310] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-22T18:39:54.549124] [INFO ] [REMOTE ] ETSY: Full fetch complete (77665 records). [2025-10-22T18:39:54.560331] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-22T18:39:54.708572] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:55.041229] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-22T18:39:55.041328] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-22T18:39:55.042272] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-22T18:39:55.042340] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-22T18:39:55.043874] [DEBUG] [LOCAL ] ETSY: Trimmed 77665 records to 53569 (keeping 200 days of data) [2025-10-22T18:39:55.334389] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-22T18:39:55.359308] [DEBUG] [LOCAL ] ETSY: Primary data saved (53569 records). [2025-10-22T18:39:55.359423] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-22T18:39:55.359521] [INFO ] [MAIN ] Update Progress: 785/2367 symbols completed. ETSY took 48.1s. Estimated remaining: 3h 21m 13s. Rate: 7.9 symbols/min [2025-10-22T18:39:55.535356] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:55.542243] [DEBUG] [LOCAL ] EVG: Loaded 5831 existing records from primary storage. [2025-10-22T18:39:55.542388] [INFO ] [MAIN ] EVG: Loaded 5831 existing records. [2025-10-22T18:39:55.724731] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T18:39:55.747487] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:55.751922] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-22T18:39:55.752177] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-22T18:39:55.752757] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-22T18:39:55.752817] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-22T18:39:56.121468] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:56.117751] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-22T18:39:56.566345] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T18:39:56.917707] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-22T18:39:57.381230] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T18:39:57.717707] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-22T18:39:58.006415] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T18:39:58.441149] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T18:39:58.517695] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-22T18:39:59.317619] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-22T18:39:59.569548] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T18:39:59.958413] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T18:40:00.117732] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-22T18:40:00.917704] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-22T18:40:01.717742] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-22T18:40:02.517715] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-22T18:40:02.718335] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-22T18:40:03.317695] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-22T18:40:03.468478] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T18:40:03.871771] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-10-22T18:40:04.117694] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-22T18:40:04.538226] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T18:40:04.552791] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-10-22T18:40:04.624298] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T18:40:04.917730] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-22T18:40:05.588248] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T18:40:05.717705] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-22T18:40:06.517622] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-22T18:40:06.794986] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:40:07.317726] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-22T18:40:07.529830] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T18:40:08.117696] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-22T18:40:08.320881] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T18:40:08.917732] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-22T18:40:09.132363] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T18:40:09.624293] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T18:40:09.717698] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-22T18:40:10.519782] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-22T18:40:10.522582] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T18:40:11.317734] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-22T18:40:11.953530] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T18:40:11.955433] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T18:40:12.117704] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-22T18:40:12.917716] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-22T18:40:13.554637] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T18:40:13.717714] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-22T18:40:13.744889] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T18:40:14.517683] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-22T18:40:15.317723] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-22T18:40:15.375595] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:40:15.504970] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T18:40:16.117725] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-22T18:40:16.125366] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T18:40:16.917752] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-22T18:40:17.717784] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-22T18:40:17.908008] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T18:40:18.170527] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T18:40:18.178212] [INFO ] [REMOTE ] EVEX: Full fetch complete (44149 records). [2025-10-22T18:40:18.178299] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-22T18:40:18.521523] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-22T18:40:18.553602] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-22T18:40:18.553695] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-22T18:40:18.554389] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-22T18:40:18.554565] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-22T18:40:18.555543] [DEBUG] [LOCAL ] EVEX: Trimmed 44149 records to 33091 (keeping 200 days of data) [2025-10-22T18:40:18.647177] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T18:40:18.749338] [DEBUG] [LOCAL ] EVEX: Primary data saved (33091 records). [2025-10-22T18:40:18.749469] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-22T18:40:18.749561] [INFO ] [MAIN ] Update Progress: 786/2367 symbols completed. EVEX took 27.2s. Estimated remaining: 3h 21m 37s. Rate: 7.8 symbols/min [2025-10-22T18:40:18.913149] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:18.955302] [DEBUG] [LOCAL ] EVH: Loaded 49597 existing records from primary storage. [2025-10-22T18:40:18.955622] [INFO ] [MAIN ] EVH: Loaded 49597 existing records. [2025-10-22T18:40:19.130749] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:19.130931] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-22T18:40:19.130976] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-22T18:40:19.131245] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-22T18:40:19.131282] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-22T18:40:19.316801] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T18:40:19.323057] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-22T18:40:19.510509] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:20.117743] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-22T18:40:20.429086] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T18:40:20.431907] [INFO ] [REMOTE ] EVC: Full fetch complete (28817 records). [2025-10-22T18:40:20.431977] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-22T18:40:20.792970] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-22T18:40:20.793047] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-22T18:40:20.793529] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-22T18:40:20.793570] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-22T18:40:20.794211] [DEBUG] [LOCAL ] EVC: Trimmed 28817 records to 17862 (keeping 200 days of data) [2025-10-22T18:40:20.894095] [DEBUG] [LOCAL ] EVC: Primary data saved (17862 records). [2025-10-22T18:40:20.894222] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-22T18:40:20.894300] [INFO ] [MAIN ] Update Progress: 787/2367 symbols completed. EVC took 32.0s. Estimated remaining: 3h 21m 18s. Rate: 7.8 symbols/min [2025-10-22T18:40:20.929617] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-22T18:40:21.006516] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T18:40:21.074231] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:21.089224] [DEBUG] [LOCAL ] EVN: Loaded 10747 existing records from primary storage. [2025-10-22T18:40:21.089468] [INFO ] [MAIN ] EVN: Loaded 10747 existing records. [2025-10-22T18:40:21.260530] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:21.260782] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-22T18:40:21.260840] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-22T18:40:21.260998] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-22T18:40:21.261054] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-22T18:40:21.604969] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:21.717687] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-22T18:40:22.517674] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-22T18:40:22.688826] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T18:40:22.957405] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T18:40:23.156180] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T18:40:23.317749] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-22T18:40:24.117703] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-22T18:40:24.171820] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T18:40:24.917705] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-22T18:40:24.939230] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T18:40:25.717756] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-22T18:40:26.100202] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T18:40:26.102730] [INFO ] [REMOTE ] EVF: Full fetch complete (12857 records). [2025-10-22T18:40:26.102816] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-22T18:40:26.460843] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-22T18:40:26.460915] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-22T18:40:26.461182] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-22T18:40:26.461220] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-22T18:40:26.461738] [DEBUG] [LOCAL ] EVF: Trimmed 12857 records to 9694 (keeping 200 days of data) [2025-10-22T18:40:26.518544] [DEBUG] [LOCAL ] EVF: Primary data saved (9694 records). [2025-10-22T18:40:26.518785] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-22T18:40:26.519017] [INFO ] [MAIN ] Update Progress: 788/2367 symbols completed. EVF took 32.7s. Estimated remaining: 3h 21m 7s. Rate: 7.9 symbols/min [2025-10-22T18:40:26.518862] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-22T18:40:26.687760] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:26.719951] [DEBUG] [LOCAL ] EVR: Loaded 33850 existing records from primary storage. [2025-10-22T18:40:26.720208] [INFO ] [MAIN ] EVR: Loaded 33850 existing records. [2025-10-22T18:40:26.893723] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:26.893929] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-22T18:40:26.893998] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-22T18:40:26.894215] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-22T18:40:26.894278] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-22T18:40:27.245860] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:27.283767] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:40:27.317615] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-22T18:40:27.337221] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T18:40:28.117766] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-22T18:40:28.757339] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T18:40:28.917665] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-22T18:40:29.019796] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T18:40:29.718010] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-22T18:40:29.719868] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T18:40:30.517736] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-22T18:40:31.317672] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-22T18:40:31.424989] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T18:40:32.117620] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-22T18:40:32.177930] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T18:40:32.268797] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T18:40:32.917693] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-22T18:40:33.555154] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T18:40:33.584178] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T18:40:33.717628] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-22T18:40:34.517718] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-22T18:40:34.605041] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T18:40:34.606491] [INFO ] [REMOTE ] EVG: Full fetch complete (8093 records). [2025-10-22T18:40:34.606560] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-22T18:40:34.960480] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-22T18:40:34.960561] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-22T18:40:34.960806] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-22T18:40:34.960873] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-22T18:40:34.961286] [DEBUG] [LOCAL ] EVG: Trimmed 8093 records to 5750 (keeping 200 days of data) [2025-10-22T18:40:34.996413] [DEBUG] [LOCAL ] EVG: Primary data saved (5750 records). [2025-10-22T18:40:34.996535] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-22T18:40:34.996618] [INFO ] [MAIN ] Update Progress: 789/2367 symbols completed. EVG took 39.6s. Estimated remaining: 3h 21m 1s. Rate: 7.9 symbols/min [2025-10-22T18:40:35.173772] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:35.173987] [DEBUG] [LOCAL ] EVT: No existing data file found in primary storage. [2025-10-22T18:40:35.174031] [WARN ] [MAIN ] EVT: No existing data found, performing full refresh instead. [2025-10-22T18:40:35.174168] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-22T18:40:35.174230] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-22T18:40:35.174279] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-10-22T18:40:35.174313] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-22T18:40:35.322817] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-22T18:40:35.483827] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T18:40:35.596694] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:36.117727] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-22T18:40:36.882366] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T18:40:36.917748] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-22T18:40:37.523951] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:40:37.717694] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-22T18:40:37.960332] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T18:40:38.517723] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-22T18:40:38.923707] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T18:40:39.317688] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-22T18:40:39.478926] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T18:40:39.481309] [INFO ] [REMOTE ] EVN: Full fetch complete (17111 records). [2025-10-22T18:40:39.481395] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-22T18:40:39.843245] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-22T18:40:39.843316] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-22T18:40:39.843688] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-22T18:40:39.843748] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-22T18:40:39.844223] [DEBUG] [LOCAL ] EVN: Trimmed 17111 records to 10780 (keeping 200 days of data) [2025-10-22T18:40:39.907812] [DEBUG] [LOCAL ] EVN: Primary data saved (10780 records). [2025-10-22T18:40:39.907933] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-22T18:40:39.908009] [INFO ] [MAIN ] Update Progress: 790/2367 symbols completed. EVN took 19.0s. Estimated remaining: 3h 20m 48s. Rate: 7.9 symbols/min [2025-10-22T18:40:40.070942] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:40.096265] [DEBUG] [LOCAL ] EVTC: Loaded 26869 existing records from primary storage. [2025-10-22T18:40:40.096503] [INFO ] [MAIN ] EVTC: Loaded 26869 existing records. [2025-10-22T18:40:40.126450] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-22T18:40:40.275553] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:40.275829] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-22T18:40:40.275881] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-22T18:40:40.276065] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-22T18:40:40.276106] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-22T18:40:40.656457] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:40.845514] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:40:40.917700] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-22T18:40:41.603719] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T18:40:41.717691] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-22T18:40:42.517690] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-22T18:40:42.744091] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T18:40:43.317687] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-22T18:40:43.369895] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T18:40:43.559919] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T18:40:44.117738] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-22T18:40:44.594976] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T18:40:44.917728] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-22T18:40:45.717678] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-22T18:40:45.904386] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T18:40:46.313153] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:40:46.517720] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-22T18:40:46.992929] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T18:40:47.317789] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-22T18:40:48.019551] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T18:40:48.117704] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-22T18:40:48.371751] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T18:40:48.917717] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-22T18:40:49.271013] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T18:40:49.717701] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-22T18:40:50.125386] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T18:40:50.356448] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T18:40:50.517718] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-22T18:40:51.317694] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-22T18:40:52.117677] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-22T18:40:52.196872] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T18:40:52.650062] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T18:40:52.917699] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-22T18:40:53.009396] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T18:40:53.717712] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-22T18:40:54.104789] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T18:40:54.109669] [INFO ] [REMOTE ] EVR: Full fetch complete (50626 records). [2025-10-22T18:40:54.109766] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-22T18:40:54.481766] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-22T18:40:54.481859] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-22T18:40:54.482547] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-22T18:40:54.482591] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-22T18:40:54.483591] [DEBUG] [LOCAL ] EVR: Trimmed 50626 records to 33601 (keeping 200 days of data) [2025-10-22T18:40:54.540557] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-22T18:40:54.704260] [DEBUG] [LOCAL ] EVR: Primary data saved (33601 records). [2025-10-22T18:40:54.704620] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T18:40:54.708690] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-22T18:40:54.709324] [INFO ] [MAIN ] Update Progress: 791/2367 symbols completed. EVR took 28.2s. Estimated remaining: 3h 20m 54s. Rate: 7.8 symbols/min [2025-10-22T18:40:54.892340] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:54.928465] [DEBUG] [LOCAL ] EVTL: Loaded 41214 existing records from primary storage. [2025-10-22T18:40:54.928767] [INFO ] [MAIN ] EVTL: Loaded 41214 existing records. [2025-10-22T18:40:55.099880] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:55.100075] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-22T18:40:55.100125] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-22T18:40:55.100293] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-22T18:40:55.100330] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-22T18:40:55.322874] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-22T18:40:55.453010] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:55.904579] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T18:40:56.117752] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-22T18:40:56.917686] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-22T18:40:57.084023] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T18:40:57.431722] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-22T18:40:57.440449] [INFO ] [REMOTE ] EVH: Full fetch complete (71867 records). [2025-10-22T18:40:57.440624] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-22T18:40:57.727383] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-22T18:40:57.873566] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-22T18:40:57.873677] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-22T18:40:57.874884] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-22T18:40:57.874951] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-22T18:40:57.876337] [DEBUG] [LOCAL ] EVH: Trimmed 71867 records to 49602 (keeping 200 days of data) [2025-10-22T18:40:58.171725] [DEBUG] [LOCAL ] EVH: Primary data saved (49602 records). [2025-10-22T18:40:58.171877] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-22T18:40:58.171961] [INFO ] [MAIN ] Update Progress: 792/2367 symbols completed. EVH took 39.4s. Estimated remaining: 3h 20m 38s. Rate: 7.8 symbols/min [2025-10-22T18:40:58.348173] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:58.366197] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T18:40:58.396007] [DEBUG] [LOCAL ] EVTR: Loaded 25297 existing records from primary storage. [2025-10-22T18:40:58.396289] [INFO ] [MAIN ] EVTR: Loaded 25297 existing records. [2025-10-22T18:40:58.522875] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-22T18:40:58.574744] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:58.575160] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-22T18:40:58.575214] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-22T18:40:58.575397] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-22T18:40:58.575437] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-22T18:40:58.927678] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:59.295875] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T18:40:59.317604] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-22T18:40:59.723478] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T18:41:00.117705] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-22T18:41:00.917690] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-22T18:41:01.207022] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T18:41:01.603106] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T18:41:01.717729] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-22T18:41:02.517748] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-22T18:41:02.720761] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T18:41:03.317678] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-22T18:41:03.438881] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:41:03.500822] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:41:03.503628] [INFO ] [REMOTE ] EVT: Full fetch complete (25082 records). [2025-10-22T18:41:03.503731] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-22T18:41:03.907904] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-22T18:41:03.907972] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-22T18:41:03.908489] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-22T18:41:03.908529] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-22T18:41:03.909245] [DEBUG] [LOCAL ] EVT: Trimmed 25082 records to 16515 (keeping 200 days of data) [2025-10-22T18:41:04.005663] [DEBUG] [LOCAL ] EVT: Primary data saved (16515 records). [2025-10-22T18:41:04.005801] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-22T18:41:04.005872] [INFO ] [MAIN ] Update Progress: 793/2367 symbols completed. EVT took 29.0s. Estimated remaining: 3h 20m 27s. Rate: 7.9 symbols/min [2025-10-22T18:41:04.122753] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-22T18:41:04.173790] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:04.220688] [DEBUG] [LOCAL ] EW: Loaded 53399 existing records from primary storage. [2025-10-22T18:41:04.220990] [INFO ] [MAIN ] EW: Loaded 53399 existing records. [2025-10-22T18:41:04.419356] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:04.419581] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-22T18:41:04.419753] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-22T18:41:04.420031] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-22T18:41:04.420086] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-22T18:41:04.684792] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T18:41:04.797330] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:04.917618] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-22T18:41:05.292202] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T18:41:05.717731] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-22T18:41:05.778798] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T18:41:06.517741] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-22T18:41:07.007164] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T18:41:07.317701] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-22T18:41:08.117700] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-22T18:41:08.384669] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T18:41:08.592852] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T18:41:08.917737] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-22T18:41:09.247833] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T18:41:09.717707] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-22T18:41:10.300597] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T18:41:10.305822] [INFO ] [REMOTE ] EVTC: Full fetch complete (38496 records). [2025-10-22T18:41:10.306004] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-22T18:41:10.529028] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-22T18:41:10.689076] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-22T18:41:10.689150] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-22T18:41:10.689737] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-22T18:41:10.689798] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-22T18:41:10.690618] [DEBUG] [LOCAL ] EVTC: Trimmed 38496 records to 26785 (keeping 200 days of data) [2025-10-22T18:41:10.861276] [DEBUG] [LOCAL ] EVTC: Primary data saved (26785 records). [2025-10-22T18:41:10.861433] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-22T18:41:10.861537] [INFO ] [MAIN ] Update Progress: 794/2367 symbols completed. EVTC took 31.0s. Estimated remaining: 3h 20m 18s. Rate: 7.9 symbols/min [2025-10-22T18:41:11.031038] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:11.062683] [DEBUG] [LOCAL ] EXG: Loaded 33695 existing records from primary storage. [2025-10-22T18:41:11.062961] [INFO ] [MAIN ] EXG: Loaded 33695 existing records. [2025-10-22T18:41:11.243254] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:11.243586] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-22T18:41:11.243755] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-22T18:41:11.244070] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-22T18:41:11.244141] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-22T18:41:11.346585] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-22T18:41:11.607347] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T18:41:11.652393] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:12.117700] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-22T18:41:12.250002] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T18:41:12.407454] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T18:41:12.917667] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-22T18:41:13.717704] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-22T18:41:13.914354] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T18:41:14.084506] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T18:41:14.517696] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-22T18:41:15.317677] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-22T18:41:15.348126] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:41:15.633476] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T18:41:16.117683] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-22T18:41:16.917704] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-22T18:41:16.974979] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T18:41:17.193273] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:41:17.717690] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-22T18:41:18.517623] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-22T18:41:18.751544] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T18:41:18.962845] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T18:41:19.317726] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-22T18:41:20.117628] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-22T18:41:20.445092] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T18:41:20.570080] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T18:41:20.917694] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-22T18:41:21.717722] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-22T18:41:22.445505] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-22T18:41:22.517712] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-22T18:41:22.589490] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T18:41:23.165471] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T18:41:23.317695] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-22T18:41:24.117796] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-22T18:41:24.729084] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T18:41:24.881700] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-22T18:41:24.890353] [INFO ] [REMOTE ] EVTL: Full fetch complete (54902 records). [2025-10-22T18:41:24.890501] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-22T18:41:24.923117] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-22T18:41:25.289903] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-22T18:41:25.290046] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-22T18:41:25.290847] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-22T18:41:25.290920] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-22T18:41:25.292393] [DEBUG] [LOCAL ] EVTL: Trimmed 54902 records to 41363 (keeping 200 days of data) [2025-10-22T18:41:25.395341] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:41:25.547484] [DEBUG] [LOCAL ] EVTL: Primary data saved (41363 records). [2025-10-22T18:41:25.547612] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-22T18:41:25.547741] [INFO ] [MAIN ] Update Progress: 795/2367 symbols completed. EVTL took 30.8s. Estimated remaining: 3h 20m 24s. Rate: 7.8 symbols/min [2025-10-22T18:41:25.711174] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:25.717719] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-22T18:41:25.761290] [DEBUG] [LOCAL ] EXK: Loaded 53186 existing records from primary storage. [2025-10-22T18:41:25.761685] [INFO ] [MAIN ] EXK: Loaded 53186 existing records. [2025-10-22T18:41:25.946760] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:25.947009] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-22T18:41:25.947056] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-22T18:41:25.947326] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-22T18:41:25.947384] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-22T18:41:26.323704] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:26.517705] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-22T18:41:26.805295] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T18:41:27.191260] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T18:41:27.317766] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-22T18:41:28.117695] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-22T18:41:28.598682] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T18:41:28.785856] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T18:41:28.917713] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-22T18:41:29.502015] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T18:41:29.508889] [INFO ] [REMOTE ] EVTR: Full fetch complete (33922 records). [2025-10-22T18:41:29.509001] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-22T18:41:29.726750] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-22T18:41:29.910094] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-22T18:41:29.910198] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-22T18:41:29.910785] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-22T18:41:29.910848] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-22T18:41:29.911777] [DEBUG] [LOCAL ] EVTR: Trimmed 33922 records to 25397 (keeping 200 days of data) [2025-10-22T18:41:30.063994] [DEBUG] [LOCAL ] EVTR: Primary data saved (25397 records). [2025-10-22T18:41:30.064114] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-22T18:41:30.064189] [INFO ] [MAIN ] Update Progress: 796/2367 symbols completed. EVTR took 31.9s. Estimated remaining: 3h 20m 10s. Rate: 7.8 symbols/min [2025-10-22T18:41:30.234720] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:30.262427] [DEBUG] [LOCAL ] EXP: Loaded 29339 existing records from primary storage. [2025-10-22T18:41:30.262707] [INFO ] [MAIN ] EXP: Loaded 29339 existing records. [2025-10-22T18:41:30.443144] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:30.443451] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-22T18:41:30.443520] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-22T18:41:30.443735] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-22T18:41:30.443797] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-22T18:41:30.522066] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-22T18:41:30.594450] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T18:41:30.848251] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:31.317617] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-22T18:41:31.425322] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:41:31.902330] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T18:41:32.117623] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-22T18:41:32.927820] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-22T18:41:32.933611] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T18:41:33.502055] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T18:41:33.717710] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-22T18:41:34.517780] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-22T18:41:34.581466] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:41:35.317695] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-22T18:41:35.606037] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T18:41:36.117715] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-22T18:41:36.368507] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T18:41:36.787589] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T18:41:36.917617] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-22T18:41:37.499463] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:41:37.717686] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-22T18:41:38.094219] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T18:41:38.517719] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-22T18:41:39.045561] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T18:41:39.323235] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-22T18:41:39.334040] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T18:41:40.117736] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-22T18:41:40.917734] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-22T18:41:41.434474] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T18:41:41.439874] [INFO ] [REMOTE ] EXG: Full fetch complete (49605 records). [2025-10-22T18:41:41.439966] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-22T18:41:41.717845] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-22T18:41:41.762625] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-22T18:41:41.863666] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-22T18:41:41.863768] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-22T18:41:41.864445] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-22T18:41:41.864487] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-22T18:41:41.865618] [DEBUG] [LOCAL ] EXG: Trimmed 49605 records to 33614 (keeping 200 days of data) [2025-10-22T18:41:42.058996] [DEBUG] [LOCAL ] EXG: Primary data saved (33614 records). [2025-10-22T18:41:42.059123] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-22T18:41:42.059199] [INFO ] [MAIN ] Update Progress: 797/2367 symbols completed. EXG took 31.2s. Estimated remaining: 3h 20m 11s. Rate: 7.8 symbols/min [2025-10-22T18:41:42.517722] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-22T18:41:42.738520] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T18:41:42.747311] [INFO ] [REMOTE ] EW: Full fetch complete (77515 records). [2025-10-22T18:41:42.747435] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-22T18:41:43.105106] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:41:43.172563] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-22T18:41:43.172639] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-22T18:41:43.173798] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-22T18:41:43.173881] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-22T18:41:43.175872] [DEBUG] [LOCAL ] EW: Trimmed 77515 records to 53399 (keeping 200 days of data) [2025-10-22T18:41:43.343934] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-22T18:41:43.493364] [DEBUG] [LOCAL ] EW: Primary data saved (53399 records). [2025-10-22T18:41:43.493508] [INFO ] [MAIN ] EW: Full history saved. [2025-10-22T18:41:43.493585] [INFO ] [MAIN ] Update Progress: 798/2367 symbols completed. EW took 39.5s. Estimated remaining: 3h 19m 51s. Rate: 7.9 symbols/min [2025-10-22T18:41:43.981000] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T18:41:44.117694] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-22T18:41:44.834571] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:41:44.917700] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-22T18:41:45.848147] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T18:41:45.858802] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-22T18:41:46.126392] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T18:41:46.517732] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-22T18:41:47.883521] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T18:41:47.900411] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-22T18:41:47.939776] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:41:48.117694] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-22T18:41:49.345736] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T18:41:49.351705] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-22T18:41:49.786137] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T18:41:49.797427] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-22T18:41:50.316919] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T18:41:50.517724] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-22T18:41:51.768968] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T18:41:51.780430] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-22T18:41:51.981438] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T18:41:51.986114] [INFO ] [REMOTE ] EXP: Full fetch complete (43031 records). [2025-10-22T18:41:51.986200] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-22T18:41:52.364257] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-22T18:41:52.364340] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-22T18:41:52.364972] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-22T18:41:52.365034] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-22T18:41:52.366000] [DEBUG] [LOCAL ] EXP: Trimmed 43031 records to 29175 (keeping 200 days of data) [2025-10-22T18:41:52.541950] [DEBUG] [LOCAL ] EXP: Primary data saved (29175 records). [2025-10-22T18:41:52.542076] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-22T18:41:52.542156] [INFO ] [MAIN ] Update Progress: 799/2367 symbols completed. EXP took 22.5s. Estimated remaining: 3h 19m 46s. Rate: 7.8 symbols/min [2025-10-22T18:41:54.154919] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-22T18:41:54.164094] [INFO ] [REMOTE ] EXK: Full fetch complete (76846 records). [2025-10-22T18:41:54.164230] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-22T18:41:54.585673] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-22T18:41:54.585763] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-22T18:41:54.586710] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-22T18:41:54.586777] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-22T18:41:54.588250] [DEBUG] [LOCAL ] EXK: Trimmed 76846 records to 53187 (keeping 200 days of data) [2025-10-22T18:41:54.892591] [DEBUG] [LOCAL ] EXK: Primary data saved (53187 records). [2025-10-22T18:41:54.892767] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-22T18:41:54.892856] [INFO ] [MAIN ] Update Progress: 800/2367 symbols completed. EXK took 29.3s. Estimated remaining: 3h 19m 28s. Rate: 7.9 symbols/min [2025-10-22T18:41:55.429166] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:55.550568] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:55.514392] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:55.600838] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:55.671342] [DEBUG] [LOCAL ] FAF: Loaded 41479 existing records from primary storage. [2025-10-22T18:41:55.671980] [INFO ] [MAIN ] FAF: Loaded 41479 existing records. [2025-10-22T18:41:55.801639] [DEBUG] [LOCAL ] EXPD: Loaded 47765 existing records from primary storage. [2025-10-22T18:41:55.802763] [DEBUG] [LOCAL ] EXR: Loaded 45544 existing records from primary storage. [2025-10-22T18:41:55.823377] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-22T18:41:55.823612] [INFO ] [MAIN ] EXR: Loaded 45544 existing records. [2025-10-22T18:41:55.822684] [INFO ] [MAIN ] EXPD: Loaded 47765 existing records. [2025-10-22T18:41:55.861224] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-22T18:41:56.083304] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:56.225962] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-22T18:41:56.234543] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-22T18:41:56.276573] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-22T18:41:56.306124] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-22T18:41:56.505463] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:56.509010] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:56.541860] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-22T18:41:56.502819] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:56.542478] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-22T18:41:56.542274] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-22T18:41:56.542673] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-22T18:41:56.542351] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-22T18:41:56.542855] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-22T18:41:56.558470] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-22T18:41:56.563748] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-22T18:41:56.569064] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-22T18:41:56.574667] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-22T18:41:56.574613] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-22T18:41:56.574545] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-22T18:41:57.839000] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:57.883989] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:57.921830] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-22T18:41:57.922205] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-22T18:41:57.970125] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:58.000584] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-22T18:41:58.029816] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:58.030112] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-22T18:41:59.401397] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T18:41:59.409082] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-22T18:41:59.675519] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:41:59.685593] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-22T18:41:59.713056] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T18:41:59.724164] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-22T18:42:00.462951] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-22T18:42:00.474054] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-22T18:42:01.205121] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T18:42:01.212037] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-22T18:42:01.751166] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T18:42:01.760213] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-22T18:42:01.803988] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-22T18:42:01.812973] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-22T18:42:03.201934] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T18:42:03.211242] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-22T18:42:03.337580] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-10-22T18:42:03.347597] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-22T18:42:03.404128] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:42:03.414554] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-22T18:42:04.147479] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-22T18:42:04.157216] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-22T18:42:04.841080] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T18:42:04.850264] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-22T18:42:05.220053] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T18:42:05.230372] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-22T18:42:05.691422] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-22T18:42:05.717728] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-22T18:42:05.784513] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T18:42:06.353945] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T18:42:06.517674] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-22T18:42:06.840804] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T18:42:07.317677] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-22T18:42:08.047329] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:42:08.117613] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-22T18:42:08.309943] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-22T18:42:08.609162] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T18:42:08.917720] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-22T18:42:09.717714] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-22T18:42:09.836187] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T18:42:10.517694] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-22T18:42:11.317681] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-22T18:42:11.425231] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T18:42:11.589951] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-22T18:42:11.972328] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:42:12.117711] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-22T18:42:12.583783] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T18:42:12.917728] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-22T18:42:13.121069] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T18:42:13.717695] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-22T18:42:14.517729] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-22T18:42:15.317898] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-22T18:42:15.393497] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-22T18:42:15.438501] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T18:42:16.117694] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-22T18:42:16.294624] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:42:16.300982] [INFO ] [REMOTE ] FAF: Full fetch complete (58302 records). [2025-10-22T18:42:16.301065] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-22T18:42:16.678033] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-22T18:42:16.678114] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-22T18:42:16.678873] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-22T18:42:16.678944] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-22T18:42:16.680070] [DEBUG] [LOCAL ] FAF: Trimmed 58302 records to 41432 (keeping 200 days of data) [2025-10-22T18:42:16.917687] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-22T18:42:16.933036] [DEBUG] [LOCAL ] FAF: Primary data saved (41432 records). [2025-10-22T18:42:16.933269] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-22T18:42:16.933475] [INFO ] [MAIN ] Update Progress: 801/2367 symbols completed. FAF took 22.0s. Estimated remaining: 3h 19m 49s. Rate: 7.8 symbols/min [2025-10-22T18:42:17.103241] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:17.134884] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:42:17.184168] [DEBUG] [LOCAL ] FBIN: Loaded 50399 existing records from primary storage. [2025-10-22T18:42:17.184485] [INFO ] [MAIN ] FBIN: Loaded 50399 existing records. [2025-10-22T18:42:17.362769] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:17.363009] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-22T18:42:17.363065] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-22T18:42:17.363271] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-22T18:42:17.363334] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-22T18:42:17.713495] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:17.726128] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-22T18:42:17.743742] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:42:18.517706] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-22T18:42:19.317717] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-22T18:42:19.561812] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-22T18:42:19.769792] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T18:42:20.117684] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-22T18:42:20.315822] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T18:42:20.489228] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T18:42:20.917698] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-22T18:42:21.722424] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-22T18:42:21.728540] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:42:22.517676] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-22T18:42:22.727130] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T18:42:22.734914] [INFO ] [REMOTE ] EXPD: Full fetch complete (69479 records). [2025-10-22T18:42:22.735031] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-22T18:42:23.115146] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-22T18:42:23.115228] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-22T18:42:23.116055] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-22T18:42:23.116118] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-22T18:42:23.117380] [DEBUG] [LOCAL ] EXPD: Trimmed 69479 records to 47729 (keeping 200 days of data) [2025-10-22T18:42:23.323892] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-22T18:42:23.402836] [DEBUG] [LOCAL ] EXPD: Primary data saved (47729 records). [2025-10-22T18:42:23.402949] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-22T18:42:23.403038] [INFO ] [MAIN ] Update Progress: 802/2367 symbols completed. EXPD took 28.5s. Estimated remaining: 3h 19m 39s. Rate: 7.8 symbols/min [2025-10-22T18:42:23.567097] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:23.593084] [DEBUG] [LOCAL ] FBK: Loaded 27486 existing records from primary storage. [2025-10-22T18:42:23.593338] [INFO ] [MAIN ] FBK: Loaded 27486 existing records. [2025-10-22T18:42:23.777088] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:23.777319] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-22T18:42:23.777368] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-22T18:42:23.777534] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-22T18:42:23.777574] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-22T18:42:24.160508] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:24.161221] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-22T18:42:24.203407] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:42:24.289161] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-22T18:42:24.733036] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T18:42:24.917704] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-22T18:42:25.343123] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:42:25.717710] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-22T18:42:26.517681] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-22T18:42:26.724361] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T18:42:27.317692] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-22T18:42:27.375719] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-22T18:42:28.123070] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-22T18:42:28.143557] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T18:42:28.151604] [INFO ] [REMOTE ] EXR: Full fetch complete (66241 records). [2025-10-22T18:42:28.151747] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-22T18:42:28.322716] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T18:42:28.581296] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-22T18:42:28.581380] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-22T18:42:28.582184] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-22T18:42:28.582249] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-22T18:42:28.583549] [DEBUG] [LOCAL ] EXR: Trimmed 66241 records to 45503 (keeping 200 days of data) [2025-10-22T18:42:28.855972] [DEBUG] [LOCAL ] EXR: Primary data saved (45503 records). [2025-10-22T18:42:28.856103] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-22T18:42:28.856184] [INFO ] [MAIN ] Update Progress: 803/2367 symbols completed. EXR took 34.0s. Estimated remaining: 3h 19m 27s. Rate: 7.8 symbols/min [2025-10-22T18:42:28.918699] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-22T18:42:29.023198] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:29.062825] [DEBUG] [LOCAL ] FBP: Loaded 45626 existing records from primary storage. [2025-10-22T18:42:29.063119] [INFO ] [MAIN ] FBP: Loaded 45626 existing records. [2025-10-22T18:42:29.236984] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:29.248033] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-22T18:42:29.248167] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-22T18:42:29.249218] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T18:42:29.253778] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-22T18:42:29.254152] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-22T18:42:29.591598] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:29.717616] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-22T18:42:29.942207] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T18:42:29.950967] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-22T18:42:29.951126] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-22T18:42:30.360462] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-22T18:42:30.360553] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-22T18:42:30.361492] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-22T18:42:30.361563] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-22T18:42:30.363061] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-22T18:42:30.547613] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-22T18:42:30.705090] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-22T18:42:30.705241] [INFO ] [MAIN ] F: Full history saved. [2025-10-22T18:42:30.705321] [INFO ] [MAIN ] Update Progress: 804/2367 symbols completed. F took 35.8s. Estimated remaining: 3h 19m 8s. Rate: 7.8 symbols/min [2025-10-22T18:42:30.880132] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:30.880296] [DEBUG] [LOCAL ] FBRT: No existing data file found in primary storage. [2025-10-22T18:42:30.880335] [WARN ] [MAIN ] FBRT: No existing data found, performing full refresh instead. [2025-10-22T18:42:30.880443] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-22T18:42:30.880485] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-22T18:42:30.880527] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-10-22T18:42:30.880560] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-22T18:42:31.242835] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:31.317670] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-22T18:42:31.351622] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:42:32.117789] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-22T18:42:32.478203] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T18:42:32.682906] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T18:42:32.917746] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-22T18:42:33.001740] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T18:42:33.717708] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-22T18:42:34.518609] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-22T18:42:34.518527] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T18:42:35.266151] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T18:42:35.317711] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-22T18:42:35.865140] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T18:42:36.117695] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-22T18:42:36.396478] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:42:36.917749] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-22T18:42:37.717692] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-22T18:42:37.821802] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T18:42:37.869768] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T18:42:38.517701] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-22T18:42:39.002180] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:42:39.317728] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-22T18:42:40.117733] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-22T18:42:40.190973] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:42:40.805123] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T18:42:40.917727] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-22T18:42:41.683935] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T18:42:41.717609] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-22T18:42:42.517688] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-22T18:42:42.744993] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T18:42:43.322791] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-22T18:42:43.335283] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T18:42:44.117618] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-22T18:42:44.159021] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T18:42:44.917723] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-22T18:42:45.006550] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T18:42:45.456192] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-22T18:42:45.717751] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-22T18:42:46.517678] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-22T18:42:46.563561] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T18:42:47.317623] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-22T18:42:47.419826] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T18:42:47.427332] [INFO ] [REMOTE ] FBIN: Full fetch complete (72655 records). [2025-10-22T18:42:47.427450] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-22T18:42:47.428310] [FATAL] [VALIDATOR ] FBIN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:42:47.428400] [FATAL] [MAIN ] FBIN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:42:47.428443] [WARN ] [MAIN ] FBIN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:42:47.428483] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-22T18:42:47.428540] [DEBUG] [LOCAL ] FBIN: No primary data file found to delete. [2025-10-22T18:42:47.428575] [INFO ] [LOCAL ] FBIN: Starting deletion of derivative data. [2025-10-22T18:42:47.428748] [DEBUG] [LOCAL ] FBIN: Deleted derivative data file. [2025-10-22T18:42:47.428839] [INFO ] [MAIN ] Update Progress: 805/2367 symbols completed. FBIN took 30.5s. Estimated remaining: 3h 19m 18s. Rate: 7.8 symbols/min [2025-10-22T18:42:47.597341] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:47.612884] [DEBUG] [LOCAL ] FC: Loaded 14475 existing records from primary storage. [2025-10-22T18:42:47.613116] [INFO ] [MAIN ] FC: Loaded 14475 existing records. [2025-10-22T18:42:47.794215] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:47.794505] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-22T18:42:47.794745] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-22T18:42:47.794928] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-22T18:42:47.794971] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-22T18:42:48.102331] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T18:42:48.124356] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-22T18:42:48.189421] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:48.579789] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:42:48.917707] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-22T18:42:49.574037] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T18:42:49.717628] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-22T18:42:50.309822] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T18:42:50.517700] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-22T18:42:51.053597] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T18:42:51.317626] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-22T18:42:51.532086] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T18:42:52.117722] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-22T18:42:52.618116] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T18:42:52.917726] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-22T18:42:53.264121] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T18:42:53.717716] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-22T18:42:54.314531] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T18:42:54.320381] [INFO ] [REMOTE ] FBK: Full fetch complete (35562 records). [2025-10-22T18:42:54.320507] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-22T18:42:54.522799] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-22T18:42:54.707185] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-22T18:42:54.707256] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-22T18:42:54.707860] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-22T18:42:54.707922] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-22T18:42:54.708726] [DEBUG] [LOCAL ] FBK: Trimmed 35562 records to 27466 (keeping 200 days of data) [2025-10-22T18:42:54.869474] [DEBUG] [LOCAL ] FBK: Primary data saved (27466 records). [2025-10-22T18:42:54.869594] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-22T18:42:54.869690] [INFO ] [MAIN ] Update Progress: 806/2367 symbols completed. FBK took 31.5s. Estimated remaining: 3h 19m 10s. Rate: 7.8 symbols/min [2025-10-22T18:42:55.036810] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:55.073255] [DEBUG] [LOCAL ] FCF: Loaded 39218 existing records from primary storage. [2025-10-22T18:42:55.073534] [INFO ] [MAIN ] FCF: Loaded 39218 existing records. [2025-10-22T18:42:55.253371] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:55.253599] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-22T18:42:55.253673] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-22T18:42:55.253866] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-22T18:42:55.253904] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-22T18:42:55.326753] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-22T18:42:55.560245] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T18:42:55.681664] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:55.686633] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T18:42:56.117694] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-22T18:42:56.917712] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-22T18:42:57.021477] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T18:42:57.028411] [INFO ] [REMOTE ] FBRT: Full fetch complete (49526 records). [2025-10-22T18:42:57.028557] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-22T18:42:57.176997] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T18:42:57.412940] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-22T18:42:57.413018] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-22T18:42:57.413687] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-22T18:42:57.413750] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-22T18:42:57.414835] [DEBUG] [LOCAL ] FBRT: Trimmed 49526 records to 35216 (keeping 200 days of data) [2025-10-22T18:42:57.626674] [DEBUG] [LOCAL ] FBRT: Primary data saved (35216 records). [2025-10-22T18:42:57.626821] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-22T18:42:57.626911] [INFO ] [MAIN ] Update Progress: 807/2367 symbols completed. FBRT took 26.9s. Estimated remaining: 3h 18m 53s. Rate: 7.8 symbols/min [2025-10-22T18:42:57.722776] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-22T18:42:57.803597] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:57.829039] [DEBUG] [LOCAL ] FCN: Loaded 25874 existing records from primary storage. [2025-10-22T18:42:57.829280] [INFO ] [MAIN ] FCN: Loaded 25874 existing records. [2025-10-22T18:42:58.002391] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:58.002608] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-22T18:42:58.002682] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-22T18:42:58.002870] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-22T18:42:58.002909] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-22T18:42:58.369177] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:58.392435] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:42:58.517684] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-22T18:42:59.317722] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-22T18:42:59.477390] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T18:42:59.694687] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:43:00.117702] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-22T18:43:00.696186] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:43:00.917687] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-22T18:43:01.717694] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-22T18:43:01.853282] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T18:43:01.860965] [INFO ] [REMOTE ] FBP: Full fetch complete (66781 records). [2025-10-22T18:43:01.861068] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-22T18:43:02.284571] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-22T18:43:02.285966] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T18:43:02.285392] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-22T18:43:02.292133] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-22T18:43:02.292214] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-22T18:43:02.293427] [DEBUG] [LOCAL ] FBP: Trimmed 66781 records to 45588 (keeping 200 days of data) [2025-10-22T18:43:02.519676] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-22T18:43:02.565460] [DEBUG] [LOCAL ] FBP: Primary data saved (45588 records). [2025-10-22T18:43:02.565571] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-22T18:43:02.565676] [INFO ] [MAIN ] Update Progress: 808/2367 symbols completed. FBP took 33.7s. Estimated remaining: 3h 18m 40s. Rate: 7.8 symbols/min [2025-10-22T18:43:02.728343] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:02.762951] [DEBUG] [LOCAL ] FCPT: Loaded 37077 existing records from primary storage. [2025-10-22T18:43:02.763217] [INFO ] [MAIN ] FCPT: Loaded 37077 existing records. [2025-10-22T18:43:02.940303] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:43:02.940524] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-22T18:43:02.940581] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-22T18:43:02.940831] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-22T18:43:02.940888] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-22T18:43:03.299937] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:03.317623] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-22T18:43:03.393861] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:43:03.805354] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T18:43:04.117687] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-22T18:43:04.396966] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T18:43:04.919996] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-22T18:43:04.921960] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T18:43:05.717720] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-22T18:43:06.305429] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:43:06.517678] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-22T18:43:07.314377] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:43:07.320927] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-22T18:43:07.425135] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T18:43:08.117707] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-22T18:43:08.201918] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T18:43:08.917750] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-22T18:43:09.717707] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-22T18:43:09.838454] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T18:43:10.219526] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T18:43:10.396896] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T18:43:10.517626] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-22T18:43:11.317757] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-22T18:43:11.416947] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T18:43:12.117694] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-22T18:43:12.427099] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T18:43:12.917733] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-22T18:43:13.531695] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T18:43:13.717680] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-22T18:43:14.517708] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-22T18:43:15.112479] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T18:43:15.317719] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-22T18:43:16.123437] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-22T18:43:16.125198] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-22T18:43:16.150675] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:43:16.922865] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-22T18:43:16.938542] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T18:43:17.137021] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T18:43:17.139535] [INFO ] [REMOTE ] FC: Full fetch complete (21790 records). [2025-10-22T18:43:17.139616] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-22T18:43:17.140104] [FATAL] [VALIDATOR ] FC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:43:17.140186] [FATAL] [MAIN ] FC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:43:17.140229] [WARN ] [MAIN ] FC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:43:17.140341] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-22T18:43:17.140417] [DEBUG] [LOCAL ] FC: No primary data file found to delete. [2025-10-22T18:43:17.140455] [INFO ] [LOCAL ] FC: Starting deletion of derivative data. [2025-10-22T18:43:17.140604] [DEBUG] [LOCAL ] FC: Deleted derivative data file. [2025-10-22T18:43:17.140724] [INFO ] [MAIN ] Update Progress: 809/2367 symbols completed. FC took 29.7s. Estimated remaining: 3h 18m 46s. Rate: 7.8 symbols/min [2025-10-22T18:43:17.307381] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:17.307615] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-22T18:43:17.307719] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-22T18:43:17.307852] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-22T18:43:17.307901] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-22T18:43:17.307950] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-22T18:43:17.307987] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-22T18:43:17.655874] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:17.717621] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-22T18:43:18.349942] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T18:43:18.517743] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-22T18:43:18.712594] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T18:43:19.317726] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-22T18:43:19.736946] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:43:20.117684] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-22T18:43:20.823875] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:43:20.917712] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-22T18:43:21.588373] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T18:43:21.717700] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-22T18:43:22.029597] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T18:43:22.034550] [INFO ] [REMOTE ] FCN: Full fetch complete (36298 records). [2025-10-22T18:43:22.034681] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-22T18:43:22.415731] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-22T18:43:22.415809] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-22T18:43:22.416599] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-22T18:43:22.416637] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-22T18:43:22.417393] [DEBUG] [LOCAL ] FCN: Trimmed 36298 records to 25886 (keeping 200 days of data) [2025-10-22T18:43:22.520577] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-22T18:43:22.570767] [DEBUG] [LOCAL ] FCN: Primary data saved (25886 records). [2025-10-22T18:43:22.570899] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-22T18:43:22.570978] [INFO ] [MAIN ] Update Progress: 810/2367 symbols completed. FCN took 24.9s. Estimated remaining: 3h 18m 34s. Rate: 7.8 symbols/min [2025-10-22T18:43:22.735855] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:22.750126] [DEBUG] [LOCAL ] FCT: Loaded 14677 existing records from primary storage. [2025-10-22T18:43:22.750299] [INFO ] [MAIN ] FCT: Loaded 14677 existing records. [2025-10-22T18:43:22.921491] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:43:22.921734] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-22T18:43:22.921786] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-22T18:43:22.922067] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-22T18:43:22.922123] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-22T18:43:23.275217] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:23.289274] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T18:43:23.317615] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-22T18:43:24.117756] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-22T18:43:24.335415] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T18:43:24.668008] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T18:43:24.917731] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-22T18:43:25.366469] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T18:43:25.629457] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T18:43:25.717672] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-22T18:43:26.517729] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-22T18:43:26.865230] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-22T18:43:27.125117] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T18:43:27.317701] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-22T18:43:28.117681] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-22T18:43:28.832957] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T18:43:28.917615] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-22T18:43:29.513429] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T18:43:29.717681] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-22T18:43:30.384928] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-22T18:43:30.384528] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T18:43:30.517689] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-22T18:43:31.317715] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-22T18:43:32.117678] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-22T18:43:32.226632] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T18:43:32.231571] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T18:43:32.238002] [INFO ] [REMOTE ] FCF: Full fetch complete (57913 records). [2025-10-22T18:43:32.238104] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-22T18:43:32.238811] [FATAL] [VALIDATOR ] FCF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:43:32.238899] [FATAL] [MAIN ] FCF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:43:32.238943] [WARN ] [MAIN ] FCF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:43:32.239009] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-22T18:43:32.239075] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-22T18:43:32.239110] [INFO ] [LOCAL ] FCF: Starting deletion of derivative data. [2025-10-22T18:43:32.239244] [DEBUG] [LOCAL ] FCF: Deleted derivative data file. [2025-10-22T18:43:32.239836] [INFO ] [MAIN ] Update Progress: 811/2367 symbols completed. FCF took 37.4s. Estimated remaining: 3h 18m 30s. Rate: 7.8 symbols/min [2025-10-22T18:43:32.404072] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:32.454360] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-22T18:43:32.454709] [INFO ] [MAIN ] FCX: Loaded 53701 existing records. [2025-10-22T18:43:32.626617] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:43:32.626846] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-22T18:43:32.626892] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-22T18:43:32.627915] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-22T18:43:32.627973] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-22T18:43:32.698057] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T18:43:32.922797] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-22T18:43:32.984295] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:33.289330] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-22T18:43:33.717707] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-22T18:43:34.517688] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-22T18:43:34.740268] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T18:43:35.317718] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-22T18:43:36.117677] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-22T18:43:36.647570] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T18:43:36.680056] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T18:43:36.917711] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-22T18:43:36.990079] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T18:43:36.996490] [INFO ] [REMOTE ] FCPT: Full fetch complete (53864 records). [2025-10-22T18:43:36.996581] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-22T18:43:37.445253] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-22T18:43:37.445331] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-22T18:43:37.446026] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-22T18:43:37.446087] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-22T18:43:37.447146] [DEBUG] [LOCAL ] FCPT: Trimmed 53864 records to 36980 (keeping 200 days of data) [2025-10-22T18:43:37.671265] [DEBUG] [LOCAL ] FCPT: Primary data saved (36980 records). [2025-10-22T18:43:37.671409] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-22T18:43:37.671738] [INFO ] [MAIN ] Update Progress: 812/2367 symbols completed. FCPT took 35.1s. Estimated remaining: 3h 18m 18s. Rate: 7.8 symbols/min [2025-10-22T18:43:37.734535] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-22T18:43:37.844167] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:37.870101] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T18:43:37.883202] [DEBUG] [LOCAL ] FDP: Loaded 29749 existing records from primary storage. [2025-10-22T18:43:37.883458] [INFO ] [MAIN ] FDP: Loaded 29749 existing records. [2025-10-22T18:43:38.059071] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:43:38.059715] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-22T18:43:38.059812] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-22T18:43:38.060088] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-22T18:43:38.060164] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-22T18:43:38.241880] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-22T18:43:38.458217] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:38.517613] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-22T18:43:39.317746] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-22T18:43:40.117886] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-22T18:43:40.301578] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T18:43:40.923472] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-22T18:43:40.937496] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:43:41.094419] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T18:43:41.717881] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-22T18:43:41.942625] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-22T18:43:42.517736] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-22T18:43:42.587615] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T18:43:43.317708] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-22T18:43:43.905012] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T18:43:44.117622] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-22T18:43:44.273929] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T18:43:44.917731] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-22T18:43:45.506303] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:43:45.717741] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-22T18:43:46.139455] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T18:43:46.142590] [INFO ] [REMOTE ] FCT: Full fetch complete (21289 records). [2025-10-22T18:43:46.142716] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-22T18:43:46.512290] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-22T18:43:46.512392] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-22T18:43:46.512870] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-22T18:43:46.512950] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-22T18:43:46.513484] [DEBUG] [LOCAL ] FCT: Trimmed 21289 records to 14722 (keeping 200 days of data) [2025-10-22T18:43:46.549385] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-22T18:43:46.600229] [DEBUG] [LOCAL ] FCT: Primary data saved (14722 records). [2025-10-22T18:43:46.600335] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-22T18:43:46.600408] [INFO ] [MAIN ] Update Progress: 813/2367 symbols completed. FCT took 24.0s. Estimated remaining: 3h 18m 13s. Rate: 7.8 symbols/min [2025-10-22T18:43:46.765364] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:46.791960] [DEBUG] [LOCAL ] FDS: Loaded 28015 existing records from primary storage. [2025-10-22T18:43:46.792241] [INFO ] [MAIN ] FDS: Loaded 28015 existing records. [2025-10-22T18:43:46.963452] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:43:46.963701] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-22T18:43:46.963821] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-22T18:43:46.964026] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-22T18:43:46.964081] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-22T18:43:47.309874] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:47.317612] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-22T18:43:47.919101] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T18:43:48.042180] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-22T18:43:48.117620] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-22T18:43:48.742867] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T18:43:48.917693] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-22T18:43:49.717624] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-22T18:43:50.007477] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T18:43:50.160356] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T18:43:50.287228] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-22T18:43:50.517692] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-22T18:43:51.317736] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-22T18:43:51.885419] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T18:43:52.117726] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-22T18:43:52.632822] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T18:43:52.917716] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-22T18:43:53.381938] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T18:43:53.717704] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-22T18:43:54.342480] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:43:54.517624] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-22T18:43:54.860182] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T18:43:55.317697] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-22T18:43:55.617341] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T18:43:55.663075] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-22T18:43:56.117696] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-22T18:43:56.917705] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-22T18:43:57.266846] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-22T18:43:57.426331] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T18:43:57.717682] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-22T18:43:58.517733] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-22T18:43:59.032088] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T18:43:59.036757] [INFO ] [REMOTE ] FDP: Full fetch complete (42930 records). [2025-10-22T18:43:59.036846] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-22T18:43:59.322828] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-22T18:43:59.436748] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-22T18:43:59.436834] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-22T18:43:59.437443] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-22T18:43:59.437516] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-22T18:43:59.438740] [DEBUG] [LOCAL ] FDP: Trimmed 42930 records to 29707 (keeping 200 days of data) [2025-10-22T18:43:59.628237] [DEBUG] [LOCAL ] FDP: Primary data saved (29707 records). [2025-10-22T18:43:59.628363] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-22T18:43:59.628442] [INFO ] [MAIN ] Update Progress: 814/2367 symbols completed. FDP took 22.0s. Estimated remaining: 3h 18m 16s. Rate: 7.8 symbols/min [2025-10-22T18:43:59.800417] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:59.825487] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T18:43:59.880128] [DEBUG] [LOCAL ] FDX: Loaded 51271 existing records from primary storage. [2025-10-22T18:43:59.880460] [INFO ] [MAIN ] FDX: Loaded 51271 existing records. [2025-10-22T18:44:00.058713] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:00.058931] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-22T18:44:00.058978] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-22T18:44:00.059181] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-22T18:44:00.059236] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-22T18:44:00.123737] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-22T18:44:00.423269] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:00.917703] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-22T18:44:01.574115] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T18:44:01.615342] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T18:44:01.616023] [INFO ] [REMOTE ] FCRX: Full fetch complete (1642 records). [2025-10-22T18:44:01.616089] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-22T18:44:01.722747] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-22T18:44:01.794518] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-22T18:44:01.794771] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:44:01.794904] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:44:01.794991] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-22T18:44:01.795109] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-22T18:44:01.795204] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-22T18:44:01.795341] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-22T18:44:01.795427] [INFO ] [MAIN ] Update Progress: 815/2367 symbols completed. FCRX took 44.7s. Estimated remaining: 3h 17m 57s. Rate: 7.8 symbols/min [2025-10-22T18:44:01.962829] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:01.995332] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-22T18:44:02.047214] [DEBUG] [LOCAL ] FE: Loaded 53434 existing records from primary storage. [2025-10-22T18:44:02.047526] [INFO ] [MAIN ] FE: Loaded 53434 existing records. [2025-10-22T18:44:02.222063] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:02.222282] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-22T18:44:02.222338] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-22T18:44:02.222530] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-22T18:44:02.222567] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-22T18:44:02.531811] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-22T18:44:02.573980] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:03.281244] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T18:44:03.317610] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-22T18:44:04.117694] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-22T18:44:04.440443] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T18:44:04.896786] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T18:44:04.917691] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-22T18:44:05.717696] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-22T18:44:05.926682] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:44:06.517622] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-22T18:44:06.761476] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:44:06.768186] [INFO ] [REMOTE ] FDS: Full fetch complete (39426 records). [2025-10-22T18:44:06.768279] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-22T18:44:07.134572] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-22T18:44:07.134688] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-22T18:44:07.135289] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-22T18:44:07.135330] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-22T18:44:07.136171] [DEBUG] [LOCAL ] FDS: Trimmed 39426 records to 28003 (keeping 200 days of data) [2025-10-22T18:44:07.305522] [DEBUG] [LOCAL ] FDS: Primary data saved (28003 records). [2025-10-22T18:44:07.305752] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-22T18:44:07.305837] [INFO ] [MAIN ] Update Progress: 816/2367 symbols completed. FDS took 20.7s. Estimated remaining: 3h 17m 46s. Rate: 7.8 symbols/min [2025-10-22T18:44:07.326592] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-22T18:44:07.479490] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:07.479687] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-22T18:44:07.479747] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-22T18:44:07.479978] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-22T18:44:07.480059] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-22T18:44:07.480196] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-22T18:44:07.480301] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-22T18:44:07.787001] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T18:44:07.878101] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:07.910990] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:44:08.117625] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-22T18:44:08.874280] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T18:44:08.917712] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-22T18:44:09.455161] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T18:44:09.717711] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-22T18:44:10.517698] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-22T18:44:10.866083] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T18:44:10.954149] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T18:44:11.317676] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-22T18:44:11.948130] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T18:44:12.118989] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-22T18:44:12.119076] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-22T18:44:12.917701] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-22T18:44:13.432377] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T18:44:13.717792] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-22T18:44:13.789376] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:44:14.517729] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-22T18:44:14.976272] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T18:44:15.317693] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-22T18:44:15.881338] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T18:44:15.937311] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-22T18:44:16.117628] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-22T18:44:16.917748] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-22T18:44:17.268505] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-22T18:44:17.722813] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-22T18:44:17.738578] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T18:44:18.071202] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-22T18:44:18.517606] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-22T18:44:19.317745] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-22T18:44:20.117716] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-22T18:44:20.507116] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T18:44:20.749060] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T18:44:20.917669] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-22T18:44:21.248119] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T18:44:21.458682] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-22T18:44:21.459831] [INFO ] [REMOTE ] FENG: Full fetch complete (2276 records). [2025-10-22T18:44:21.459916] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-22T18:44:21.670505] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T18:44:21.670744] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:44:21.670796] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:44:21.670843] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-22T18:44:21.670898] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-22T18:44:21.670931] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-22T18:44:21.670969] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-22T18:44:21.671027] [INFO ] [MAIN ] Update Progress: 817/2367 symbols completed. FENG took 14.4s. Estimated remaining: 3h 17m 51s. Rate: 7.8 symbols/min [2025-10-22T18:44:21.725636] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-22T18:44:21.861412] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:21.906633] [DEBUG] [LOCAL ] FERG: Loaded 48749 existing records from primary storage. [2025-10-22T18:44:21.906994] [INFO ] [MAIN ] FERG: Loaded 48749 existing records. [2025-10-22T18:44:22.083322] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:22.083573] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-22T18:44:22.083666] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-22T18:44:22.083972] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-22T18:44:22.084029] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-22T18:44:22.432729] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:22.517715] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-22T18:44:23.317678] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-22T18:44:23.611461] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T18:44:24.117744] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-22T18:44:24.848514] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-22T18:44:24.917691] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-22T18:44:25.418381] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-22T18:44:25.717674] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-22T18:44:26.183420] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-22T18:44:26.517730] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-22T18:44:27.321350] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-22T18:44:27.578681] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-22T18:44:27.588208] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-22T18:44:27.588418] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-22T18:44:28.008733] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-22T18:44:28.009048] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-22T18:44:28.011472] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T18:44:28.010345] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-22T18:44:28.022035] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-22T18:44:28.023896] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 53701 (keeping 200 days of data) [2025-10-22T18:44:28.117778] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-22T18:44:28.353565] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T18:44:28.388158] [DEBUG] [LOCAL ] FCX: Primary data saved (53701 records). [2025-10-22T18:44:28.388263] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-22T18:44:28.388826] [INFO ] [MAIN ] Update Progress: 818/2367 symbols completed. FCX took 56.1s. Estimated remaining: 3h 17m 41s. Rate: 7.8 symbols/min [2025-10-22T18:44:28.559292] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:28.574228] [DEBUG] [LOCAL ] FET: Loaded 12922 existing records from primary storage. [2025-10-22T18:44:28.574454] [INFO ] [MAIN ] FET: Loaded 12922 existing records. [2025-10-22T18:44:28.749636] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:28.749990] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-22T18:44:28.750086] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-22T18:44:28.750250] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-22T18:44:28.750303] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-22T18:44:28.910120] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T18:44:28.920433] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-22T18:44:29.131445] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:29.717704] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-22T18:44:29.915114] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T18:44:30.517727] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-22T18:44:30.768628] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T18:44:31.317746] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-22T18:44:31.405520] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T18:44:31.580398] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T18:44:32.117766] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-22T18:44:32.870252] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T18:44:32.917710] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-22T18:44:33.717748] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-22T18:44:34.034092] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T18:44:34.517628] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-22T18:44:34.560564] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:44:35.317675] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-22T18:44:35.584704] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T18:44:36.117691] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-22T18:44:36.515344] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T18:44:36.523372] [INFO ] [REMOTE ] FDX: Full fetch complete (74225 records). [2025-10-22T18:44:36.523485] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-22T18:44:36.912324] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-22T18:44:36.912439] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-22T18:44:36.913542] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-22T18:44:36.913606] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-22T18:44:36.915199] [DEBUG] [LOCAL ] FDX: Trimmed 74225 records to 51182 (keeping 200 days of data) [2025-10-22T18:44:36.928589] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-22T18:44:37.002374] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T18:44:37.040798] [INFO ] [REMOTE ] FE: Full fetch complete (77480 records). [2025-10-22T18:44:37.042863] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-22T18:44:37.582129] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-22T18:44:37.582949] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-22T18:44:37.584362] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-22T18:44:37.585614] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-22T18:44:37.603184] [DEBUG] [LOCAL ] FE: Trimmed 77480 records to 53433 (keeping 200 days of data) [2025-10-22T18:44:37.797490] [DEBUG] [LOCAL ] FDX: Primary data saved (51182 records). [2025-10-22T18:44:37.797860] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-22T18:44:37.798098] [INFO ] [MAIN ] Update Progress: 819/2367 symbols completed. FDX took 38.2s. Estimated remaining: 3h 17m 37s. Rate: 7.8 symbols/min [2025-10-22T18:44:38.075154] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T18:44:38.077490] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:38.091182] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-22T18:44:38.112136] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T18:44:38.148972] [DEBUG] [LOCAL ] FF: Loaded 23879 existing records from primary storage. [2025-10-22T18:44:38.157330] [INFO ] [MAIN ] FF: Loaded 23879 existing records. [2025-10-22T18:44:38.391439] [DEBUG] [LOCAL ] FE: Primary data saved (53433 records). [2025-10-22T18:44:38.411240] [INFO ] [MAIN ] FE: Full history saved. [2025-10-22T18:44:38.411368] [INFO ] [MAIN ] Update Progress: 820/2367 symbols completed. FE took 36.6s. Estimated remaining: 3h 17m 16s. Rate: 7.8 symbols/min [2025-10-22T18:44:38.411172] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:38.454328] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-22T18:44:38.474536] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-22T18:44:38.490705] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-22T18:44:38.501385] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-22T18:44:38.522878] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-22T18:44:38.684031] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:38.689764] [DEBUG] [LOCAL ] FFA: No existing data file found in primary storage. [2025-10-22T18:44:38.694970] [WARN ] [MAIN ] FFA: No existing data found, performing full refresh instead. [2025-10-22T18:44:38.706073] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-22T18:44:38.711261] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-22T18:44:38.736085] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-10-22T18:44:38.771703] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-22T18:44:39.064011] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:39.125674] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T18:44:39.323063] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-22T18:44:39.327867] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:40.117694] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-22T18:44:40.188511] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T18:44:40.237603] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T18:44:40.917691] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-22T18:44:41.529189] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:44:41.717699] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-22T18:44:42.522715] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-22T18:44:42.528768] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T18:44:42.742303] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T18:44:43.172172] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T18:44:43.317705] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-22T18:44:43.892432] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T18:44:44.117732] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-22T18:44:44.721511] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T18:44:44.917789] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-22T18:44:45.688683] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T18:44:45.717613] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-22T18:44:46.308711] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T18:44:46.517681] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-22T18:44:47.317671] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-22T18:44:47.397111] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T18:44:47.970184] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T18:44:48.117706] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-22T18:44:48.724199] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T18:44:48.917705] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-22T18:44:49.717697] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-22T18:44:50.119153] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T18:44:50.517732] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-22T18:44:51.317699] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-22T18:44:51.365717] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T18:44:51.427073] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T18:44:52.117703] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-22T18:44:52.711388] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T18:44:52.917722] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-22T18:44:53.719904] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-22T18:44:53.725286] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T18:44:53.741115] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T18:44:54.517624] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-22T18:44:54.718479] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T18:44:55.317743] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-22T18:44:56.117710] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-22T18:44:56.269353] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:44:56.277371] [INFO ] [REMOTE ] FERG: Full fetch complete (71260 records). [2025-10-22T18:44:56.277492] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-22T18:44:56.442068] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T18:44:56.627441] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-22T18:44:56.698769] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-22T18:44:56.698884] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-22T18:44:56.699836] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-22T18:44:56.699902] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-22T18:44:56.701332] [DEBUG] [LOCAL ] FERG: Trimmed 71260 records to 48718 (keeping 200 days of data) [2025-10-22T18:44:56.920554] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-22T18:44:57.009246] [DEBUG] [LOCAL ] FERG: Primary data saved (48718 records). [2025-10-22T18:44:57.009383] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-22T18:44:57.009489] [INFO ] [MAIN ] Update Progress: 821/2367 symbols completed. FERG took 35.3s. Estimated remaining: 3h 17m 29s. Rate: 7.8 symbols/min [2025-10-22T18:44:57.173919] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:57.192616] [DEBUG] [LOCAL ] FFC: Loaded 16617 existing records from primary storage. [2025-10-22T18:44:57.192893] [INFO ] [MAIN ] FFC: Loaded 16617 existing records. [2025-10-22T18:44:57.370374] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:57.370625] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-22T18:44:57.370706] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-22T18:44:57.370875] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-22T18:44:57.370913] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-22T18:44:57.720758] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-22T18:44:57.724259] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:57.918271] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T18:44:57.921043] [INFO ] [REMOTE ] FET: Full fetch complete (18470 records). [2025-10-22T18:44:57.921121] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-22T18:44:58.286923] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-22T18:44:58.287000] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-22T18:44:58.287441] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-22T18:44:58.287482] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-22T18:44:58.288053] [DEBUG] [LOCAL ] FET: Trimmed 18470 records to 12875 (keeping 200 days of data) [2025-10-22T18:44:58.362105] [DEBUG] [LOCAL ] FET: Primary data saved (12875 records). [2025-10-22T18:44:58.362240] [INFO ] [MAIN ] FET: Full history saved. [2025-10-22T18:44:58.362348] [INFO ] [MAIN ] Update Progress: 822/2367 symbols completed. FET took 30.0s. Estimated remaining: 3h 17m 9s. Rate: 7.8 symbols/min [2025-10-22T18:44:58.531250] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-22T18:44:58.533844] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:58.534106] [DEBUG] [LOCAL ] FFWM: No existing data file found in primary storage. [2025-10-22T18:44:58.534752] [WARN ] [MAIN ] FFWM: No existing data found, performing full refresh instead. [2025-10-22T18:44:58.534868] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-22T18:44:58.534913] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-22T18:44:58.534956] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-10-22T18:44:58.534990] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-22T18:44:58.644497] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T18:44:58.667171] [INFO ] [REMOTE ] FFA: Full fetch complete (8682 records). [2025-10-22T18:44:58.686122] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-22T18:44:59.248139] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:59.322865] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-22T18:44:59.360620] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-22T18:44:59.360763] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-22T18:44:59.361196] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-22T18:44:59.361269] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-22T18:44:59.361859] [DEBUG] [LOCAL ] FFA: Trimmed 8682 records to 5586 (keeping 200 days of data) [2025-10-22T18:44:59.398299] [DEBUG] [LOCAL ] FFA: Primary data saved (5586 records). [2025-10-22T18:44:59.398446] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-22T18:44:59.398535] [INFO ] [MAIN ] Update Progress: 823/2367 symbols completed. FFA took 21.0s. Estimated remaining: 3h 16m 49s. Rate: 7.8 symbols/min [2025-10-22T18:44:59.580238] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:59.605343] [DEBUG] [LOCAL ] FG: Loaded 21549 existing records from primary storage. [2025-10-22T18:44:59.605693] [INFO ] [MAIN ] FG: Loaded 21549 existing records. [2025-10-22T18:44:59.790040] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:59.790345] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-22T18:44:59.790400] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-22T18:44:59.790622] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-22T18:44:59.790731] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-22T18:45:00.113118] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T18:45:00.118414] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-22T18:45:00.213741] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:00.430947] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T18:45:00.917740] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-22T18:45:01.717849] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-22T18:45:02.138186] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T18:45:02.517689] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-22T18:45:02.608032] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T18:45:02.830624] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T18:45:03.317716] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-22T18:45:03.569220] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T18:45:04.117699] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-22T18:45:04.593106] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T18:45:04.917696] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-22T18:45:05.128812] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T18:45:05.717738] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-22T18:45:05.742604] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T18:45:06.517776] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-22T18:45:07.177001] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T18:45:07.317681] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-22T18:45:07.703591] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T18:45:08.117730] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-22T18:45:08.172235] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T18:45:08.917678] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-22T18:45:09.718858] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-22T18:45:09.720827] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T18:45:10.402009] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T18:45:10.517744] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-22T18:45:10.698858] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T18:45:11.317678] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-22T18:45:11.678149] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T18:45:12.117714] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-22T18:45:12.370676] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T18:45:12.894032] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-22T18:45:12.917674] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-22T18:45:13.717735] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-22T18:45:14.057735] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T18:45:14.517740] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-22T18:45:14.724355] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T18:45:15.317737] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-22T18:45:15.586180] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T18:45:16.117731] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-22T18:45:16.917468] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T18:45:16.926052] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-22T18:45:16.989525] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T18:45:17.717716] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-22T18:45:17.815593] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T18:45:17.821493] [INFO ] [REMOTE ] FF: Full fetch complete (36517 records). [2025-10-22T18:45:17.821637] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-22T18:45:18.208036] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-22T18:45:18.208163] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-22T18:45:18.209046] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-22T18:45:18.209127] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-22T18:45:18.210587] [DEBUG] [LOCAL ] FF: Trimmed 36517 records to 23707 (keeping 200 days of data) [2025-10-22T18:45:18.361727] [DEBUG] [LOCAL ] FF: Primary data saved (23707 records). [2025-10-22T18:45:18.361855] [INFO ] [MAIN ] FF: Full history saved. [2025-10-22T18:45:18.361936] [INFO ] [MAIN ] Update Progress: 824/2367 symbols completed. FF took 40.6s. Estimated remaining: 3h 17m 3s. Rate: 7.8 symbols/min [2025-10-22T18:45:18.529277] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-22T18:45:18.532821] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:18.538559] [DEBUG] [LOCAL ] FGN: Loaded 3610 existing records from primary storage. [2025-10-22T18:45:18.538762] [INFO ] [MAIN ] FGN: Loaded 3610 existing records. [2025-10-22T18:45:18.760113] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:45:18.760321] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-22T18:45:18.760370] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-22T18:45:18.760532] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-22T18:45:18.760589] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-22T18:45:19.135866] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:19.204326] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:45:19.317691] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-22T18:45:19.502826] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T18:45:19.929207] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T18:45:20.117694] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-22T18:45:20.917733] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-22T18:45:21.133455] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T18:45:21.717672] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-22T18:45:22.177521] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:45:22.517612] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-22T18:45:22.831966] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T18:45:23.317697] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-22T18:45:23.985757] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T18:45:24.046667] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-22T18:45:24.117749] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-22T18:45:24.603930] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T18:45:24.917786] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-22T18:45:25.545046] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T18:45:25.717746] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-22T18:45:26.517753] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-22T18:45:27.042259] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T18:45:27.046521] [INFO ] [REMOTE ] FG: Full fetch complete (28977 records). [2025-10-22T18:45:27.046705] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-22T18:45:27.174503] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T18:45:27.323010] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-22T18:45:27.462105] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-22T18:45:27.462200] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-22T18:45:27.462761] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-22T18:45:27.462838] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-22T18:45:27.463785] [DEBUG] [LOCAL ] FG: Trimmed 28977 records to 21366 (keeping 200 days of data) [2025-10-22T18:45:27.591254] [DEBUG] [LOCAL ] FG: Primary data saved (21366 records). [2025-10-22T18:45:27.591402] [INFO ] [MAIN ] FG: Full history saved. [2025-10-22T18:45:27.591489] [INFO ] [MAIN ] Update Progress: 825/2367 symbols completed. FG took 28.2s. Estimated remaining: 3h 16m 58s. Rate: 7.8 symbols/min [2025-10-22T18:45:27.760402] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:27.760571] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-22T18:45:27.760610] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-22T18:45:27.760745] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-22T18:45:27.760789] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-22T18:45:27.760830] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-22T18:45:27.760862] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-22T18:45:28.101502] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:28.117615] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-22T18:45:28.841943] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T18:45:28.917769] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-22T18:45:29.026969] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T18:45:29.717625] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-22T18:45:30.185230] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T18:45:30.188232] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T18:45:30.517753] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-22T18:45:31.154382] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T18:45:31.317726] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-22T18:45:32.117775] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-22T18:45:32.691193] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T18:45:32.922876] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-22T18:45:32.931511] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T18:45:32.938466] [INFO ] [REMOTE ] FFWM: Full fetch complete (51951 records). [2025-10-22T18:45:32.938613] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-22T18:45:33.316621] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-22T18:45:33.316736] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-22T18:45:33.317461] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-22T18:45:33.317506] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-22T18:45:33.318677] [DEBUG] [LOCAL ] FFWM: Trimmed 51951 records to 35671 (keeping 200 days of data) [2025-10-22T18:45:33.511769] [DEBUG] [LOCAL ] FFWM: Primary data saved (35671 records). [2025-10-22T18:45:33.511900] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-22T18:45:33.511970] [INFO ] [MAIN ] Update Progress: 826/2367 symbols completed. FFWM took 35.1s. Estimated remaining: 3h 16m 47s. Rate: 7.8 symbols/min [2025-10-22T18:45:33.681292] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:33.716027] [DEBUG] [LOCAL ] FHI: Loaded 39612 existing records from primary storage. [2025-10-22T18:45:33.716327] [INFO ] [MAIN ] FHI: Loaded 39612 existing records. [2025-10-22T18:45:33.727389] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-22T18:45:33.893826] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:45:33.894048] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-22T18:45:33.894100] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-22T18:45:33.894343] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-22T18:45:33.894398] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-22T18:45:34.202839] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T18:45:34.265321] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:34.280867] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T18:45:34.517618] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-22T18:45:35.317730] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-22T18:45:36.117623] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-22T18:45:36.391117] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T18:45:36.394093] [INFO ] [REMOTE ] FFC: Full fetch complete (24518 records). [2025-10-22T18:45:36.394165] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-22T18:45:36.537167] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T18:45:36.717621] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T18:45:36.799678] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-22T18:45:36.799751] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-22T18:45:36.800218] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-22T18:45:36.800257] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-22T18:45:36.800857] [DEBUG] [LOCAL ] FFC: Trimmed 24518 records to 16583 (keeping 200 days of data) [2025-10-22T18:45:36.897267] [DEBUG] [LOCAL ] FFC: Primary data saved (16583 records). [2025-10-22T18:45:36.897388] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-22T18:45:36.897465] [INFO ] [MAIN ] Update Progress: 827/2367 symbols completed. FFC took 39.9s. Estimated remaining: 3h 16m 32s. Rate: 7.8 symbols/min [2025-10-22T18:45:36.926295] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-22T18:45:37.065379] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:37.114607] [DEBUG] [LOCAL ] FHN: Loaded 53399 existing records from primary storage. [2025-10-22T18:45:37.114912] [INFO ] [MAIN ] FHN: Loaded 53399 existing records. [2025-10-22T18:45:37.286611] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:45:37.286812] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-22T18:45:37.286877] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-22T18:45:37.287140] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-22T18:45:37.287211] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-22T18:45:37.632133] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:37.717617] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-22T18:45:38.435680] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T18:45:38.517615] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-22T18:45:39.317693] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-22T18:45:39.554183] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T18:45:40.009882] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-22T18:45:40.122851] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-22T18:45:40.144591] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:45:40.756861] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T18:45:40.917666] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-22T18:45:41.717683] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-22T18:45:42.349348] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T18:45:42.517730] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-22T18:45:43.317699] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-22T18:45:43.439467] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T18:45:43.697358] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T18:45:44.081466] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T18:45:44.082486] [INFO ] [REMOTE ] FGN: Full fetch complete (5510 records). [2025-10-22T18:45:44.082557] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-22T18:45:44.122912] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-22T18:45:44.444194] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-22T18:45:44.444276] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-22T18:45:44.444442] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-22T18:45:44.444562] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-22T18:45:44.444967] [DEBUG] [LOCAL ] FGN: Trimmed 5510 records to 3560 (keeping 200 days of data) [2025-10-22T18:45:44.466484] [DEBUG] [LOCAL ] FGN: Primary data saved (3560 records). [2025-10-22T18:45:44.466552] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-22T18:45:44.466622] [INFO ] [MAIN ] Update Progress: 828/2367 symbols completed. FGN took 26.1s. Estimated remaining: 3h 16m 24s. Rate: 7.8 symbols/min [2025-10-22T18:45:44.636284] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:44.684204] [DEBUG] [LOCAL ] FI: Loaded 53588 existing records from primary storage. [2025-10-22T18:45:44.684575] [INFO ] [MAIN ] FI: Loaded 53588 existing records. [2025-10-22T18:45:44.862474] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:45:44.862709] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-22T18:45:44.862767] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-22T18:45:44.863234] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-22T18:45:44.863292] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-22T18:45:44.926286] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-22T18:45:45.221608] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:45.702161] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T18:45:45.717604] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-22T18:45:45.960633] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T18:45:46.258721] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-22T18:45:46.517700] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-22T18:45:47.317748] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-22T18:45:48.117728] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-22T18:45:48.260000] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:45:48.917736] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-22T18:45:49.084695] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T18:45:49.614320] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T18:45:49.640913] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T18:45:49.717730] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-22T18:45:50.517745] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-22T18:45:51.206487] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T18:45:51.317679] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-22T18:45:51.752135] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T18:45:52.035062] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T18:45:52.117688] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-22T18:45:52.917694] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-22T18:45:53.717713] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-22T18:45:53.815885] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T18:45:54.525932] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-22T18:45:54.531262] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:45:54.931903] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-22T18:45:55.122856] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T18:45:55.317689] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-22T18:45:55.882186] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-22T18:45:56.117680] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-22T18:45:56.717225] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T18:45:56.718840] [INFO ] [REMOTE ] FGSN: Full fetch complete (8076 records). [2025-10-22T18:45:56.718964] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-22T18:45:56.907777] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-22T18:45:56.908045] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:45:56.908119] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:45:56.908167] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-22T18:45:56.908222] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-22T18:45:56.908260] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-22T18:45:56.908299] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-22T18:45:56.908352] [INFO ] [MAIN ] Update Progress: 829/2367 symbols completed. FGSN took 29.3s. Estimated remaining: 3h 16m 25s. Rate: 7.8 symbols/min [2025-10-22T18:45:56.922818] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-22T18:45:57.074905] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:57.097510] [DEBUG] [LOCAL ] FICO: Loaded 21911 existing records from primary storage. [2025-10-22T18:45:57.097811] [INFO ] [MAIN ] FICO: Loaded 21911 existing records. [2025-10-22T18:45:57.269099] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:45:57.269288] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-22T18:45:57.269335] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-22T18:45:57.269499] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-22T18:45:57.269536] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-22T18:45:57.616000] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:57.717708] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-22T18:45:58.517747] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-22T18:45:58.922678] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T18:45:59.137271] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T18:45:59.317711] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-22T18:45:59.652103] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T18:46:00.117691] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-22T18:46:00.733128] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T18:46:00.738822] [INFO ] [REMOTE ] FHI: Full fetch complete (57435 records). [2025-10-22T18:46:00.738919] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-22T18:46:00.924417] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-22T18:46:01.123700] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-22T18:46:01.123917] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-22T18:46:01.124931] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-22T18:46:01.125046] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-22T18:46:01.137739] [DEBUG] [LOCAL ] FHI: Trimmed 57435 records to 39410 (keeping 200 days of data) [2025-10-22T18:46:01.138671] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-22T18:46:01.373298] [DEBUG] [LOCAL ] FHI: Primary data saved (39410 records). [2025-10-22T18:46:01.373430] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-22T18:46:01.374040] [INFO ] [MAIN ] Update Progress: 830/2367 symbols completed. FHI took 27.9s. Estimated remaining: 3h 16m 11s. Rate: 7.8 symbols/min [2025-10-22T18:46:01.538910] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:01.539072] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-22T18:46:01.539108] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-22T18:46:01.539221] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-22T18:46:01.539262] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-22T18:46:01.539302] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-22T18:46:01.539334] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-22T18:46:01.728213] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-22T18:46:01.903117] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:02.517706] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-22T18:46:02.760155] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-22T18:46:02.962327] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T18:46:03.317691] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-22T18:46:03.449030] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-22T18:46:04.117743] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-22T18:46:04.428974] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-22T18:46:04.917737] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-22T18:46:05.215554] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T18:46:05.717731] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-22T18:46:06.517725] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-22T18:46:06.869796] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T18:46:06.989528] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T18:46:07.317695] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-22T18:46:08.117704] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-22T18:46:08.159177] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T18:46:08.438706] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-22T18:46:08.464735] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T18:46:08.917725] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-22T18:46:09.717682] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-22T18:46:10.045243] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-22T18:46:10.517690] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-22T18:46:10.731556] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T18:46:11.317720] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-22T18:46:12.117625] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-22T18:46:12.455448] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T18:46:12.474519] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-22T18:46:12.917726] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-22T18:46:13.361268] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:46:13.370545] [INFO ] [REMOTE ] FHN: Full fetch complete (77478 records). [2025-10-22T18:46:13.370791] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-22T18:46:13.719685] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-22T18:46:13.776214] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-22T18:46:13.776340] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-22T18:46:13.777727] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-22T18:46:13.777849] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-22T18:46:13.779870] [DEBUG] [LOCAL ] FHN: Trimmed 77478 records to 53399 (keeping 200 days of data) [2025-10-22T18:46:13.992775] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:46:13.997248] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-22T18:46:13.998234] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:46:13.998939] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-22T18:46:14.001464] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:46:14.005471] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-22T18:46:14.017047] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-22T18:46:14.032926] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-22T18:46:14.033152] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-22T18:46:14.033238] [INFO ] [MAIN ] Update Progress: 831/2367 symbols completed. FIG took 12.7s. Estimated remaining: 3h 16m 13s. Rate: 7.8 symbols/min [2025-10-22T18:46:14.267068] [DEBUG] [LOCAL ] FHN: Primary data saved (53399 records). [2025-10-22T18:46:14.277565] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-22T18:46:14.294294] [INFO ] [MAIN ] Update Progress: 832/2367 symbols completed. FHN took 37.4s. Estimated remaining: 3h 15m 52s. Rate: 7.8 symbols/min [2025-10-22T18:46:14.362070] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:14.509968] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:14.522967] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-22T18:46:14.544380] [DEBUG] [LOCAL ] FIGS: Loaded 48559 existing records from primary storage. [2025-10-22T18:46:14.544826] [INFO ] [MAIN ] FIGS: Loaded 48559 existing records. [2025-10-22T18:46:14.700474] [DEBUG] [LOCAL ] FIHL: Loaded 39140 existing records from primary storage. [2025-10-22T18:46:14.716420] [INFO ] [MAIN ] FIHL: Loaded 39140 existing records. [2025-10-22T18:46:14.838861] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:14.865570] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-22T18:46:14.889530] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-22T18:46:14.910867] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-22T18:46:14.911052] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-22T18:46:15.039236] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:15.074337] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-22T18:46:15.077780] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-22T18:46:15.083662] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-22T18:46:15.104316] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-22T18:46:15.613055] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:15.623781] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-22T18:46:15.609521] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-22T18:46:15.778470] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:15.789794] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T18:46:16.117765] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-22T18:46:16.917752] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-22T18:46:17.272100] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:46:17.632579] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T18:46:17.717629] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-22T18:46:18.517718] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-22T18:46:18.945730] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T18:46:18.989550] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T18:46:19.317729] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-22T18:46:19.978557] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T18:46:20.117720] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-22T18:46:20.917708] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-22T18:46:21.339468] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T18:46:21.729092] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-22T18:46:21.731792] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:46:22.285794] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T18:46:22.517700] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-22T18:46:22.900818] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T18:46:23.317738] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-22T18:46:24.117732] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-22T18:46:24.415606] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T18:46:24.917731] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-22T18:46:25.044206] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T18:46:25.049285] [INFO ] [REMOTE ] FICO: Full fetch complete (30038 records). [2025-10-22T18:46:25.049443] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-22T18:46:25.345195] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T18:46:25.390457] [INFO ] [REMOTE ] FI: Full fetch complete (77496 records). [2025-10-22T18:46:25.400886] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-22T18:46:25.605127] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-22T18:46:25.622246] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-22T18:46:25.632843] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-22T18:46:25.657051] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-22T18:46:25.721791] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-22T18:46:25.778046] [DEBUG] [LOCAL ] FICO: Trimmed 30038 records to 21963 (keeping 200 days of data) [2025-10-22T18:46:25.967131] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-22T18:46:25.967932] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-22T18:46:25.969184] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-22T18:46:25.972575] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-22T18:46:25.981859] [DEBUG] [LOCAL ] FI: Trimmed 77496 records to 53586 (keeping 200 days of data) [2025-10-22T18:46:26.117534] [DEBUG] [LOCAL ] FICO: Primary data saved (21963 records). [2025-10-22T18:46:26.128461] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-22T18:46:26.133912] [INFO ] [MAIN ] Update Progress: 833/2367 symbols completed. FICO took 29.2s. Estimated remaining: 3h 15m 52s. Rate: 7.8 symbols/min [2025-10-22T18:46:26.397310] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:26.413914] [DEBUG] [LOCAL ] FINS: Loaded 8297 existing records from primary storage. [2025-10-22T18:46:26.416620] [INFO ] [MAIN ] FINS: Loaded 8297 existing records. [2025-10-22T18:46:26.680771] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:26.681295] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-22T18:46:26.698982] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-22T18:46:26.700830] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-22T18:46:26.701134] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-22T18:46:26.805962] [DEBUG] [LOCAL ] FI: Primary data saved (53586 records). [2025-10-22T18:46:26.847598] [INFO ] [MAIN ] FI: Full history saved. [2025-10-22T18:46:26.850279] [INFO ] [MAIN ] Update Progress: 834/2367 symbols completed. FI took 42.4s. Estimated remaining: 3h 15m 31s. Rate: 7.8 symbols/min [2025-10-22T18:46:26.851918] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T18:46:26.959787] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-22T18:46:27.240073] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:27.298496] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:27.320403] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-22T18:46:27.341189] [DEBUG] [LOCAL ] FINV: Loaded 45256 existing records from primary storage. [2025-10-22T18:46:27.341497] [INFO ] [MAIN ] FINV: Loaded 45256 existing records. [2025-10-22T18:46:27.541384] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:27.541726] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-22T18:46:27.541931] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-22T18:46:27.542263] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-22T18:46:27.542334] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-22T18:46:27.843433] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-22T18:46:27.936945] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:27.943815] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T18:46:28.117612] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-22T18:46:28.684726] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T18:46:28.726084] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T18:46:28.917695] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-22T18:46:29.717683] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-22T18:46:30.517806] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-22T18:46:30.805889] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T18:46:31.015477] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T18:46:31.317742] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-22T18:46:32.076148] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T18:46:32.117716] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-22T18:46:32.699082] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T18:46:32.796590] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T18:46:32.917700] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-22T18:46:33.717679] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-22T18:46:34.363329] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T18:46:34.517627] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-22T18:46:34.880116] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T18:46:35.317735] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-22T18:46:35.959165] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T18:46:36.117684] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-22T18:46:36.125807] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T18:46:36.917684] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-22T18:46:37.722772] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-22T18:46:37.747829] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T18:46:38.517718] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-22T18:46:38.589922] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T18:46:38.618329] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T18:46:39.317719] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-22T18:46:40.117751] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-22T18:46:40.178967] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T18:46:40.871232] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:46:40.917626] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-22T18:46:41.570825] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:46:41.717627] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-22T18:46:42.006702] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T18:46:42.517726] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-22T18:46:43.290328] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T18:46:43.317613] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-22T18:46:43.388237] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T18:46:44.103794] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T18:46:44.117612] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-22T18:46:44.917697] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-22T18:46:45.717715] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-22T18:46:45.929144] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T18:46:45.937197] [INFO ] [REMOTE ] FIGS: Full fetch complete (70850 records). [2025-10-22T18:46:45.937333] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-22T18:46:46.333635] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-22T18:46:46.333757] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-22T18:46:46.334596] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-22T18:46:46.334680] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-22T18:46:46.336424] [DEBUG] [LOCAL ] FIGS: Trimmed 70850 records to 48545 (keeping 200 days of data) [2025-10-22T18:46:46.536371] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-22T18:46:46.539187] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:46:46.652349] [DEBUG] [LOCAL ] FIGS: Primary data saved (48545 records). [2025-10-22T18:46:46.652476] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-22T18:46:46.653056] [INFO ] [MAIN ] Update Progress: 835/2367 symbols completed. FIGS took 32.6s. Estimated remaining: 3h 15m 46s. Rate: 7.8 symbols/min [2025-10-22T18:46:46.819211] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:46.868695] [DEBUG] [LOCAL ] FIS: Loaded 53326 existing records from primary storage. [2025-10-22T18:46:46.868999] [INFO ] [MAIN ] FIS: Loaded 53326 existing records. [2025-10-22T18:46:47.052959] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:47.053289] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-22T18:46:47.053347] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-22T18:46:47.053534] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-22T18:46:47.053572] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-22T18:46:47.322882] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-22T18:46:47.323562] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T18:46:47.373875] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:46:47.460143] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:48.117707] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-22T18:46:48.917705] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-22T18:46:49.142042] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:46:49.648840] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:46:49.655284] [INFO ] [REMOTE ] FIHL: Full fetch complete (56360 records). [2025-10-22T18:46:49.655427] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-22T18:46:49.722932] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-22T18:46:50.041997] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-22T18:46:50.042082] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-22T18:46:50.042839] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-22T18:46:50.042911] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-22T18:46:50.044151] [DEBUG] [LOCAL ] FIHL: Trimmed 56360 records to 39044 (keeping 200 days of data) [2025-10-22T18:46:50.282446] [DEBUG] [LOCAL ] FIHL: Primary data saved (39044 records). [2025-10-22T18:46:50.282727] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-22T18:46:50.282879] [INFO ] [MAIN ] Update Progress: 836/2367 symbols completed. FIHL took 36.0s. Estimated remaining: 3h 15m 31s. Rate: 7.8 symbols/min [2025-10-22T18:46:50.456193] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:50.485957] [DEBUG] [LOCAL ] FIX: Loaded 28480 existing records from primary storage. [2025-10-22T18:46:50.486253] [INFO ] [MAIN ] FIX: Loaded 28480 existing records. [2025-10-22T18:46:50.523707] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-22T18:46:50.691618] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:50.711494] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-22T18:46:50.711887] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-22T18:46:50.715242] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T18:46:50.715347] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-22T18:46:50.715566] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-22T18:46:51.081450] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:51.278021] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T18:46:51.317690] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-22T18:46:51.477553] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T18:46:52.031962] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T18:46:52.033497] [INFO ] [REMOTE ] FINS: Full fetch complete (11609 records). [2025-10-22T18:46:52.033567] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-22T18:46:52.122897] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-22T18:46:52.390388] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-22T18:46:52.390464] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-22T18:46:52.390746] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-22T18:46:52.390806] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-22T18:46:52.391260] [DEBUG] [LOCAL ] FINS: Trimmed 11609 records to 8261 (keeping 200 days of data) [2025-10-22T18:46:52.442104] [DEBUG] [LOCAL ] FINS: Primary data saved (8261 records). [2025-10-22T18:46:52.442242] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-22T18:46:52.442321] [INFO ] [MAIN ] Update Progress: 837/2367 symbols completed. FINS took 26.3s. Estimated remaining: 3h 15m 13s. Rate: 7.8 symbols/min [2025-10-22T18:46:52.917693] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-22T18:46:53.717762] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-22T18:46:53.870700] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T18:46:54.469132] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T18:46:54.517726] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-22T18:46:55.317744] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-22T18:46:55.459068] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:46:56.117745] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-22T18:46:56.332343] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T18:46:56.339979] [INFO ] [REMOTE ] FINV: Full fetch complete (64964 records). [2025-10-22T18:46:56.340106] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-22T18:46:56.724288] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-22T18:46:56.724439] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-22T18:46:56.725391] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-22T18:46:56.732519] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-22T18:46:56.745637] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:46:56.754304] [DEBUG] [LOCAL ] FINV: Trimmed 64964 records to 45222 (keeping 200 days of data) [2025-10-22T18:46:56.921012] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-22T18:46:57.008787] [DEBUG] [LOCAL ] FINV: Primary data saved (45222 records). [2025-10-22T18:46:57.008921] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-22T18:46:57.008998] [INFO ] [MAIN ] Update Progress: 838/2367 symbols completed. FINV took 30.2s. Estimated remaining: 3h 14m 60s. Rate: 7.8 symbols/min [2025-10-22T18:46:57.887472] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:46:57.899205] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-22T18:46:58.611825] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:46:58.620517] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-22T18:46:59.769639] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T18:46:59.781380] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-22T18:47:00.195978] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:47:00.204042] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-22T18:47:01.582839] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T18:47:01.590169] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-22T18:47:01.690504] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T18:47:01.717614] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-22T18:47:02.841285] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T18:47:02.847201] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-22T18:47:03.456866] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:47:03.467619] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-22T18:47:04.307218] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T18:47:04.313945] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-22T18:47:05.292168] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:47:05.305301] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-22T18:47:05.325071] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T18:47:05.717725] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-22T18:47:07.087329] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T18:47:07.100047] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-22T18:47:07.133415] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T18:47:07.317755] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-22T18:47:08.793258] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T18:47:08.801757] [INFO ] [REMOTE ] FIX: Full fetch complete (45633 records). [2025-10-22T18:47:08.802051] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-22T18:47:09.108947] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T18:47:09.201844] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-22T18:47:09.466242] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-22T18:47:09.466341] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-22T18:47:09.467158] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-22T18:47:09.467227] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-22T18:47:09.468615] [DEBUG] [LOCAL ] FIX: Trimmed 45633 records to 28424 (keeping 200 days of data) [2025-10-22T18:47:09.672883] [DEBUG] [LOCAL ] FIX: Primary data saved (28424 records). [2025-10-22T18:47:09.673056] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-22T18:47:09.673155] [INFO ] [MAIN ] Update Progress: 839/2367 symbols completed. FIX took 19.4s. Estimated remaining: 3h 15m 1s. Rate: 7.8 symbols/min [2025-10-22T18:47:10.183564] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:47:10.193019] [INFO ] [REMOTE ] FIS: Full fetch complete (77393 records). [2025-10-22T18:47:10.193200] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-22T18:47:10.612156] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-22T18:47:10.612251] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-22T18:47:10.613184] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-22T18:47:10.613252] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-22T18:47:10.614761] [DEBUG] [LOCAL ] FIS: Trimmed 77393 records to 53325 (keeping 200 days of data) [2025-10-22T18:47:10.934755] [DEBUG] [LOCAL ] FIS: Primary data saved (53325 records). [2025-10-22T18:47:10.934900] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-22T18:47:10.934981] [INFO ] [MAIN ] Update Progress: 840/2367 symbols completed. FIS took 24.3s. Estimated remaining: 3h 14m 42s. Rate: 7.8 symbols/min [2025-10-22T18:47:11.469815] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:11.589692] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:11.599770] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-22T18:47:11.599872] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-22T18:47:11.619083] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:11.639700] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:11.639945] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-22T18:47:11.640538] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-22T18:47:11.640617] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-22T18:47:11.640713] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-22T18:47:11.751354] [DEBUG] [LOCAL ] FLC: Loaded 5426 existing records from primary storage. [2025-10-22T18:47:11.799883] [INFO ] [MAIN ] FLC: Loaded 5426 existing records. [2025-10-22T18:47:12.068821] [DEBUG] [LOCAL ] FLNG: Loaded 33491 existing records from primary storage. [2025-10-22T18:47:12.092687] [DEBUG] [LOCAL ] FLG: Loaded 53319 existing records from primary storage. [2025-10-22T18:47:12.109371] [INFO ] [MAIN ] FLNG: Loaded 33491 existing records. [2025-10-22T18:47:12.142934] [INFO ] [MAIN ] FLG: Loaded 53319 existing records. [2025-10-22T18:47:12.249322] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:12.319404] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-22T18:47:12.459738] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:12.479571] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-22T18:47:12.490767] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-22T18:47:12.516712] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-22T18:47:12.532691] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-22T18:47:12.671543] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:12.690374] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-22T18:47:12.685026] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:12.712626] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-22T18:47:12.731276] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:47:12.737218] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-22T18:47:12.737590] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-22T18:47:12.750709] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-22T18:47:12.731833] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-22T18:47:12.768368] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-22T18:47:12.774358] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:47:12.841458] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-22T18:47:12.841530] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-22T18:47:12.875552] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-22T18:47:12.868401] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:47:13.032391] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-22T18:47:13.125049] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-22T18:47:13.192379] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-22T18:47:13.224933] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-22T18:47:13.317310] [INFO ] [MAIN ] Update Progress: 841/2367 symbols completed. FIXT took 2.4s. Estimated remaining: 3h 14m 25s. Rate: 7.8 symbols/min [2025-10-22T18:47:13.667915] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:13.710481] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-22T18:47:13.878559] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:13.938699] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-22T18:47:13.941948] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:14.021985] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:14.022365] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-22T18:47:14.065966] [DEBUG] [LOCAL ] FLO: Loaded 52075 existing records from primary storage. [2025-10-22T18:47:14.066309] [INFO ] [MAIN ] FLO: Loaded 52075 existing records. [2025-10-22T18:47:14.238795] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:14.239010] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-22T18:47:14.239058] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-22T18:47:14.239245] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-22T18:47:14.239282] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-22T18:47:14.612294] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:14.612663] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-22T18:47:14.693277] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T18:47:14.695009] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-22T18:47:15.379959] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T18:47:15.382521] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-22T18:47:15.404897] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:47:15.412637] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-22T18:47:15.497248] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:47:15.508016] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-22T18:47:16.041767] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T18:47:16.117690] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-22T18:47:16.410760] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T18:47:16.848893] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T18:47:16.897433] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:47:16.917608] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-22T18:47:16.941178] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:47:17.717688] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-22T18:47:18.366388] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T18:47:18.517684] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-22T18:47:18.700681] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T18:47:19.317772] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-22T18:47:20.132986] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-22T18:47:20.139309] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:47:20.734423] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T18:47:20.899873] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T18:47:20.917603] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-22T18:47:21.717703] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-22T18:47:22.353459] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T18:47:22.517811] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-22T18:47:23.317686] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-22T18:47:23.669736] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T18:47:23.853553] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T18:47:23.909820] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-22T18:47:24.117740] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-22T18:47:24.917684] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-22T18:47:25.717687] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-22T18:47:25.879102] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T18:47:26.314667] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:47:26.317995] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T18:47:26.517728] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-22T18:47:27.155013] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T18:47:27.317689] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-22T18:47:28.101460] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T18:47:28.102785] [INFO ] [REMOTE ] FLC: Full fetch complete (7801 records). [2025-10-22T18:47:28.102870] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-22T18:47:28.123684] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-22T18:47:28.466569] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-22T18:47:28.466666] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-22T18:47:28.466925] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-22T18:47:28.466970] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-22T18:47:28.467358] [DEBUG] [LOCAL ] FLC: Trimmed 7801 records to 5396 (keeping 200 days of data) [2025-10-22T18:47:28.499979] [DEBUG] [LOCAL ] FLC: Primary data saved (5396 records). [2025-10-22T18:47:28.500088] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-22T18:47:28.500166] [INFO ] [MAIN ] Update Progress: 842/2367 symbols completed. FLC took 17.6s. Estimated remaining: 3h 14m 31s. Rate: 7.8 symbols/min [2025-10-22T18:47:28.667954] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:28.668104] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-22T18:47:28.668141] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-22T18:47:28.668251] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-22T18:47:28.668293] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-22T18:47:28.668334] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-22T18:47:28.668367] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-22T18:47:28.924165] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-22T18:47:29.033144] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:29.717732] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-22T18:47:29.845468] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:47:30.517729] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-22T18:47:30.757257] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T18:47:30.932057] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:47:31.317769] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-22T18:47:32.117727] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-22T18:47:32.208409] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T18:47:32.839337] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T18:47:32.917707] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-22T18:47:33.292062] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T18:47:33.717702] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-22T18:47:34.517730] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-22T18:47:34.722249] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T18:47:35.135008] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T18:47:35.317702] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-22T18:47:35.590900] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T18:47:36.117692] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-22T18:47:36.768031] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T18:47:36.917693] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-22T18:47:37.717716] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-22T18:47:37.773603] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T18:47:38.220231] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T18:47:38.517725] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-22T18:47:39.317681] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-22T18:47:39.665286] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T18:47:40.117620] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-22T18:47:40.414789] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T18:47:40.612428] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-22T18:47:40.917720] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-22T18:47:41.263942] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T18:47:41.717768] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-22T18:47:42.411965] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T18:47:42.417231] [INFO ] [REMOTE ] FLNG: Full fetch complete (49871 records). [2025-10-22T18:47:42.417328] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-22T18:47:42.523984] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-22T18:47:42.802453] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-22T18:47:42.802532] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-22T18:47:42.803217] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-22T18:47:42.803278] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-22T18:47:42.804310] [DEBUG] [LOCAL ] FLNG: Trimmed 49871 records to 33319 (keeping 200 days of data) [2025-10-22T18:47:43.004096] [DEBUG] [LOCAL ] FLNG: Primary data saved (33319 records). [2025-10-22T18:47:43.004224] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-22T18:47:43.004302] [INFO ] [MAIN ] Update Progress: 843/2367 symbols completed. FLNG took 32.1s. Estimated remaining: 3h 14m 36s. Rate: 7.8 symbols/min [2025-10-22T18:47:43.169425] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:43.217220] [DEBUG] [LOCAL ] FLR: Loaded 53260 existing records from primary storage. [2025-10-22T18:47:43.217542] [INFO ] [MAIN ] FLR: Loaded 53260 existing records. [2025-10-22T18:47:43.322896] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-22T18:47:43.393976] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:43.394180] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-22T18:47:43.394226] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-22T18:47:43.394448] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-22T18:47:43.394503] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-22T18:47:43.749218] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:43.781793] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-22T18:47:44.117699] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-22T18:47:44.338163] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T18:47:44.578981] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:47:44.917742] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-22T18:47:45.717697] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-22T18:47:45.807158] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T18:47:46.517707] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-22T18:47:46.991615] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-22T18:47:47.035678] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T18:47:47.317698] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-22T18:47:48.117731] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-22T18:47:48.522319] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T18:47:48.531365] [INFO ] [REMOTE ] FLG: Full fetch complete (77425 records). [2025-10-22T18:47:48.531534] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-22T18:47:48.922545] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-22T18:47:48.922882] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-22T18:47:48.922767] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-22T18:47:48.924843] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-22T18:47:48.925020] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-22T18:47:48.926738] [DEBUG] [LOCAL ] FLG: Trimmed 77425 records to 53319 (keeping 200 days of data) [2025-10-22T18:47:49.057994] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:47:49.284295] [DEBUG] [LOCAL ] FLG: Primary data saved (53319 records). [2025-10-22T18:47:49.284486] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-22T18:47:49.284591] [INFO ] [MAIN ] Update Progress: 844/2367 symbols completed. FLG took 38.3s. Estimated remaining: 3h 14m 25s. Rate: 7.8 symbols/min [2025-10-22T18:47:49.453485] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:49.497541] [DEBUG] [LOCAL ] FLS: Loaded 50413 existing records from primary storage. [2025-10-22T18:47:49.497917] [INFO ] [MAIN ] FLS: Loaded 50413 existing records. [2025-10-22T18:47:49.670870] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:49.671095] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-22T18:47:49.671142] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-22T18:47:49.671561] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-22T18:47:49.671617] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-22T18:47:49.727835] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-22T18:47:50.072914] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:50.207070] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T18:47:50.355596] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T18:47:50.364216] [INFO ] [REMOTE ] FLO: Full fetch complete (75395 records). [2025-10-22T18:47:50.364361] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-22T18:47:50.535146] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-22T18:47:50.750088] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-22T18:47:50.750176] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-22T18:47:50.751071] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-22T18:47:50.751138] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-22T18:47:50.752552] [DEBUG] [LOCAL ] FLO: Trimmed 75395 records to 52073 (keeping 200 days of data) [2025-10-22T18:47:51.075179] [DEBUG] [LOCAL ] FLO: Primary data saved (52073 records). [2025-10-22T18:47:51.075552] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-22T18:47:51.075681] [INFO ] [MAIN ] Update Progress: 845/2367 symbols completed. FLO took 37.7s. Estimated remaining: 3h 14m 7s. Rate: 7.8 symbols/min [2025-10-22T18:47:51.244061] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:51.273132] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:47:51.323480] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-22T18:47:51.326208] [DEBUG] [LOCAL ] FLUT: Loaded 50684 existing records from primary storage. [2025-10-22T18:47:51.326525] [INFO ] [MAIN ] FLUT: Loaded 50684 existing records. [2025-10-22T18:47:51.499879] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:51.500120] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-22T18:47:51.500164] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-22T18:47:51.500750] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-22T18:47:51.500812] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-22T18:47:51.855599] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:51.923493] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T18:47:52.117680] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-22T18:47:52.917785] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-22T18:47:53.096352] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:47:53.585192] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T18:47:53.589806] [INFO ] [REMOTE ] FLOC: Full fetch complete (40811 records). [2025-10-22T18:47:53.589899] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-22T18:47:53.725512] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-22T18:47:53.774306] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-22T18:47:53.774862] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:47:53.774933] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:47:53.775004] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-22T18:47:53.775067] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-22T18:47:53.775102] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-22T18:47:53.775141] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-22T18:47:53.775198] [INFO ] [MAIN ] Update Progress: 846/2367 symbols completed. FLOC took 25.3s. Estimated remaining: 3h 13m 51s. Rate: 7.8 symbols/min [2025-10-22T18:47:53.944263] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:53.944487] [DEBUG] [LOCAL ] FLXR: No existing data file found in primary storage. [2025-10-22T18:47:53.944556] [WARN ] [MAIN ] FLXR: No existing data found, performing full refresh instead. [2025-10-22T18:47:53.944849] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-22T18:47:53.944964] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-22T18:47:53.945021] [DEBUG] [LOCAL ] FLXR: No primary data file found to delete. [2025-10-22T18:47:53.945056] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-22T18:47:54.312153] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:54.336295] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T18:47:54.517720] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-22T18:47:55.101735] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T18:47:55.317705] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-22T18:47:56.120632] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-22T18:47:56.234015] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:47:56.917681] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-22T18:47:57.041537] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T18:47:57.717629] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-22T18:47:57.744022] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T18:47:57.800187] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T18:47:58.517692] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-22T18:47:59.317669] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-22T18:47:59.488545] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T18:47:59.796995] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T18:48:00.117714] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-22T18:48:00.217824] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:48:00.917732] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-22T18:48:01.131714] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T18:48:01.717942] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-22T18:48:02.517682] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-22T18:48:02.931388] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:48:03.317686] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-22T18:48:03.669427] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T18:48:04.111004] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T18:48:04.121476] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-22T18:48:04.917693] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-22T18:48:05.424419] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T18:48:05.703393] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T18:48:05.717613] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-22T18:48:05.810717] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T18:48:06.517624] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-22T18:48:06.689308] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T18:48:07.317698] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-22T18:48:08.117625] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-22T18:48:08.301965] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T18:48:08.917741] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-22T18:48:09.129387] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T18:48:09.717729] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-22T18:48:09.762004] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T18:48:10.041439] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T18:48:10.517711] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-22T18:48:11.317722] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-22T18:48:11.668365] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T18:48:11.701543] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T18:48:12.117743] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-22T18:48:12.917627] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-22T18:48:13.181171] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T18:48:13.314436] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T18:48:13.326765] [INFO ] [REMOTE ] FLR: Full fetch complete (76896 records). [2025-10-22T18:48:13.327012] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-22T18:48:13.721936] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-22T18:48:13.741244] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-22T18:48:13.742761] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-22T18:48:13.743876] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-22T18:48:13.743971] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-22T18:48:13.745675] [DEBUG] [LOCAL ] FLR: Trimmed 76896 records to 53263 (keeping 200 days of data) [2025-10-22T18:48:14.050598] [DEBUG] [LOCAL ] FLR: Primary data saved (53263 records). [2025-10-22T18:48:14.050789] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-22T18:48:14.050891] [INFO ] [MAIN ] Update Progress: 847/2367 symbols completed. FLR took 31.0s. Estimated remaining: 3h 14m 6s. Rate: 7.8 symbols/min [2025-10-22T18:48:14.248828] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:14.298666] [DEBUG] [LOCAL ] FMC: Loaded 51887 existing records from primary storage. [2025-10-22T18:48:14.299013] [INFO ] [MAIN ] FMC: Loaded 51887 existing records. [2025-10-22T18:48:14.498977] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:14.499422] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-22T18:48:14.499551] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-22T18:48:14.499940] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-22T18:48:14.499998] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-22T18:48:14.533327] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-22T18:48:14.911812] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T18:48:14.925781] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T18:48:14.952872] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:15.317716] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-22T18:48:16.117763] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-22T18:48:16.450174] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T18:48:16.917745] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-22T18:48:17.222074] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T18:48:17.514254] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T18:48:17.519190] [INFO ] [REMOTE ] FLXR: Full fetch complete (27570 records). [2025-10-22T18:48:17.519324] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-22T18:48:17.725414] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-22T18:48:17.890291] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-22T18:48:17.890377] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-22T18:48:17.890903] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-22T18:48:17.890966] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-22T18:48:17.891840] [DEBUG] [LOCAL ] FLXR: Trimmed 27570 records to 21360 (keeping 200 days of data) [2025-10-22T18:48:18.020921] [DEBUG] [LOCAL ] FLXR: Primary data saved (21360 records). [2025-10-22T18:48:18.021048] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-22T18:48:18.021115] [INFO ] [MAIN ] Update Progress: 848/2367 symbols completed. FLXR took 24.2s. Estimated remaining: 3h 13m 51s. Rate: 7.8 symbols/min [2025-10-22T18:48:18.185197] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:18.193958] [DEBUG] [LOCAL ] FMN: Loaded 5499 existing records from primary storage. [2025-10-22T18:48:18.194161] [INFO ] [MAIN ] FMN: Loaded 5499 existing records. [2025-10-22T18:48:18.400123] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:18.400403] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-22T18:48:18.400464] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-22T18:48:18.400806] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-22T18:48:18.400880] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-22T18:48:18.526839] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-22T18:48:18.758263] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T18:48:18.806741] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:19.317619] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-22T18:48:19.487060] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T18:48:20.040503] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T18:48:20.117616] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-22T18:48:20.304417] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T18:48:20.917704] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-22T18:48:21.661436] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T18:48:21.717619] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-22T18:48:21.847491] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T18:48:22.517630] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-22T18:48:22.674853] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T18:48:23.317744] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-22T18:48:24.117732] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-22T18:48:24.363581] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-22T18:48:24.917715] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-22T18:48:25.158255] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:48:25.167206] [INFO ] [REMOTE ] FLS: Full fetch complete (72537 records). [2025-10-22T18:48:25.167354] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-22T18:48:25.554332] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-22T18:48:25.554418] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-22T18:48:25.555343] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-22T18:48:25.555409] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-22T18:48:25.556837] [DEBUG] [LOCAL ] FLS: Trimmed 72537 records to 50409 (keeping 200 days of data) [2025-10-22T18:48:25.726548] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-22T18:48:25.863690] [DEBUG] [LOCAL ] FLS: Primary data saved (50409 records). [2025-10-22T18:48:25.863872] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-22T18:48:25.864212] [INFO ] [MAIN ] Update Progress: 849/2367 symbols completed. FLS took 36.6s. Estimated remaining: 3h 13m 44s. Rate: 7.8 symbols/min [2025-10-22T18:48:25.996285] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T18:48:26.074444] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:26.103034] [DEBUG] [LOCAL ] FMS: Loaded 30427 existing records from primary storage. [2025-10-22T18:48:26.103294] [INFO ] [MAIN ] FMS: Loaded 30427 existing records. [2025-10-22T18:48:26.277764] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:26.278014] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-22T18:48:26.278062] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-22T18:48:26.278244] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-22T18:48:26.278301] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-22T18:48:26.530439] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-22T18:48:26.579035] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T18:48:26.657585] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:26.992864] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T18:48:27.317732] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-22T18:48:28.117705] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-22T18:48:28.647989] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T18:48:28.676989] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T18:48:28.685883] [INFO ] [REMOTE ] FLUT: Full fetch complete (73382 records). [2025-10-22T18:48:28.686054] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-22T18:48:28.790445] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T18:48:28.922915] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-22T18:48:29.078813] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-22T18:48:29.078895] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-22T18:48:29.079757] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-22T18:48:29.079819] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-22T18:48:29.081209] [DEBUG] [LOCAL ] FLUT: Trimmed 73382 records to 50672 (keeping 200 days of data) [2025-10-22T18:48:29.379141] [DEBUG] [LOCAL ] FLUT: Primary data saved (50672 records). [2025-10-22T18:48:29.379286] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-22T18:48:29.379365] [INFO ] [MAIN ] Update Progress: 850/2367 symbols completed. FLUT took 38.3s. Estimated remaining: 3h 13m 29s. Rate: 7.8 symbols/min [2025-10-22T18:48:29.544171] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:29.578939] [DEBUG] [LOCAL ] FMX: Loaded 40553 existing records from primary storage. [2025-10-22T18:48:29.579229] [INFO ] [MAIN ] FMX: Loaded 40553 existing records. [2025-10-22T18:48:29.727328] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-22T18:48:29.757027] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:29.757304] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-22T18:48:29.757351] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-22T18:48:29.757602] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-22T18:48:29.757710] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-22T18:48:30.107715] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:30.427866] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T18:48:30.517760] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-22T18:48:31.183955] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-22T18:48:31.226761] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T18:48:31.317718] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-22T18:48:32.117745] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-22T18:48:32.917682] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-22T18:48:33.059780] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T18:48:33.283532] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T18:48:33.499530] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T18:48:33.717729] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-22T18:48:34.517908] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-22T18:48:35.140535] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T18:48:35.185754] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T18:48:35.317706] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-22T18:48:36.106362] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T18:48:36.108182] [INFO ] [REMOTE ] FMN: Full fetch complete (9940 records). [2025-10-22T18:48:36.108254] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-22T18:48:36.122871] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-22T18:48:36.471767] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-22T18:48:36.471927] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-22T18:48:36.472204] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-22T18:48:36.472246] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-22T18:48:36.472764] [DEBUG] [LOCAL ] FMN: Trimmed 9940 records to 5477 (keeping 200 days of data) [2025-10-22T18:48:36.508042] [DEBUG] [LOCAL ] FMN: Primary data saved (5477 records). [2025-10-22T18:48:36.508180] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-22T18:48:36.508279] [INFO ] [MAIN ] Update Progress: 851/2367 symbols completed. FMN took 18.5s. Estimated remaining: 3h 13m 20s. Rate: 7.8 symbols/min [2025-10-22T18:48:36.677964] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:36.681678] [DEBUG] [LOCAL ] FMY: Loaded 1377 existing records from primary storage. [2025-10-22T18:48:36.681834] [INFO ] [MAIN ] FMY: Loaded 1377 existing records. [2025-10-22T18:48:36.860773] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:36.861020] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-22T18:48:36.861068] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-22T18:48:36.861191] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-22T18:48:36.861229] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-22T18:48:36.929231] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-22T18:48:37.217302] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:37.622890] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T18:48:37.717719] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-22T18:48:38.118873] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-22T18:48:38.517722] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-22T18:48:38.644660] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:48:39.317714] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-22T18:48:39.970758] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T18:48:40.117700] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-22T18:48:40.917684] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-22T18:48:41.084869] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T18:48:41.552023] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T18:48:41.572511] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T18:48:41.717741] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-22T18:48:42.517723] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-22T18:48:43.317624] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-22T18:48:43.484155] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T18:48:43.773415] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:48:44.117714] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-22T18:48:44.505185] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T18:48:44.522111] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T18:48:44.917704] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-22T18:48:45.717705] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-22T18:48:46.517693] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-22T18:48:46.568560] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T18:48:46.991724] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T18:48:47.317678] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-22T18:48:47.612095] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T18:48:48.117679] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-22T18:48:48.562511] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T18:48:48.917685] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-22T18:48:49.283958] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-22T18:48:49.672946] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T18:48:49.717610] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-22T18:48:50.517692] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-22T18:48:51.224632] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T18:48:51.317724] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-22T18:48:51.770771] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T18:48:52.117767] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-22T18:48:52.719546] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:48:52.917711] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-22T18:48:53.267284] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T18:48:53.717725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-22T18:48:54.055842] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T18:48:54.064452] [INFO ] [REMOTE ] FMC: Full fetch complete (75426 records). [2025-10-22T18:48:54.064574] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-22T18:48:54.264291] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T18:48:54.453727] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-22T18:48:54.453826] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-22T18:48:54.454712] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-22T18:48:54.454774] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-22T18:48:54.456171] [DEBUG] [LOCAL ] FMC: Trimmed 75426 records to 51883 (keeping 200 days of data) [2025-10-22T18:48:54.542153] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-22T18:48:54.768622] [DEBUG] [LOCAL ] FMC: Primary data saved (51883 records). [2025-10-22T18:48:54.768846] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-22T18:48:54.769764] [INFO ] [MAIN ] Update Progress: 852/2367 symbols completed. FMC took 40.7s. Estimated remaining: 3h 13m 32s. Rate: 7.8 symbols/min [2025-10-22T18:48:54.935968] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:54.973139] [DEBUG] [LOCAL ] FN: Loaded 37491 existing records from primary storage. [2025-10-22T18:48:54.973423] [INFO ] [MAIN ] FN: Loaded 37491 existing records. [2025-10-22T18:48:55.151587] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:55.151817] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-22T18:48:55.151863] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-22T18:48:55.152119] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-22T18:48:55.152166] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-22T18:48:55.318253] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-22T18:48:55.547090] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:55.873831] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T18:48:56.099935] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:48:56.117629] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-22T18:48:56.917723] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-22T18:48:57.359235] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T18:48:57.717760] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-22T18:48:57.904349] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T18:48:58.095559] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-22T18:48:58.096350] [INFO ] [REMOTE ] FMY: Full fetch complete (1943 records). [2025-10-22T18:48:58.096429] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-22T18:48:58.448941] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-22T18:48:58.449022] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-22T18:48:58.449110] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-22T18:48:58.449147] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-22T18:48:58.449460] [DEBUG] [LOCAL ] FMY: Trimmed 1943 records to 1360 (keeping 200 days of data) [2025-10-22T18:48:58.457931] [DEBUG] [LOCAL ] FMY: Primary data saved (1360 records). [2025-10-22T18:48:58.457990] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-22T18:48:58.458055] [INFO ] [MAIN ] Update Progress: 853/2367 symbols completed. FMY took 21.9s. Estimated remaining: 3h 13m 17s. Rate: 7.8 symbols/min [2025-10-22T18:48:58.522979] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-22T18:48:58.650501] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:58.709670] [DEBUG] [LOCAL ] FNB: Loaded 52603 existing records from primary storage. [2025-10-22T18:48:58.710198] [INFO ] [MAIN ] FNB: Loaded 52603 existing records. [2025-10-22T18:48:58.915878] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:58.916121] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-22T18:48:58.916171] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-22T18:48:58.916369] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-22T18:48:58.916408] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-22T18:48:59.272953] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:59.317700] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-22T18:49:00.083278] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T18:49:00.117722] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-22T18:49:00.917786] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-22T18:49:01.459236] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T18:49:01.717682] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-22T18:49:01.790681] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T18:49:02.517765] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-22T18:49:02.562214] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:49:03.317708] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-22T18:49:03.640560] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T18:49:04.117768] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-22T18:49:04.204317] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:49:04.850168] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:49:04.856292] [INFO ] [REMOTE ] FMX: Full fetch complete (58007 records). [2025-10-22T18:49:04.856393] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-22T18:49:04.924240] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-22T18:49:05.275953] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-22T18:49:05.276067] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-22T18:49:05.277016] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-22T18:49:05.277100] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-22T18:49:05.278467] [DEBUG] [LOCAL ] FMX: Trimmed 58007 records to 40436 (keeping 200 days of data) [2025-10-22T18:49:05.544710] [DEBUG] [LOCAL ] FMX: Primary data saved (40436 records). [2025-10-22T18:49:05.544847] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-22T18:49:05.544925] [INFO ] [MAIN ] Update Progress: 854/2367 symbols completed. FMX took 36.2s. Estimated remaining: 3h 13m 8s. Rate: 7.8 symbols/min [2025-10-22T18:49:05.714067] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:05.717742] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-22T18:49:05.763800] [DEBUG] [LOCAL ] FND: Loaded 52080 existing records from primary storage. [2025-10-22T18:49:05.764122] [INFO ] [MAIN ] FND: Loaded 52080 existing records. [2025-10-22T18:49:05.952051] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:05.952319] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-22T18:49:05.952367] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-22T18:49:05.952592] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-22T18:49:05.952684] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-22T18:49:06.348168] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T18:49:06.387422] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-22T18:49:06.392891] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:06.517705] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-22T18:49:07.329749] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-22T18:49:07.332291] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T18:49:08.117725] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-22T18:49:08.237374] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T18:49:08.537475] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:49:08.917758] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-22T18:49:09.586764] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T18:49:09.594839] [INFO ] [REMOTE ] FMS: Full fetch complete (43147 records). [2025-10-22T18:49:09.594962] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-22T18:49:09.731766] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-22T18:49:09.967990] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-22T18:49:09.968080] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-22T18:49:09.968752] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-22T18:49:09.968815] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-22T18:49:09.969869] [DEBUG] [LOCAL ] FMS: Trimmed 43147 records to 30344 (keeping 200 days of data) [2025-10-22T18:49:10.146794] [DEBUG] [LOCAL ] FMS: Primary data saved (30344 records). [2025-10-22T18:49:10.146933] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-22T18:49:10.147013] [INFO ] [MAIN ] Update Progress: 855/2367 symbols completed. FMS took 44.3s. Estimated remaining: 3h 12m 55s. Rate: 7.8 symbols/min [2025-10-22T18:49:10.317115] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:10.361218] [DEBUG] [LOCAL ] FNF: Loaded 48759 existing records from primary storage. [2025-10-22T18:49:10.361509] [INFO ] [MAIN ] FNF: Loaded 48759 existing records. [2025-10-22T18:49:10.518634] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-22T18:49:10.556854] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:10.571673] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-22T18:49:10.572897] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-22T18:49:10.574362] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T18:49:10.574539] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-22T18:49:10.584792] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-22T18:49:10.992518] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:11.317770] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-22T18:49:11.544217] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T18:49:12.117747] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-22T18:49:12.403553] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T18:49:12.466598] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T18:49:12.917725] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-22T18:49:13.681381] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T18:49:13.717722] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-22T18:49:14.316182] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:49:14.517720] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-22T18:49:15.317700] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-22T18:49:15.585688] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T18:49:16.117625] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-22T18:49:16.235250] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:49:16.412913] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T18:49:16.917746] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-22T18:49:17.717735] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-22T18:49:17.854137] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T18:49:18.517726] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-22T18:49:18.637730] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:49:19.114356] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T18:49:19.317700] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-22T18:49:20.117612] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-22T18:49:20.453532] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T18:49:20.917717] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-22T18:49:21.064895] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:49:21.696595] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:49:21.717606] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-22T18:49:22.517736] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-22T18:49:22.803082] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T18:49:22.812957] [INFO ] [REMOTE ] FNB: Full fetch complete (76231 records). [2025-10-22T18:49:22.813178] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-22T18:49:23.227255] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-22T18:49:23.227393] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-22T18:49:23.228765] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-22T18:49:23.228833] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-22T18:49:23.231194] [DEBUG] [LOCAL ] FNB: Trimmed 76231 records to 52602 (keeping 200 days of data) [2025-10-22T18:49:23.323015] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-22T18:49:23.585145] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T18:49:23.615552] [DEBUG] [LOCAL ] FNB: Primary data saved (52602 records). [2025-10-22T18:49:23.615698] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-22T18:49:23.615784] [INFO ] [MAIN ] Update Progress: 856/2367 symbols completed. FNB took 25.2s. Estimated remaining: 3h 12m 58s. Rate: 7.8 symbols/min [2025-10-22T18:49:23.785089] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:23.818334] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T18:49:23.864066] [DEBUG] [LOCAL ] FNV: Loaded 46145 existing records from primary storage. [2025-10-22T18:49:23.864354] [INFO ] [MAIN ] FNV: Loaded 46145 existing records. [2025-10-22T18:49:24.038607] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:24.038844] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-22T18:49:24.038892] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-22T18:49:24.039068] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-22T18:49:24.039105] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-22T18:49:24.127171] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-22T18:49:24.394447] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:24.925049] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-22T18:49:24.930925] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T18:49:25.717697] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-22T18:49:25.865337] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:49:26.518538] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-22T18:49:26.520808] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:49:27.175210] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T18:49:27.317720] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-22T18:49:28.117714] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-22T18:49:28.766160] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-22T18:49:28.917729] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-22T18:49:28.953243] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T18:49:29.705207] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T18:49:29.710868] [INFO ] [REMOTE ] FN: Full fetch complete (56451 records). [2025-10-22T18:49:29.710992] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-22T18:49:29.722954] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-22T18:49:30.102372] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-22T18:49:30.102475] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-22T18:49:30.103408] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-22T18:49:30.103474] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-22T18:49:30.104773] [DEBUG] [LOCAL ] FN: Trimmed 56451 records to 37392 (keeping 200 days of data) [2025-10-22T18:49:30.325193] [DEBUG] [LOCAL ] FN: Primary data saved (37392 records). [2025-10-22T18:49:30.325323] [INFO ] [MAIN ] FN: Full history saved. [2025-10-22T18:49:30.325886] [INFO ] [MAIN ] Update Progress: 857/2367 symbols completed. FN took 35.6s. Estimated remaining: 3h 12m 49s. Rate: 7.8 symbols/min [2025-10-22T18:49:30.493760] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:30.507701] [DEBUG] [LOCAL ] FOA: Loaded 13051 existing records from primary storage. [2025-10-22T18:49:30.507937] [INFO ] [MAIN ] FOA: Loaded 13051 existing records. [2025-10-22T18:49:30.538561] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-22T18:49:30.689937] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:30.690275] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-22T18:49:30.690405] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-22T18:49:30.690764] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-22T18:49:30.690845] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-22T18:49:30.906073] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T18:49:31.096559] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:31.169740] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T18:49:31.317629] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-22T18:49:32.117720] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-22T18:49:32.175227] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T18:49:32.474020] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T18:49:32.917740] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-22T18:49:33.448510] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T18:49:33.717708] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-22T18:49:34.517755] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-22T18:49:34.685493] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T18:49:35.250042] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T18:49:35.317706] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-22T18:49:35.357469] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:49:36.117710] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-22T18:49:36.917729] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-22T18:49:37.570583] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-22T18:49:37.579099] [INFO ] [REMOTE ] FND: Full fetch complete (75088 records). [2025-10-22T18:49:37.579211] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-22T18:49:37.720983] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-22T18:49:37.852701] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T18:49:38.009002] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-22T18:49:38.009202] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-22T18:49:38.010233] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-22T18:49:38.010368] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-22T18:49:38.011997] [DEBUG] [LOCAL ] FND: Trimmed 75088 records to 52075 (keeping 200 days of data) [2025-10-22T18:49:38.321902] [DEBUG] [LOCAL ] FND: Primary data saved (52075 records). [2025-10-22T18:49:38.322220] [INFO ] [MAIN ] FND: Full history saved. [2025-10-22T18:49:38.322403] [INFO ] [MAIN ] Update Progress: 858/2367 symbols completed. FND took 32.8s. Estimated remaining: 3h 12m 41s. Rate: 7.8 symbols/min [2025-10-22T18:49:38.507480] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:38.522617] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-22T18:49:38.535851] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-22T18:49:38.556287] [DEBUG] [LOCAL ] FOF: Loaded 8614 existing records from primary storage. [2025-10-22T18:49:38.556762] [INFO ] [MAIN ] FOF: Loaded 8614 existing records. [2025-10-22T18:49:38.744686] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:38.745054] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-22T18:49:38.745111] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-22T18:49:38.745352] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-22T18:49:38.745414] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-22T18:49:39.150115] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:39.317677] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-22T18:49:39.426320] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T18:49:39.603179] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T18:49:39.610927] [INFO ] [REMOTE ] FNF: Full fetch complete (70010 records). [2025-10-22T18:49:39.611060] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-22T18:49:39.990333] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-22T18:49:39.990438] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-22T18:49:39.991356] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-22T18:49:39.991431] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-22T18:49:39.992787] [DEBUG] [LOCAL ] FNF: Trimmed 70010 records to 48737 (keeping 200 days of data) [2025-10-22T18:49:40.161441] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-22T18:49:40.281977] [DEBUG] [LOCAL ] FNF: Primary data saved (48737 records). [2025-10-22T18:49:40.282120] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-22T18:49:40.282202] [INFO ] [MAIN ] Update Progress: 859/2367 symbols completed. FNF took 30.1s. Estimated remaining: 3h 12m 24s. Rate: 7.8 symbols/min [2025-10-22T18:49:40.446235] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:40.465767] [DEBUG] [LOCAL ] FOR: Loaded 19646 existing records from primary storage. [2025-10-22T18:49:40.466005] [INFO ] [MAIN ] FOR: Loaded 19646 existing records. [2025-10-22T18:49:40.641981] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:40.642239] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-22T18:49:40.642287] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-22T18:49:40.642518] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-22T18:49:40.642574] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-22T18:49:40.921994] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-22T18:49:41.008857] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:41.116830] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T18:49:41.133180] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T18:49:41.717706] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-22T18:49:41.810410] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T18:49:42.453543] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T18:49:42.517694] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-22T18:49:43.317687] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-22T18:49:44.073963] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T18:49:44.117626] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-22T18:49:44.215809] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T18:49:44.917632] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-22T18:49:45.184716] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T18:49:45.684335] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T18:49:45.717610] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-22T18:49:46.517632] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-22T18:49:46.624962] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T18:49:47.304045] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T18:49:47.317605] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-22T18:49:48.117619] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-22T18:49:48.362517] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T18:49:48.917690] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-22T18:49:49.548811] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T18:49:49.717631] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-22T18:49:49.970203] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T18:49:50.517632] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-22T18:49:50.788028] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T18:49:51.317720] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-22T18:49:51.731551] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T18:49:51.734184] [INFO ] [REMOTE ] FOA: Full fetch complete (21133 records). [2025-10-22T18:49:51.734257] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-22T18:49:52.115597] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-22T18:49:52.115834] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-22T18:49:52.116403] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-22T18:49:52.116482] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-22T18:49:52.122040] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-22T18:49:52.130910] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T18:49:52.130351] [DEBUG] [LOCAL ] FOA: Trimmed 21133 records to 13013 (keeping 200 days of data) [2025-10-22T18:49:52.212594] [DEBUG] [LOCAL ] FOA: Primary data saved (13013 records). [2025-10-22T18:49:52.212747] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-22T18:49:52.212832] [INFO ] [MAIN ] Update Progress: 860/2367 symbols completed. FOA took 21.9s. Estimated remaining: 3h 12m 24s. Rate: 7.8 symbols/min [2025-10-22T18:49:52.383085] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:52.428511] [DEBUG] [LOCAL ] FOUR: Loaded 49722 existing records from primary storage. [2025-10-22T18:49:52.428834] [INFO ] [MAIN ] FOUR: Loaded 49722 existing records. [2025-10-22T18:49:52.604993] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:52.605186] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-22T18:49:52.605236] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-22T18:49:52.605419] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-22T18:49:52.605458] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-22T18:49:52.926740] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-22T18:49:52.976465] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T18:49:52.975491] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:53.717694] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-22T18:49:54.250097] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T18:49:54.517702] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-22T18:49:55.311619] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T18:49:55.321156] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-22T18:49:55.550501] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:49:56.117696] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-22T18:49:56.888048] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T18:49:56.917610] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-22T18:49:57.059833] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T18:49:57.717802] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-22T18:49:58.335856] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T18:49:58.517688] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-22T18:49:59.317707] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-22T18:49:59.414406] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:50:00.117800] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-22T18:50:00.186085] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T18:50:00.368109] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-22T18:50:00.917743] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-22T18:50:01.717799] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-22T18:50:02.292473] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T18:50:02.517773] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-22T18:50:03.135937] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T18:50:03.318634] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-22T18:50:03.320903] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-22T18:50:03.329016] [INFO ] [REMOTE ] FNV: Full fetch complete (67016 records). [2025-10-22T18:50:03.329116] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-22T18:50:03.729256] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-22T18:50:03.729353] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-22T18:50:03.730189] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-22T18:50:03.730251] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-22T18:50:03.731576] [DEBUG] [LOCAL ] FNV: Trimmed 67016 records to 46129 (keeping 200 days of data) [2025-10-22T18:50:04.012493] [DEBUG] [LOCAL ] FNV: Primary data saved (46129 records). [2025-10-22T18:50:04.012611] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-22T18:50:04.012713] [INFO ] [MAIN ] Update Progress: 861/2367 symbols completed. FNV took 40.4s. Estimated remaining: 3h 12m 23s. Rate: 7.8 symbols/min [2025-10-22T18:50:04.122883] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-22T18:50:04.180131] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:04.198677] [DEBUG] [LOCAL ] FPF: Loaded 18753 existing records from primary storage. [2025-10-22T18:50:04.198916] [INFO ] [MAIN ] FPF: Loaded 18753 existing records. [2025-10-22T18:50:04.356349] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T18:50:04.385860] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:04.386069] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-22T18:50:04.386230] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-22T18:50:04.386507] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-22T18:50:04.386562] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-22T18:50:04.692868] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-22T18:50:04.777489] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:04.917611] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-22T18:50:05.104027] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T18:50:05.717734] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-22T18:50:06.266354] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T18:50:06.455692] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T18:50:06.517618] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-22T18:50:07.317704] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-22T18:50:07.369348] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T18:50:08.112300] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T18:50:08.117612] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-22T18:50:08.917705] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-22T18:50:09.717759] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-22T18:50:09.734034] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T18:50:09.736911] [INFO ] [REMOTE ] FOR: Full fetch complete (29650 records). [2025-10-22T18:50:09.736987] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-22T18:50:10.108552] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-22T18:50:10.108673] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-22T18:50:10.109265] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-22T18:50:10.109325] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-22T18:50:10.110048] [DEBUG] [LOCAL ] FOR: Trimmed 29650 records to 19506 (keeping 200 days of data) [2025-10-22T18:50:10.218177] [DEBUG] [LOCAL ] FOR: Primary data saved (19506 records). [2025-10-22T18:50:10.218323] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-22T18:50:10.218435] [INFO ] [MAIN ] Update Progress: 862/2367 symbols completed. FOR took 29.9s. Estimated remaining: 3h 12m 13s. Rate: 7.8 symbols/min [2025-10-22T18:50:10.382615] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:10.400590] [DEBUG] [LOCAL ] FPH: Loaded 19222 existing records from primary storage. [2025-10-22T18:50:10.400850] [INFO ] [MAIN ] FPH: Loaded 19222 existing records. [2025-10-22T18:50:10.522789] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-22T18:50:10.591807] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:10.592020] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-22T18:50:10.592069] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-22T18:50:10.592250] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-22T18:50:10.592307] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-22T18:50:10.957727] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:11.186283] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-22T18:50:11.270260] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T18:50:11.272154] [INFO ] [REMOTE ] FOF: Full fetch complete (11911 records). [2025-10-22T18:50:11.272223] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-22T18:50:11.325757] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-22T18:50:11.627764] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-22T18:50:11.627846] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-22T18:50:11.628200] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-22T18:50:11.628246] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-22T18:50:11.628704] [DEBUG] [LOCAL ] FOF: Trimmed 11911 records to 8391 (keeping 200 days of data) [2025-10-22T18:50:11.680585] [DEBUG] [LOCAL ] FOF: Primary data saved (8391 records). [2025-10-22T18:50:11.680790] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-22T18:50:11.680875] [INFO ] [MAIN ] Update Progress: 863/2367 symbols completed. FOF took 33.4s. Estimated remaining: 3h 11m 54s. Rate: 7.8 symbols/min [2025-10-22T18:50:11.847971] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T18:50:11.868176] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:11.899895] [DEBUG] [LOCAL ] FPI: Loaded 31413 existing records from primary storage. [2025-10-22T18:50:11.900151] [INFO ] [MAIN ] FPI: Loaded 31413 existing records. [2025-10-22T18:50:12.075051] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:12.075242] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-22T18:50:12.075288] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-22T18:50:12.075471] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-22T18:50:12.075526] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-22T18:50:12.128920] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-22T18:50:12.429550] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:12.917699] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-22T18:50:13.105633] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:50:13.509099] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T18:50:13.717698] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-22T18:50:14.325720] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:50:14.517701] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-22T18:50:14.599747] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T18:50:15.317628] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-22T18:50:15.395276] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T18:50:16.117698] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-22T18:50:16.637921] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T18:50:16.917734] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-22T18:50:17.059534] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T18:50:17.717739] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-22T18:50:18.517685] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-22T18:50:18.710533] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T18:50:18.879528] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-22T18:50:19.317761] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-22T18:50:19.830383] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T18:50:20.117697] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-22T18:50:20.917694] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-22T18:50:21.102445] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T18:50:21.175745] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T18:50:21.720687] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-22T18:50:22.304440] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:50:22.517760] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-22T18:50:23.317733] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-22T18:50:23.519758] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T18:50:23.802793] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T18:50:23.811392] [INFO ] [REMOTE ] FOUR: Full fetch complete (72260 records). [2025-10-22T18:50:23.811551] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-22T18:50:24.123299] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-22T18:50:24.221065] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-22T18:50:24.221142] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-22T18:50:24.221986] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-22T18:50:24.222047] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-22T18:50:24.223362] [DEBUG] [LOCAL ] FOUR: Trimmed 72260 records to 49712 (keeping 200 days of data) [2025-10-22T18:50:24.448996] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T18:50:24.548053] [DEBUG] [LOCAL ] FOUR: Primary data saved (49712 records). [2025-10-22T18:50:24.548229] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-22T18:50:24.548787] [INFO ] [MAIN ] Update Progress: 864/2367 symbols completed. FOUR took 32.3s. Estimated remaining: 3h 11m 56s. Rate: 7.8 symbols/min [2025-10-22T18:50:24.753811] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:24.795547] [DEBUG] [LOCAL ] FR: Loaded 46672 existing records from primary storage. [2025-10-22T18:50:24.795863] [INFO ] [MAIN ] FR: Loaded 46672 existing records. [2025-10-22T18:50:24.922750] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-22T18:50:24.986316] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:24.986596] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-22T18:50:24.986680] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-22T18:50:24.986874] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-22T18:50:24.986919] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-22T18:50:25.316992] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T18:50:25.382780] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:25.717742] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-22T18:50:25.975324] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T18:50:26.517695] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-22T18:50:26.692568] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T18:50:27.317746] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-22T18:50:27.989986] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:50:28.117705] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-22T18:50:28.678026] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T18:50:28.917626] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-22T18:50:29.103493] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T18:50:29.717747] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-22T18:50:30.146534] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T18:50:30.517722] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-22T18:50:31.110908] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T18:50:31.317696] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-22T18:50:31.530494] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T18:50:32.117707] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-22T18:50:32.498392] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T18:50:32.917629] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-22T18:50:33.243110] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T18:50:33.717730] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-22T18:50:34.517683] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-22T18:50:34.549321] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:50:34.739248] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T18:50:35.317623] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-22T18:50:35.467527] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T18:50:36.117727] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-22T18:50:36.917754] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-22T18:50:37.092853] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T18:50:37.120427] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T18:50:37.717706] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-22T18:50:38.214849] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T18:50:38.517720] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-22T18:50:39.103916] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T18:50:39.317716] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-22T18:50:39.794467] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T18:50:39.799807] [INFO ] [REMOTE ] FPI: Full fetch complete (43910 records). [2025-10-22T18:50:39.799922] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-22T18:50:40.126438] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-22T18:50:40.166335] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-22T18:50:40.166418] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-22T18:50:40.167093] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-22T18:50:40.167154] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-22T18:50:40.168187] [DEBUG] [LOCAL ] FPI: Trimmed 43910 records to 31375 (keeping 200 days of data) [2025-10-22T18:50:40.354518] [DEBUG] [LOCAL ] FPI: Primary data saved (31375 records). [2025-10-22T18:50:40.354718] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-22T18:50:40.354838] [INFO ] [MAIN ] Update Progress: 865/2367 symbols completed. FPI took 28.7s. Estimated remaining: 3h 12m 2s. Rate: 7.8 symbols/min [2025-10-22T18:50:40.521961] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:40.548345] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T18:50:40.570448] [DEBUG] [LOCAL ] FRA: Loaded 14225 existing records from primary storage. [2025-10-22T18:50:40.570704] [INFO ] [MAIN ] FRA: Loaded 14225 existing records. [2025-10-22T18:50:40.743195] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:40.743410] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-22T18:50:40.743467] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-22T18:50:40.743618] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-22T18:50:40.743696] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-22T18:50:40.925336] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-22T18:50:41.091793] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:41.152296] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T18:50:41.717690] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-22T18:50:42.238891] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T18:50:42.245042] [INFO ] [REMOTE ] FPF: Full fetch complete (26614 records). [2025-10-22T18:50:42.245166] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-22T18:50:42.522854] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-22T18:50:42.616639] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-22T18:50:42.616788] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-22T18:50:42.617295] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-22T18:50:42.617335] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-22T18:50:42.618169] [DEBUG] [LOCAL ] FPF: Trimmed 26614 records to 18735 (keeping 200 days of data) [2025-10-22T18:50:42.729999] [DEBUG] [LOCAL ] FPF: Primary data saved (18735 records). [2025-10-22T18:50:42.730135] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-22T18:50:42.730213] [INFO ] [MAIN ] Update Progress: 866/2367 symbols completed. FPF took 38.7s. Estimated remaining: 3h 11m 46s. Rate: 7.8 symbols/min [2025-10-22T18:50:42.899585] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:42.916186] [DEBUG] [LOCAL ] FRGE: Loaded 15653 existing records from primary storage. [2025-10-22T18:50:42.916408] [INFO ] [MAIN ] FRGE: Loaded 15653 existing records. [2025-10-22T18:50:43.096511] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:43.111129] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-22T18:50:43.111198] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-22T18:50:43.119581] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-22T18:50:43.119778] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-22T18:50:43.165461] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:50:43.323200] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-22T18:50:43.501268] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:43.523842] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T18:50:43.527181] [INFO ] [REMOTE ] FPH: Full fetch complete (30832 records). [2025-10-22T18:50:43.527256] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-22T18:50:43.881089] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-22T18:50:43.881160] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-22T18:50:43.881706] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-22T18:50:43.881767] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-22T18:50:43.882408] [DEBUG] [LOCAL ] FPH: Trimmed 30832 records to 19183 (keeping 200 days of data) [2025-10-22T18:50:43.985013] [DEBUG] [LOCAL ] FPH: Primary data saved (19183 records). [2025-10-22T18:50:43.985147] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-22T18:50:43.985225] [INFO ] [MAIN ] Update Progress: 867/2367 symbols completed. FPH took 33.8s. Estimated remaining: 3h 11m 27s. Rate: 7.8 symbols/min [2025-10-22T18:50:44.125390] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-22T18:50:44.157803] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:44.206387] [DEBUG] [LOCAL ] FRO: Loaded 51688 existing records from primary storage. [2025-10-22T18:50:44.206767] [INFO ] [MAIN ] FRO: Loaded 51688 existing records. [2025-10-22T18:50:44.384163] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:44.384339] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-22T18:50:44.384385] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-22T18:50:44.384549] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-22T18:50:44.384586] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-22T18:50:44.496831] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T18:50:44.771344] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:44.917720] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-22T18:50:45.438943] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T18:50:45.717699] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-22T18:50:46.365874] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:50:46.517737] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-22T18:50:47.085611] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T18:50:47.317629] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-22T18:50:48.117694] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-22T18:50:48.269319] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T18:50:48.375529] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T18:50:48.917735] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-22T18:50:49.717751] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-22T18:50:49.860398] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:50:49.908340] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T18:50:50.517782] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-22T18:50:51.082212] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T18:50:51.317782] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-22T18:50:51.993080] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T18:50:52.117748] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-22T18:50:52.565590] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T18:50:52.917720] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-22T18:50:53.676483] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T18:50:53.717760] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-22T18:50:53.978419] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T18:50:54.517755] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-22T18:50:55.317724] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-22T18:50:55.403805] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:50:55.423809] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T18:50:56.117796] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-22T18:50:56.850947] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:50:56.860151] [INFO ] [REMOTE ] FR: Full fetch complete (67234 records). [2025-10-22T18:50:56.860350] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-22T18:50:56.922946] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-22T18:50:56.999539] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T18:50:57.312788] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-22T18:50:57.312911] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-22T18:50:57.314841] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-22T18:50:57.314932] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-22T18:50:57.316936] [DEBUG] [LOCAL ] FR: Trimmed 67234 records to 46648 (keeping 200 days of data) [2025-10-22T18:50:57.635186] [DEBUG] [LOCAL ] FR: Primary data saved (46648 records). [2025-10-22T18:50:57.635389] [INFO ] [MAIN ] FR: Full history saved. [2025-10-22T18:50:57.636039] [INFO ] [MAIN ] Update Progress: 868/2367 symbols completed. FR took 33.1s. Estimated remaining: 3h 11m 29s. Rate: 7.8 symbols/min [2025-10-22T18:50:57.721278] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-22T18:50:57.832752] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:57.879123] [DEBUG] [LOCAL ] FRT: Loaded 41559 existing records from primary storage. [2025-10-22T18:50:57.879513] [INFO ] [MAIN ] FRT: Loaded 41559 existing records. [2025-10-22T18:50:57.976279] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-22T18:50:58.090359] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:58.090762] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-22T18:50:58.090834] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-22T18:50:58.091106] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-22T18:50:58.091182] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-22T18:50:58.475388] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:58.517687] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-22T18:50:58.754451] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T18:50:59.317714] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-22T18:50:59.675969] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T18:51:00.117743] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-22T18:51:00.854115] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T18:51:00.910003] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T18:51:00.917610] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-22T18:51:01.717741] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-22T18:51:01.896936] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:51:01.899356] [INFO ] [REMOTE ] FRGE: Full fetch complete (30170 records). [2025-10-22T18:51:01.899427] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-22T18:51:02.256978] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-22T18:51:02.257049] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-22T18:51:02.257557] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-22T18:51:02.257596] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-22T18:51:02.258258] [DEBUG] [LOCAL ] FRGE: Trimmed 30170 records to 15540 (keeping 200 days of data) [2025-10-22T18:51:02.345906] [DEBUG] [LOCAL ] FRGE: Primary data saved (15540 records). [2025-10-22T18:51:02.346035] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-22T18:51:02.346112] [INFO ] [MAIN ] Update Progress: 869/2367 symbols completed. FRGE took 19.6s. Estimated remaining: 3h 11m 17s. Rate: 7.8 symbols/min [2025-10-22T18:51:02.517615] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-22T18:51:02.517549] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:02.552142] [DEBUG] [LOCAL ] FSCO: Loaded 38651 existing records from primary storage. [2025-10-22T18:51:02.552405] [INFO ] [MAIN ] FSCO: Loaded 38651 existing records. [2025-10-22T18:51:02.723740] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:02.723986] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-22T18:51:02.724041] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-22T18:51:02.724206] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-22T18:51:02.724244] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-22T18:51:03.084017] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:03.317705] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-22T18:51:03.617611] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T18:51:03.943462] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:51:04.117789] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-22T18:51:04.499883] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:51:04.917756] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-22T18:51:05.397054] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:51:05.717745] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-22T18:51:06.026286] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T18:51:06.517715] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-22T18:51:07.317626] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-22T18:51:07.412956] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T18:51:07.906056] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:51:08.117693] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-22T18:51:08.917744] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-22T18:51:08.939586] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T18:51:09.282511] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T18:51:09.717746] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-22T18:51:09.999145] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T18:51:10.517706] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-22T18:51:11.317697] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-22T18:51:11.653866] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T18:51:11.735001] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T18:51:12.117723] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-22T18:51:12.501265] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T18:51:12.917730] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-22T18:51:13.613878] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T18:51:13.717637] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-22T18:51:13.780741] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T18:51:14.517685] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-22T18:51:15.317635] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-22T18:51:15.584980] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:51:15.935155] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T18:51:16.117722] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-22T18:51:16.362887] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T18:51:16.365550] [INFO ] [REMOTE ] FRA: Full fetch complete (23320 records). [2025-10-22T18:51:16.365622] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-22T18:51:16.724264] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-22T18:51:16.724341] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-22T18:51:16.724827] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-22T18:51:16.724890] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-22T18:51:16.725596] [DEBUG] [LOCAL ] FRA: Trimmed 23320 records to 14058 (keeping 200 days of data) [2025-10-22T18:51:16.808814] [DEBUG] [LOCAL ] FRA: Primary data saved (14058 records). [2025-10-22T18:51:16.808939] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-22T18:51:16.809020] [INFO ] [MAIN ] Update Progress: 870/2367 symbols completed. FRA took 36.5s. Estimated remaining: 3h 11m 21s. Rate: 7.8 symbols/min [2025-10-22T18:51:16.922768] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-22T18:51:16.984142] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:17.029853] [DEBUG] [LOCAL ] FSK: Loaded 49498 existing records from primary storage. [2025-10-22T18:51:17.030148] [INFO ] [MAIN ] FSK: Loaded 49498 existing records. [2025-10-22T18:51:17.246576] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:17.246888] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-22T18:51:17.246964] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-22T18:51:17.247206] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-22T18:51:17.247308] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-22T18:51:17.605698] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:17.717720] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-22T18:51:18.101395] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T18:51:18.247090] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T18:51:18.517695] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-22T18:51:19.182851] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:51:19.317753] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-22T18:51:20.075609] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T18:51:20.084420] [INFO ] [REMOTE ] FRO: Full fetch complete (75381 records). [2025-10-22T18:51:20.084591] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-22T18:51:20.127269] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-22T18:51:20.512187] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-22T18:51:20.512378] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-22T18:51:20.513504] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-22T18:51:20.513575] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-22T18:51:20.515230] [DEBUG] [LOCAL ] FRO: Trimmed 75381 records to 51679 (keeping 200 days of data) [2025-10-22T18:51:20.832828] [DEBUG] [LOCAL ] FRO: Primary data saved (51679 records). [2025-10-22T18:51:20.833012] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-22T18:51:20.833133] [INFO ] [MAIN ] Update Progress: 871/2367 symbols completed. FRO took 36.8s. Estimated remaining: 3h 11m 7s. Rate: 7.8 symbols/min [2025-10-22T18:51:20.932928] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-22T18:51:21.033277] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T18:51:21.032168] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:21.088250] [DEBUG] [LOCAL ] FSLY: Loaded 51318 existing records from primary storage. [2025-10-22T18:51:21.088602] [INFO ] [MAIN ] FSLY: Loaded 51318 existing records. [2025-10-22T18:51:21.260820] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:21.261048] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-22T18:51:21.261097] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-22T18:51:21.261303] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-22T18:51:21.261357] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-22T18:51:21.599409] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:21.717610] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-22T18:51:21.931268] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T18:51:22.021262] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T18:51:22.517745] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-22T18:51:23.317693] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-22T18:51:23.526833] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:51:23.902475] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T18:51:24.117677] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-22T18:51:24.795830] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T18:51:24.917766] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-22T18:51:25.377554] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T18:51:25.717761] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-22T18:51:26.517737] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-22T18:51:26.701594] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T18:51:27.317756] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-22T18:51:27.555533] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T18:51:28.117736] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-22T18:51:28.143587] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:51:28.917626] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-22T18:51:29.019565] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T18:51:29.724783] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-22T18:51:29.743011] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:51:30.520434] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-22T18:51:30.524393] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T18:51:31.317626] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-22T18:51:31.606030] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T18:51:32.117692] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-22T18:51:32.208073] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T18:51:32.215771] [INFO ] [REMOTE ] FSCO: Full fetch complete (55297 records). [2025-10-22T18:51:32.215915] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-22T18:51:32.606523] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-22T18:51:32.606621] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-22T18:51:32.607380] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-22T18:51:32.607430] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-22T18:51:32.608631] [DEBUG] [LOCAL ] FSCO: Trimmed 55297 records to 38527 (keeping 200 days of data) [2025-10-22T18:51:32.831543] [DEBUG] [LOCAL ] FSCO: Primary data saved (38527 records). [2025-10-22T18:51:32.831726] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-22T18:51:32.831819] [INFO ] [MAIN ] Update Progress: 872/2367 symbols completed. FSCO took 30.5s. Estimated remaining: 3h 11m 7s. Rate: 7.8 symbols/min [2025-10-22T18:51:32.928362] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-22T18:51:33.013429] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:33.041138] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:51:33.094920] [DEBUG] [LOCAL ] FSM: Loaded 53303 existing records from primary storage. [2025-10-22T18:51:33.095262] [INFO ] [MAIN ] FSM: Loaded 53303 existing records. [2025-10-22T18:51:33.274525] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:33.274778] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-22T18:51:33.274831] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-22T18:51:33.275052] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-22T18:51:33.275094] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-22T18:51:33.649204] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:33.717621] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-22T18:51:33.787803] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T18:51:34.148561] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:51:34.517706] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-22T18:51:35.317714] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-22T18:51:35.397250] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T18:51:36.091278] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T18:51:36.098134] [INFO ] [REMOTE ] FRT: Full fetch complete (60515 records). [2025-10-22T18:51:36.098420] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-22T18:51:36.123044] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-22T18:51:36.495408] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-22T18:51:36.495490] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-22T18:51:36.496288] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-22T18:51:36.496363] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-22T18:51:36.497565] [DEBUG] [LOCAL ] FRT: Trimmed 60515 records to 41468 (keeping 200 days of data) [2025-10-22T18:51:36.754587] [DEBUG] [LOCAL ] FRT: Primary data saved (41468 records). [2025-10-22T18:51:36.754746] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-22T18:51:36.755400] [INFO ] [MAIN ] Update Progress: 873/2367 symbols completed. FRT took 39.1s. Estimated remaining: 3h 10m 53s. Rate: 7.8 symbols/min [2025-10-22T18:51:36.919124] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-22T18:51:36.941402] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:36.971346] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T18:51:37.013073] [DEBUG] [LOCAL ] FSS: Loaded 33326 existing records from primary storage. [2025-10-22T18:51:37.013399] [INFO ] [MAIN ] FSS: Loaded 33326 existing records. [2025-10-22T18:51:37.198207] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:37.198470] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-22T18:51:37.198533] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-22T18:51:37.198821] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-22T18:51:37.198881] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-22T18:51:37.548807] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:37.717694] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-22T18:51:37.842284] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T18:51:38.517632] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-22T18:51:38.629983] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T18:51:38.982607] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T18:51:39.317681] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-22T18:51:40.117731] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-22T18:51:40.212070] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T18:51:40.917717] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-22T18:51:41.305287] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T18:51:41.717768] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-22T18:51:41.814339] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:51:42.475630] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T18:51:42.517635] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-22T18:51:43.317710] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-22T18:51:43.510349] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T18:51:44.117699] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-22T18:51:44.503259] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T18:51:44.511959] [INFO ] [REMOTE ] FSK: Full fetch complete (72130 records). [2025-10-22T18:51:44.512084] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-22T18:51:44.931857] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-22T18:51:44.956023] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-22T18:51:44.956434] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-22T18:51:44.958858] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-22T18:51:44.959163] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-22T18:51:44.984951] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:51:44.985137] [DEBUG] [LOCAL ] FSK: Trimmed 72130 records to 49476 (keeping 200 days of data) [2025-10-22T18:51:45.326157] [DEBUG] [LOCAL ] FSK: Primary data saved (49476 records). [2025-10-22T18:51:45.326434] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-22T18:51:45.326579] [INFO ] [MAIN ] Update Progress: 874/2367 symbols completed. FSK took 28.5s. Estimated remaining: 3h 10m 46s. Rate: 7.8 symbols/min [2025-10-22T18:51:45.499614] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:45.509273] [DEBUG] [LOCAL ] FT: Loaded 6765 existing records from primary storage. [2025-10-22T18:51:45.509494] [INFO ] [MAIN ] FT: Loaded 6765 existing records. [2025-10-22T18:51:45.686346] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:45.686690] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-22T18:51:45.686806] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-22T18:51:45.687042] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-22T18:51:45.687186] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-22T18:51:45.717888] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-22T18:51:45.970519] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:51:46.097162] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:46.517629] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-22T18:51:46.745151] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T18:51:47.161978] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T18:51:47.322757] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-22T18:51:47.337775] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T18:51:48.117690] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-22T18:51:48.749415] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T18:51:48.917756] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-22T18:51:49.170890] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T18:51:49.717709] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-22T18:51:50.337317] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T18:51:50.517729] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-22T18:51:51.293540] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T18:51:51.317619] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-22T18:51:51.816539] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T18:51:52.117718] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-22T18:51:52.724959] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:51:52.917634] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-22T18:51:53.023239] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T18:51:53.630948] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T18:51:53.717735] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-22T18:51:54.517714] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-22T18:51:55.317708] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-22T18:51:55.751387] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-22T18:51:55.760058] [INFO ] [REMOTE ] FSLY: Full fetch complete (74922 records). [2025-10-22T18:51:55.760189] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-22T18:51:56.117832] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-22T18:51:56.157304] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-22T18:51:56.157387] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-22T18:51:56.158549] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-22T18:51:56.158730] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-22T18:51:56.160319] [DEBUG] [LOCAL ] FSLY: Trimmed 74922 records to 51303 (keeping 200 days of data) [2025-10-22T18:51:56.261958] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T18:51:56.481842] [DEBUG] [LOCAL ] FSLY: Primary data saved (51303 records). [2025-10-22T18:51:56.482009] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-22T18:51:56.482121] [INFO ] [MAIN ] Update Progress: 875/2367 symbols completed. FSLY took 35.6s. Estimated remaining: 3h 10m 45s. Rate: 7.8 symbols/min [2025-10-22T18:51:56.648492] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:56.661797] [DEBUG] [LOCAL ] FTHY: Loaded 12518 existing records from primary storage. [2025-10-22T18:51:56.661994] [INFO ] [MAIN ] FTHY: Loaded 12518 existing records. [2025-10-22T18:51:56.844769] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:56.844930] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-22T18:51:56.844989] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-22T18:51:56.845143] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-22T18:51:56.845197] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-22T18:51:56.918752] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-22T18:51:57.009750] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T18:51:57.220575] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:57.253181] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T18:51:57.717768] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-22T18:51:58.282987] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T18:51:58.313166] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T18:51:58.517776] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-22T18:51:59.317705] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-22T18:52:00.117629] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-22T18:52:00.246889] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T18:52:00.289179] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T18:52:00.917718] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-22T18:52:01.281029] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T18:52:01.672932] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T18:52:01.717752] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-22T18:52:02.517744] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-22T18:52:02.604140] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T18:52:03.317693] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-22T18:52:03.351217] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T18:52:03.423278] [DEBUG] [REMOTE ] FSM: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-22T18:52:03.423736] [WARN ] [REMOTE ] FSM: No data returned for month 2025-09 [2025-10-22T18:52:03.423836] [FATAL] [REMOTE ] FSM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:52:03.423938] [FATAL] [MAIN ] FSM: Failed to fetch primary data. [2025-10-22T18:52:03.424007] [WARN ] [MAIN ] FSM: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:52:03.424060] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-22T18:52:03.424127] [DEBUG] [LOCAL ] FSM: No primary data file found to delete. [2025-10-22T18:52:03.424163] [INFO ] [LOCAL ] FSM: Starting deletion of derivative data. [2025-10-22T18:52:03.424549] [DEBUG] [LOCAL ] FSM: Deleted derivative data file. [2025-10-22T18:52:03.424950] [INFO ] [MAIN ] Update Progress: 876/2367 symbols completed. FSM took 30.6s. Estimated remaining: 3h 10m 36s. Rate: 7.8 symbols/min [2025-10-22T18:52:03.618123] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:03.665343] [DEBUG] [LOCAL ] FTI: Loaded 53293 existing records from primary storage. [2025-10-22T18:52:03.665711] [INFO ] [MAIN ] FTI: Loaded 53293 existing records. [2025-10-22T18:52:03.835897] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:03.836130] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-22T18:52:03.836211] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-22T18:52:03.836427] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-22T18:52:03.836482] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-22T18:52:04.122762] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-22T18:52:04.184546] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:04.917635] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-22T18:52:04.962022] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T18:52:05.427867] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T18:52:05.717728] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-22T18:52:06.517635] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-22T18:52:06.543608] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T18:52:06.545429] [INFO ] [REMOTE ] FT: Full fetch complete (9306 records). [2025-10-22T18:52:06.545519] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-22T18:52:06.894665] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-22T18:52:06.894767] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-22T18:52:06.895051] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-22T18:52:06.895098] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-22T18:52:06.895609] [DEBUG] [LOCAL ] FT: Trimmed 9306 records to 6800 (keeping 200 days of data) [2025-10-22T18:52:06.943918] [DEBUG] [LOCAL ] FT: Primary data saved (6800 records). [2025-10-22T18:52:06.944016] [INFO ] [MAIN ] FT: Full history saved. [2025-10-22T18:52:06.944090] [INFO ] [MAIN ] Update Progress: 877/2367 symbols completed. FT took 21.6s. Estimated remaining: 3h 10m 21s. Rate: 7.8 symbols/min [2025-10-22T18:52:07.317745] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-22T18:52:07.862348] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T18:52:07.867335] [INFO ] [REMOTE ] FSS: Full fetch complete (48525 records). [2025-10-22T18:52:07.867421] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-22T18:52:08.125046] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-22T18:52:08.235853] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-22T18:52:08.235936] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-22T18:52:08.236614] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-22T18:52:08.236685] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-22T18:52:08.237783] [DEBUG] [LOCAL ] FSS: Trimmed 48525 records to 33138 (keeping 200 days of data) [2025-10-22T18:52:08.439726] [DEBUG] [LOCAL ] FSS: Primary data saved (33138 records). [2025-10-22T18:52:08.439915] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-22T18:52:08.440489] [INFO ] [MAIN ] Update Progress: 878/2367 symbols completed. FSS took 31.7s. Estimated remaining: 3h 10m 3s. Rate: 7.8 symbols/min [2025-10-22T18:52:09.168683] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T18:52:09.181489] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-22T18:52:09.181952] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T18:52:09.717685] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-22T18:52:10.477138] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T18:52:10.517618] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-22T18:52:10.802596] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:52:11.271298] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T18:52:11.317730] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-22T18:52:11.873854] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T18:52:12.117703] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-22T18:52:12.917728] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-22T18:52:12.949465] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T18:52:13.717754] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-22T18:52:14.699601] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T18:52:14.720911] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-22T18:52:14.722525] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T18:52:15.317751] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-22T18:52:16.373325] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T18:52:16.376177] [INFO ] [REMOTE ] FTHY: Full fetch complete (17333 records). [2025-10-22T18:52:16.376250] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-22T18:52:16.708090] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T18:52:16.759606] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-22T18:52:16.784884] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-22T18:52:16.784948] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-22T18:52:16.785328] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-22T18:52:16.785365] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-22T18:52:16.785893] [DEBUG] [LOCAL ] FTHY: Trimmed 17333 records to 12294 (keeping 200 days of data) [2025-10-22T18:52:16.859239] [DEBUG] [LOCAL ] FTHY: Primary data saved (12294 records). [2025-10-22T18:52:16.859360] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-22T18:52:16.859435] [INFO ] [MAIN ] Update Progress: 879/2367 symbols completed. FTHY took 20.4s. Estimated remaining: 3h 9m 57s. Rate: 7.8 symbols/min [2025-10-22T18:52:18.673140] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T18:52:18.684843] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-22T18:52:20.413363] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T18:52:20.426212] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-22T18:52:22.091298] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:52:22.103877] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-22T18:52:23.898550] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T18:52:23.909948] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-22T18:52:25.503143] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T18:52:25.515408] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-22T18:52:27.727749] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-22T18:52:27.736527] [INFO ] [REMOTE ] FTI: Full fetch complete (77331 records). [2025-10-22T18:52:27.736718] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-22T18:52:28.120452] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-22T18:52:28.120555] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-22T18:52:28.121464] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-22T18:52:28.121525] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-22T18:52:28.123047] [DEBUG] [LOCAL ] FTI: Trimmed 77331 records to 53293 (keeping 200 days of data) [2025-10-22T18:52:28.431313] [DEBUG] [LOCAL ] FTI: Primary data saved (53293 records). [2025-10-22T18:52:28.431464] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-22T18:52:28.431545] [INFO ] [MAIN ] Update Progress: 880/2367 symbols completed. FTI took 25.0s. Estimated remaining: 3h 9m 55s. Rate: 7.8 symbols/min [2025-10-22T18:52:29.099364] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:29.047277] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:29.157457] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:29.190805] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:29.196474] [DEBUG] [LOCAL ] FTWO: Loaded 1964 existing records from primary storage. [2025-10-22T18:52:29.197014] [INFO ] [MAIN ] FTWO: Loaded 1964 existing records. [2025-10-22T18:52:29.380853] [DEBUG] [LOCAL ] FTK: Loaded 32948 existing records from primary storage. [2025-10-22T18:52:29.400720] [INFO ] [MAIN ] FTK: Loaded 32948 existing records. [2025-10-22T18:52:29.435670] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:29.548467] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-22T18:52:29.548181] [DEBUG] [LOCAL ] FTS: Loaded 42523 existing records from primary storage. [2025-10-22T18:52:29.559221] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-22T18:52:29.576181] [DEBUG] [LOCAL ] FTV: Loaded 53034 existing records from primary storage. [2025-10-22T18:52:29.576528] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-22T18:52:29.576396] [INFO ] [MAIN ] FTS: Loaded 42523 existing records. [2025-10-22T18:52:29.601683] [INFO ] [MAIN ] FTV: Loaded 53034 existing records. [2025-10-22T18:52:29.611679] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-22T18:52:29.991967] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:30.037928] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-22T18:52:30.038162] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-22T18:52:30.111923] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:30.166215] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-22T18:52:30.152484] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-22T18:52:30.198219] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-22T18:52:30.237922] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-22T18:52:30.247911] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:30.264344] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-22T18:52:30.264084] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-22T18:52:30.296120] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-22T18:52:30.380963] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-22T18:52:30.406957] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-22T18:52:30.457927] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-22T18:52:30.807108] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:30.894270] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-22T18:52:31.427704] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:31.526067] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:31.536776] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-22T18:52:31.521545] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-22T18:52:31.658679] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:31.661446] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-22T18:52:31.665508] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T18:52:31.671557] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-22T18:52:32.132740] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T18:52:32.134012] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-22T18:52:32.674603] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T18:52:32.675804] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-22T18:52:32.691154] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T18:52:32.696664] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-22T18:52:33.077129] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T18:52:33.085308] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-22T18:52:33.113037] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-22T18:52:33.114193] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-22T18:52:33.416614] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T18:52:33.426890] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-22T18:52:33.506117] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-22T18:52:33.507145] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-22T18:52:33.697763] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-22T18:52:33.702583] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-22T18:52:34.034437] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-22T18:52:34.035793] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-22T18:52:34.229401] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T18:52:34.237522] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-22T18:52:34.466494] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T18:52:34.467951] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-22T18:52:34.530811] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T18:52:34.537282] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-22T18:52:34.921487] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T18:52:34.922702] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-22T18:52:35.102388] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:52:35.317719] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-22T18:52:35.366682] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T18:52:35.644761] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T18:52:35.703411] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T18:52:36.117634] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-22T18:52:36.917625] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-22T18:52:37.076547] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T18:52:37.649006] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:52:37.717612] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-22T18:52:38.231621] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-22T18:52:38.232669] [INFO ] [REMOTE ] FTWO: Full fetch complete (3335 records). [2025-10-22T18:52:38.232740] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-22T18:52:38.428625] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T18:52:38.522711] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-22T18:52:38.629688] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-22T18:52:38.629773] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-22T18:52:38.629903] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-22T18:52:38.629943] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-22T18:52:38.630281] [DEBUG] [LOCAL ] FTWO: Trimmed 3335 records to 1949 (keeping 200 days of data) [2025-10-22T18:52:38.642345] [DEBUG] [LOCAL ] FTWO: Primary data saved (1949 records). [2025-10-22T18:52:38.642422] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-22T18:52:38.642493] [INFO ] [MAIN ] Update Progress: 881/2367 symbols completed. FTWO took 10.2s. Estimated remaining: 3h 9m 52s. Rate: 7.8 symbols/min [2025-10-22T18:52:38.809260] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:38.857729] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-22T18:52:38.858083] [INFO ] [MAIN ] FUBO: Loaded 53718 existing records. [2025-10-22T18:52:39.036891] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:39.037108] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-22T18:52:39.037162] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-22T18:52:39.037374] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-22T18:52:39.037432] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-22T18:52:39.322729] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-22T18:52:39.389688] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:40.117614] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-22T18:52:40.153440] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T18:52:40.728562] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T18:52:40.917692] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-22T18:52:41.717626] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-22T18:52:41.895854] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T18:52:42.517737] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-22T18:52:42.766384] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T18:52:42.848067] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T18:52:43.317716] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-22T18:52:44.117617] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-22T18:52:44.620382] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T18:52:44.917730] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-22T18:52:44.987236] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:52:45.513911] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T18:52:45.717629] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-22T18:52:46.285880] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T18:52:46.517728] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-22T18:52:47.317687] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-22T18:52:47.482420] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T18:52:48.117711] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-22T18:52:48.917731] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-22T18:52:49.100058] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T18:52:49.308778] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-10-22T18:52:49.717731] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-22T18:52:50.414158] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T18:52:50.496983] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-22T18:52:50.517628] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-22T18:52:51.317699] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-22T18:52:51.853198] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-22T18:52:52.117755] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-22T18:52:52.333393] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T18:52:52.611946] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T18:52:52.617817] [INFO ] [REMOTE ] FTK: Full fetch complete (43995 records). [2025-10-22T18:52:52.618003] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-22T18:52:52.922777] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-22T18:52:52.996628] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-22T18:52:52.996758] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-22T18:52:52.997464] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-22T18:52:52.997508] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-22T18:52:52.998630] [DEBUG] [LOCAL ] FTK: Trimmed 43995 records to 32937 (keeping 200 days of data) [2025-10-22T18:52:53.187858] [DEBUG] [LOCAL ] FTK: Primary data saved (32937 records). [2025-10-22T18:52:53.188004] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-22T18:52:53.188087] [INFO ] [MAIN ] Update Progress: 882/2367 symbols completed. FTK took 24.8s. Estimated remaining: 3h 9m 56s. Rate: 7.8 symbols/min [2025-10-22T18:52:53.357900] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:53.389927] [DEBUG] [LOCAL ] FUL: Loaded 31998 existing records from primary storage. [2025-10-22T18:52:53.390231] [INFO ] [MAIN ] FUL: Loaded 31998 existing records. [2025-10-22T18:52:53.600411] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:53.600933] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-22T18:52:53.601059] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-22T18:52:53.601384] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-22T18:52:53.601463] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-22T18:52:53.647085] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T18:52:53.718343] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-22T18:52:54.131221] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:54.517764] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-22T18:52:55.268636] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-22T18:52:55.317599] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-22T18:52:55.513016] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:52:55.989860] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:52:56.117730] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-22T18:52:56.917742] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-22T18:52:57.547246] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-22T18:52:57.717639] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-22T18:52:57.867500] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:52:57.876075] [INFO ] [REMOTE ] FTV: Full fetch complete (76620 records). [2025-10-22T18:52:57.876196] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-22T18:52:58.280303] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-22T18:52:58.280417] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-22T18:52:58.281415] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-22T18:52:58.281562] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-22T18:52:58.299579] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:52:58.305929] [DEBUG] [LOCAL ] FTV: Trimmed 76620 records to 53022 (keeping 200 days of data) [2025-10-22T18:52:58.517719] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-22T18:52:58.622114] [DEBUG] [LOCAL ] FTV: Primary data saved (53022 records). [2025-10-22T18:52:58.622254] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-22T18:52:58.622334] [INFO ] [MAIN ] Update Progress: 883/2367 symbols completed. FTV took 30.2s. Estimated remaining: 3h 9m 45s. Rate: 7.8 symbols/min [2025-10-22T18:52:58.789157] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:58.841255] [DEBUG] [LOCAL ] FUN: Loaded 52023 existing records from primary storage. [2025-10-22T18:52:58.842485] [INFO ] [MAIN ] FUN: Loaded 52023 existing records. [2025-10-22T18:52:59.034563] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:59.034789] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-22T18:52:59.034838] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-22T18:52:59.035032] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-22T18:52:59.035085] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-22T18:52:59.317897] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-22T18:52:59.391677] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:59.410708] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T18:52:59.417958] [INFO ] [REMOTE ] FTS: Full fetch complete (60815 records). [2025-10-22T18:52:59.418077] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-22T18:52:59.822605] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-22T18:52:59.822709] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-22T18:52:59.823475] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-22T18:52:59.823515] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-22T18:52:59.824698] [DEBUG] [LOCAL ] FTS: Trimmed 60815 records to 42482 (keeping 200 days of data) [2025-10-22T18:53:00.087746] [DEBUG] [LOCAL ] FTS: Primary data saved (42482 records). [2025-10-22T18:53:00.087876] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-22T18:53:00.088311] [INFO ] [MAIN ] Update Progress: 884/2367 symbols completed. FTS took 31.7s. Estimated remaining: 3h 9m 27s. Rate: 7.8 symbols/min [2025-10-22T18:53:00.122881] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-22T18:53:00.279816] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:00.303513] [DEBUG] [LOCAL ] FVR: Loaded 20869 existing records from primary storage. [2025-10-22T18:53:00.303876] [INFO ] [MAIN ] FVR: Loaded 20869 existing records. [2025-10-22T18:53:00.497605] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:00.497926] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-22T18:53:00.497976] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-22T18:53:00.498163] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-22T18:53:00.498210] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-22T18:53:00.906567] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:00.909452] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-22T18:53:00.921610] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-22T18:53:00.946350] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:53:01.689682] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T18:53:01.717702] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-22T18:53:02.099678] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:53:02.517716] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-22T18:53:03.317713] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-22T18:53:03.342836] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:53:04.117735] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-22T18:53:04.847064] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:53:04.861565] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-22T18:53:04.917633] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-22T18:53:05.125211] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T18:53:05.717750] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-22T18:53:06.520183] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-22T18:53:06.523591] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T18:53:07.317757] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-22T18:53:07.797699] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-22T18:53:07.832972] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T18:53:08.117724] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-22T18:53:08.725729] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T18:53:08.917718] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-22T18:53:09.319391] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T18:53:09.717733] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-22T18:53:10.517637] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-22T18:53:10.596598] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T18:53:10.840273] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T18:53:11.317762] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-22T18:53:12.117781] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-22T18:53:12.777459] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-22T18:53:12.917750] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-22T18:53:13.085362] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T18:53:13.704488] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T18:53:13.717625] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-22T18:53:13.936740] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T18:53:14.517729] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-22T18:53:14.948769] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T18:53:15.317695] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-22T18:53:15.451100] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-22T18:53:16.117747] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-22T18:53:16.861834] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T18:53:16.917706] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-22T18:53:17.196861] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T18:53:17.717755] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-22T18:53:18.452183] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T18:53:18.517616] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-22T18:53:19.317750] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-22T18:53:20.117717] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-22T18:53:20.172741] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-22T18:53:20.181915] [INFO ] [REMOTE ] FUBO: Full fetch complete (77870 records). [2025-10-22T18:53:20.182069] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-22T18:53:20.496051] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T18:53:20.624784] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-22T18:53:20.624883] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-22T18:53:20.625841] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-22T18:53:20.625905] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-22T18:53:20.627563] [DEBUG] [LOCAL ] FUBO: Trimmed 77870 records to 53718 (keeping 200 days of data) [2025-10-22T18:53:20.872869] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T18:53:20.914437] [INFO ] [REMOTE ] FUL: Full fetch complete (47781 records). [2025-10-22T18:53:20.914893] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-22T18:53:20.933143] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-22T18:53:21.048542] [DEBUG] [LOCAL ] FUBO: Primary data saved (53718 records). [2025-10-22T18:53:21.080883] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-22T18:53:21.081015] [INFO ] [MAIN ] Update Progress: 885/2367 symbols completed. FUBO took 42.4s. Estimated remaining: 3h 9m 41s. Rate: 7.8 symbols/min [2025-10-22T18:53:21.429123] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:21.555503] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T18:53:21.631086] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-22T18:53:21.631173] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-22T18:53:21.631865] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-22T18:53:21.631929] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-22T18:53:21.633120] [DEBUG] [LOCAL ] FUL: Trimmed 47781 records to 31986 (keeping 200 days of data) [2025-10-22T18:53:21.736743] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-22T18:53:21.761841] [DEBUG] [LOCAL ] FVRR: Loaded 40625 existing records from primary storage. [2025-10-22T18:53:21.776581] [INFO ] [MAIN ] FVRR: Loaded 40625 existing records. [2025-10-22T18:53:22.002112] [DEBUG] [LOCAL ] FUL: Primary data saved (31986 records). [2025-10-22T18:53:22.010874] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-22T18:53:22.011317] [INFO ] [MAIN ] Update Progress: 886/2367 symbols completed. FUL took 28.8s. Estimated remaining: 3h 9m 22s. Rate: 7.8 symbols/min [2025-10-22T18:53:22.099739] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:22.126562] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-22T18:53:22.134472] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-22T18:53:22.137060] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-22T18:53:22.152734] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-22T18:53:22.313371] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:22.381399] [DEBUG] [LOCAL ] FXED: Loaded 1238 existing records from primary storage. [2025-10-22T18:53:22.398192] [INFO ] [MAIN ] FXED: Loaded 1238 existing records. [2025-10-22T18:53:22.722913] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:22.776876] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-22T18:53:22.777221] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-22T18:53:22.776765] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:22.777729] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-22T18:53:22.777878] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-22T18:53:22.778816] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-22T18:53:22.907059] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T18:53:23.162725] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:23.177780] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T18:53:23.186332] [INFO ] [REMOTE ] FUN: Full fetch complete (73532 records). [2025-10-22T18:53:23.186446] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-22T18:53:23.322727] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-22T18:53:23.573285] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-22T18:53:23.573367] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-22T18:53:23.574245] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-22T18:53:23.574308] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-22T18:53:23.575716] [DEBUG] [LOCAL ] FUN: Trimmed 73532 records to 52023 (keeping 200 days of data) [2025-10-22T18:53:23.856945] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-22T18:53:23.878797] [DEBUG] [LOCAL ] FUN: Primary data saved (52023 records). [2025-10-22T18:53:23.878941] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-22T18:53:23.879024] [INFO ] [MAIN ] Update Progress: 887/2367 symbols completed. FUN took 25.3s. Estimated remaining: 3h 9m 5s. Rate: 7.8 symbols/min [2025-10-22T18:53:24.051427] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:24.094817] [DEBUG] [LOCAL ] G: Loaded 50109 existing records from primary storage. [2025-10-22T18:53:24.095276] [INFO ] [MAIN ] G: Loaded 50109 existing records. [2025-10-22T18:53:24.124292] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-22T18:53:24.283430] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:24.283984] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-22T18:53:24.284224] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-22T18:53:24.295555] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-22T18:53:24.315220] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-22T18:53:24.381420] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:53:24.701745] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:24.917613] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-22T18:53:25.268391] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T18:53:25.717732] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-22T18:53:26.148806] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T18:53:26.442191] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T18:53:26.517747] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-22T18:53:26.870622] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-22T18:53:27.317691] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-22T18:53:28.117722] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-22T18:53:28.864943] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:53:28.917616] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-22T18:53:29.102361] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T18:53:29.717750] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-22T18:53:30.517632] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-22T18:53:30.578882] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T18:53:30.741592] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T18:53:30.744894] [INFO ] [REMOTE ] FVR: Full fetch complete (29331 records). [2025-10-22T18:53:30.744982] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-22T18:53:31.146001] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-22T18:53:31.146079] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-22T18:53:31.146731] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-22T18:53:31.146793] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-22T18:53:31.147604] [DEBUG] [LOCAL ] FVR: Trimmed 29331 records to 20820 (keeping 200 days of data) [2025-10-22T18:53:31.274858] [DEBUG] [LOCAL ] FVR: Primary data saved (20820 records). [2025-10-22T18:53:31.274980] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-22T18:53:31.275056] [INFO ] [MAIN ] Update Progress: 888/2367 symbols completed. FVR took 31.2s. Estimated remaining: 3h 8m 57s. Rate: 7.8 symbols/min [2025-10-22T18:53:31.322748] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-22T18:53:31.444748] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:31.470582] [DEBUG] [LOCAL ] GAB: Loaded 27631 existing records from primary storage. [2025-10-22T18:53:31.470891] [INFO ] [MAIN ] GAB: Loaded 27631 existing records. [2025-10-22T18:53:31.649509] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:31.649743] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-22T18:53:31.649796] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-22T18:53:31.650002] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-22T18:53:31.650057] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-22T18:53:31.765754] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-22T18:53:32.035711] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:32.117908] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-22T18:53:32.118847] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T18:53:32.917719] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-22T18:53:33.717627] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-22T18:53:33.871511] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T18:53:34.237698] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T18:53:34.517714] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-22T18:53:35.219356] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T18:53:35.317722] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-22T18:53:36.117744] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-22T18:53:36.248995] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:53:36.754293] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T18:53:36.898106] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:53:36.917611] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-22T18:53:37.717717] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-22T18:53:38.067774] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T18:53:38.400236] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T18:53:38.517705] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-22T18:53:39.317707] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-22T18:53:39.764368] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-22T18:53:39.904425] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T18:53:40.117698] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-22T18:53:40.539396] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-22T18:53:40.917692] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-22T18:53:41.339040] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-22T18:53:41.717713] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-22T18:53:42.517703] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-22T18:53:42.994595] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-22T18:53:42.995368] [INFO ] [REMOTE ] FXED: Full fetch complete (1791 records). [2025-10-22T18:53:42.995454] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-22T18:53:43.323315] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-22T18:53:43.353471] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-22T18:53:43.353627] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-22T18:53:43.353769] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-22T18:53:43.353843] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-22T18:53:43.354492] [DEBUG] [LOCAL ] FXED: Trimmed 1791 records to 1227 (keeping 200 days of data) [2025-10-22T18:53:43.363545] [DEBUG] [LOCAL ] FXED: Primary data saved (1227 records). [2025-10-22T18:53:43.363735] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-22T18:53:43.363836] [INFO ] [MAIN ] Update Progress: 889/2367 symbols completed. FXED took 21.4s. Estimated remaining: 3h 8m 56s. Rate: 7.8 symbols/min [2025-10-22T18:53:43.487838] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T18:53:43.581043] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:43.588028] [DEBUG] [LOCAL ] GAM: Loaded 3873 existing records from primary storage. [2025-10-22T18:53:43.588238] [INFO ] [MAIN ] GAM: Loaded 3873 existing records. [2025-10-22T18:53:43.771424] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:43.771678] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-22T18:53:43.771758] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-22T18:53:43.771944] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-22T18:53:43.772002] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-22T18:53:44.121313] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-22T18:53:44.125664] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:44.917751] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-22T18:53:45.098925] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T18:53:45.298520] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T18:53:45.717711] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-22T18:53:45.993308] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T18:53:46.517721] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-22T18:53:47.249370] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T18:53:47.317638] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-22T18:53:48.122775] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-22T18:53:48.137081] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T18:53:48.684678] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T18:53:48.761508] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T18:53:48.917741] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-22T18:53:49.628516] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T18:53:49.717701] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-22T18:53:50.517749] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-22T18:53:51.110341] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:53:51.317742] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-22T18:53:51.922162] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T18:53:52.117609] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-22T18:53:52.917696] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-22T18:53:53.073928] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T18:53:53.537987] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T18:53:53.717702] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-22T18:53:53.784735] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T18:53:53.791514] [INFO ] [REMOTE ] FVRR: Full fetch complete (59204 records). [2025-10-22T18:53:53.791634] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-22T18:53:54.172623] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-22T18:53:54.172744] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-22T18:53:54.173536] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-22T18:53:54.173598] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-22T18:53:54.174701] [DEBUG] [LOCAL ] FVRR: Trimmed 59204 records to 40496 (keeping 200 days of data) [2025-10-22T18:53:54.401710] [DEBUG] [LOCAL ] FVRR: Primary data saved (40496 records). [2025-10-22T18:53:54.401839] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-22T18:53:54.401914] [INFO ] [MAIN ] Update Progress: 890/2367 symbols completed. FVRR took 33.3s. Estimated remaining: 3h 8m 54s. Rate: 7.8 symbols/min [2025-10-22T18:53:54.522770] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-22T18:53:54.577461] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:54.627630] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-22T18:53:54.628004] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-22T18:53:54.819429] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:54.819580] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-22T18:53:54.819629] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-22T18:53:54.820626] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-22T18:53:54.820710] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-22T18:53:55.210871] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:55.265792] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T18:53:55.317615] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-22T18:53:55.771858] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T18:53:56.117759] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-22T18:53:56.917712] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-22T18:53:57.164250] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T18:53:57.172857] [INFO ] [REMOTE ] G: Full fetch complete (72298 records). [2025-10-22T18:53:57.173015] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-22T18:53:57.560069] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-22T18:53:57.562631] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-22T18:53:57.563563] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-22T18:53:57.564729] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-22T18:53:57.565618] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T18:53:57.567976] [DEBUG] [LOCAL ] G: Trimmed 72298 records to 50090 (keeping 200 days of data) [2025-10-22T18:53:57.738614] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-22T18:53:57.827409] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T18:53:57.914794] [DEBUG] [LOCAL ] G: Primary data saved (50090 records). [2025-10-22T18:53:57.914924] [INFO ] [MAIN ] G: Full history saved. [2025-10-22T18:53:57.915003] [INFO ] [MAIN ] Update Progress: 891/2367 symbols completed. G took 34.0s. Estimated remaining: 3h 8m 40s. Rate: 7.8 symbols/min [2025-10-22T18:53:58.081244] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:58.098948] [DEBUG] [LOCAL ] GATX: Loaded 18144 existing records from primary storage. [2025-10-22T18:53:58.099181] [INFO ] [MAIN ] GATX: Loaded 18144 existing records. [2025-10-22T18:53:58.290955] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:58.291189] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-22T18:53:58.291235] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-22T18:53:58.291493] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-22T18:53:58.291530] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-22T18:53:58.525798] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-22T18:53:58.644135] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:58.926883] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T18:53:59.317698] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-22T18:53:59.904820] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:53:59.925388] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T18:54:00.120574] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-22T18:54:00.917630] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-22T18:54:01.438466] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T18:54:01.717695] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-22T18:54:02.287190] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T18:54:02.517734] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-22T18:54:02.855939] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T18:54:03.317633] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-22T18:54:03.648160] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T18:54:03.992937] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T18:54:04.117689] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-22T18:54:04.694104] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T18:54:04.917688] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-22T18:54:05.717639] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-22T18:54:05.775590] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T18:54:06.517716] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-22T18:54:07.317681] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-22T18:54:07.477350] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T18:54:07.535119] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T18:54:07.953593] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T18:54:08.117758] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-22T18:54:08.917728] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-22T18:54:09.432928] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T18:54:09.437710] [INFO ] [REMOTE ] GAB: Full fetch complete (39416 records). [2025-10-22T18:54:09.437823] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-22T18:54:09.724620] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-22T18:54:09.817131] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-22T18:54:09.817210] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-22T18:54:09.817930] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-22T18:54:09.817992] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-22T18:54:09.818871] [DEBUG] [LOCAL ] GAB: Trimmed 39416 records to 27447 (keeping 200 days of data) [2025-10-22T18:54:09.978345] [DEBUG] [LOCAL ] GAB: Primary data saved (27447 records). [2025-10-22T18:54:09.978476] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-22T18:54:09.978557] [INFO ] [MAIN ] Update Progress: 892/2367 symbols completed. GAB took 38.7s. Estimated remaining: 3h 8m 39s. Rate: 7.8 symbols/min [2025-10-22T18:54:10.145963] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:10.160083] [DEBUG] [LOCAL ] GBAB: Loaded 12766 existing records from primary storage. [2025-10-22T18:54:10.160307] [INFO ] [MAIN ] GBAB: Loaded 12766 existing records. [2025-10-22T18:54:10.334161] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:10.334358] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-22T18:54:10.334405] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-22T18:54:10.334546] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-22T18:54:10.334583] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-22T18:54:10.439007] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T18:54:10.448701] [INFO ] [REMOTE ] GAM: Full fetch complete (6464 records). [2025-10-22T18:54:10.448831] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-22T18:54:10.529608] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-22T18:54:10.964432] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:11.117349] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-22T18:54:11.117488] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-22T18:54:11.117811] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-22T18:54:11.117905] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-22T18:54:11.118494] [DEBUG] [LOCAL ] GAM: Trimmed 6464 records to 3825 (keeping 200 days of data) [2025-10-22T18:54:11.168565] [DEBUG] [LOCAL ] GAM: Primary data saved (3825 records). [2025-10-22T18:54:11.169312] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-22T18:54:11.170469] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-22T18:54:11.170725] [INFO ] [MAIN ] Update Progress: 893/2367 symbols completed. GAM took 27.8s. Estimated remaining: 3h 8m 21s. Rate: 7.8 symbols/min [2025-10-22T18:54:11.325476] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-22T18:54:11.359167] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:11.395553] [DEBUG] [LOCAL ] GBCI: Loaded 41232 existing records from primary storage. [2025-10-22T18:54:11.395883] [INFO ] [MAIN ] GBCI: Loaded 41232 existing records. [2025-10-22T18:54:11.575808] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:11.576095] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-22T18:54:11.576148] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-22T18:54:11.576400] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-22T18:54:11.576437] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-22T18:54:11.902119] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T18:54:11.970936] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:12.051439] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T18:54:12.117614] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-22T18:54:12.878579] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T18:54:12.917622] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-22T18:54:13.717721] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-22T18:54:14.366667] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:54:14.517730] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-22T18:54:15.317711] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-22T18:54:15.805099] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-22T18:54:16.117721] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-22T18:54:16.450678] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T18:54:16.494043] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-22T18:54:16.917702] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-22T18:54:17.717621] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-22T18:54:17.875786] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T18:54:18.064180] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T18:54:18.464420] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T18:54:18.517738] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-22T18:54:19.317693] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-22T18:54:19.516989] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T18:54:20.117761] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-22T18:54:20.777496] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T18:54:20.917718] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-22T18:54:21.189714] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T18:54:21.717752] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-22T18:54:21.806103] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T18:54:22.517752] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-22T18:54:23.196427] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T18:54:23.221450] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T18:54:23.317625] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-22T18:54:24.117746] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-22T18:54:24.814493] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T18:54:24.917620] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-22T18:54:25.211673] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T18:54:25.717770] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-22T18:54:26.300319] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T18:54:26.374183] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T18:54:26.517636] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-22T18:54:27.317635] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-22T18:54:27.617752] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T18:54:28.117745] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-22T18:54:28.472982] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T18:54:28.917735] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-22T18:54:29.708206] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T18:54:29.717765] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-22T18:54:30.517634] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-22T18:54:30.758567] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T18:54:30.761631] [INFO ] [REMOTE ] GATX: Full fetch complete (25071 records). [2025-10-22T18:54:30.761729] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-22T18:54:31.098025] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T18:54:31.183867] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-22T18:54:31.183957] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-22T18:54:31.184526] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-22T18:54:31.184567] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-22T18:54:31.185303] [DEBUG] [LOCAL ] GATX: Trimmed 25071 records to 18061 (keeping 200 days of data) [2025-10-22T18:54:31.298071] [DEBUG] [LOCAL ] GATX: Primary data saved (18061 records). [2025-10-22T18:54:31.298253] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-22T18:54:31.298369] [INFO ] [MAIN ] Update Progress: 894/2367 symbols completed. GATX took 33.4s. Estimated remaining: 3h 8m 34s. Rate: 7.8 symbols/min [2025-10-22T18:54:31.328221] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-22T18:54:31.431767] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T18:54:31.493585] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:31.493801] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-22T18:54:31.493853] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-22T18:54:31.493983] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-22T18:54:31.494031] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-22T18:54:31.494080] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-22T18:54:31.494121] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-22T18:54:31.857433] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:32.117696] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-22T18:54:32.886070] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T18:54:32.919188] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-22T18:54:32.922563] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T18:54:33.717735] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-22T18:54:34.456425] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T18:54:34.517611] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-22T18:54:35.317628] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-22T18:54:35.574836] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T18:54:36.117731] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-22T18:54:36.185018] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T18:54:36.188296] [INFO ] [REMOTE ] GBAB: Full fetch complete (18795 records). [2025-10-22T18:54:36.188437] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-22T18:54:36.357968] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:54:36.430592] [INFO ] [REMOTE ] GBCI: Full fetch complete (59526 records). [2025-10-22T18:54:36.479835] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-22T18:54:36.822571] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-22T18:54:36.839024] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-22T18:54:36.891348] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-22T18:54:36.925302] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-22T18:54:36.947983] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-22T18:54:36.967467] [DEBUG] [LOCAL ] GBAB: Trimmed 18795 records to 12735 (keeping 200 days of data) [2025-10-22T18:54:37.120325] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-22T18:54:37.124429] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-22T18:54:37.132406] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-22T18:54:37.132489] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-22T18:54:37.147895] [DEBUG] [LOCAL ] GBAB: Primary data saved (12735 records). [2025-10-22T18:54:37.148146] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-22T18:54:37.148328] [INFO ] [MAIN ] Update Progress: 895/2367 symbols completed. GBAB took 27.2s. Estimated remaining: 3h 8m 23s. Rate: 7.8 symbols/min [2025-10-22T18:54:37.191378] [DEBUG] [LOCAL ] GBCI: Trimmed 59526 records to 41187 (keeping 200 days of data) [2025-10-22T18:54:37.355024] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-22T18:54:37.421033] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:37.597966] [DEBUG] [LOCAL ] GBCI: Primary data saved (41187 records). [2025-10-22T18:54:37.598178] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-22T18:54:37.598301] [INFO ] [MAIN ] Update Progress: 896/2367 symbols completed. GBCI took 26.4s. Estimated remaining: 3h 8m 4s. Rate: 7.8 symbols/min [2025-10-22T18:54:37.610343] [DEBUG] [LOCAL ] GBTG: Loaded 40249 existing records from primary storage. [2025-10-22T18:54:37.632942] [INFO ] [MAIN ] GBTG: Loaded 40249 existing records. [2025-10-22T18:54:37.728410] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-22T18:54:37.922460] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:38.009488] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:38.010398] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-22T18:54:38.010468] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-22T18:54:38.010825] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-22T18:54:38.010887] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-22T18:54:38.052175] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:54:38.145305] [INFO ] [REMOTE ] GAP: Full fetch complete (77812 records). [2025-10-22T18:54:38.189717] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T18:54:38.188216] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-22T18:54:38.203692] [DEBUG] [LOCAL ] GBX: Loaded 28402 existing records from primary storage. [2025-10-22T18:54:38.209584] [INFO ] [MAIN ] GBX: Loaded 28402 existing records. [2025-10-22T18:54:38.528025] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-22T18:54:39.055259] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-22T18:54:39.107083] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:39.194234] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-22T18:54:39.232266] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:39.227925] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-22T18:54:39.268962] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-22T18:54:39.269324] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-22T18:54:39.322292] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-22T18:54:39.484251] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-22T18:54:39.484390] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-22T18:54:39.485359] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-22T18:54:39.485442] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-22T18:54:39.561768] [DEBUG] [LOCAL ] GAP: Trimmed 77812 records to 53653 (keeping 200 days of data) [2025-10-22T18:54:39.774092] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T18:54:39.854760] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:40.079554] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-22T18:54:40.079693] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-22T18:54:40.079787] [INFO ] [MAIN ] Update Progress: 897/2367 symbols completed. GAP took 45.7s. Estimated remaining: 3h 7m 47s. Rate: 7.8 symbols/min [2025-10-22T18:54:40.122754] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-22T18:54:40.269492] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:40.306916] [DEBUG] [LOCAL ] GCI: Loaded 43632 existing records from primary storage. [2025-10-22T18:54:40.307196] [INFO ] [MAIN ] GCI: Loaded 43632 existing records. [2025-10-22T18:54:40.480870] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:40.481033] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-22T18:54:40.481080] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-22T18:54:40.481249] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-22T18:54:40.481287] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-22T18:54:40.552717] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T18:54:40.835299] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:40.917618] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-22T18:54:41.717708] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-22T18:54:41.976254] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-22T18:54:42.470285] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T18:54:42.517730] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-22T18:54:43.317746] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-22T18:54:43.915818] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T18:54:44.117732] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-22T18:54:44.632885] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-22T18:54:44.856311] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T18:54:44.917625] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-22T18:54:45.717730] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-22T18:54:46.239150] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T18:54:46.517691] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-22T18:54:47.176369] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T18:54:47.317744] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-22T18:54:47.448578] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T18:54:48.117742] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-22T18:54:48.838763] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T18:54:48.917739] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-22T18:54:49.375470] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T18:54:49.421070] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T18:54:49.717720] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-22T18:54:50.517754] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-22T18:54:51.246151] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:54:51.317687] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-22T18:54:51.679342] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-22T18:54:52.071776] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:54:52.117605] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-22T18:54:52.917713] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-22T18:54:53.605639] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:54:53.717707] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-22T18:54:54.186994] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T18:54:54.517707] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-22T18:54:55.157003] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T18:54:55.317631] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-22T18:54:55.703026] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T18:54:56.117699] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-22T18:54:56.922761] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-22T18:54:56.937085] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:54:57.382709] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-22T18:54:57.383392] [INFO ] [REMOTE ] GBLI: Full fetch complete (1280 records). [2025-10-22T18:54:57.383458] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-22T18:54:57.561096] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-22T18:54:57.561333] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:54:57.561432] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:54:57.561668] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-22T18:54:57.561806] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-22T18:54:57.561859] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-22T18:54:57.561916] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-22T18:54:57.561976] [INFO ] [MAIN ] Update Progress: 898/2367 symbols completed. GBLI took 26.3s. Estimated remaining: 3h 7m 56s. Rate: 7.8 symbols/min [2025-10-22T18:54:57.728381] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-22T18:54:57.731025] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:57.757093] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T18:54:57.783849] [DEBUG] [LOCAL ] GCO: Loaded 23035 existing records from primary storage. [2025-10-22T18:54:57.784090] [INFO ] [MAIN ] GCO: Loaded 23035 existing records. [2025-10-22T18:54:57.961308] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:57.961578] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-22T18:54:57.961679] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-22T18:54:57.961920] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-22T18:54:57.961979] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-22T18:54:58.308699] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:58.517714] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-22T18:54:59.317722] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-22T18:54:59.355455] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T18:54:59.892838] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T18:55:00.117697] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-22T18:55:00.917634] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-22T18:55:00.985910] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:55:01.706033] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T18:55:01.717752] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-22T18:55:01.856545] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T18:55:02.517738] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-22T18:55:02.953315] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T18:55:03.317713] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-22T18:55:03.667876] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T18:55:04.117717] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-22T18:55:04.712753] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T18:55:04.917690] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-22T18:55:05.261115] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T18:55:05.717704] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-22T18:55:06.364278] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:55:06.517712] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-22T18:55:07.313896] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:55:07.325985] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-22T18:55:08.004335] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T18:55:08.117741] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-22T18:55:08.435031] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T18:55:08.917729] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-22T18:55:09.290488] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T18:55:09.717746] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-22T18:55:10.517637] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-22T18:55:11.036027] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T18:55:11.043031] [INFO ] [REMOTE ] GCI: Full fetch complete (63291 records). [2025-10-22T18:55:11.043186] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-22T18:55:11.319771] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-22T18:55:11.405451] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T18:55:11.470080] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-22T18:55:11.470600] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-22T18:55:11.471548] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-22T18:55:11.471750] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-22T18:55:11.488015] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T18:55:11.487464] [DEBUG] [LOCAL ] GCI: Trimmed 63291 records to 43579 (keeping 200 days of data) [2025-10-22T18:55:11.731972] [DEBUG] [LOCAL ] GCI: Primary data saved (43579 records). [2025-10-22T18:55:11.732106] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-22T18:55:11.732212] [INFO ] [MAIN ] Update Progress: 899/2367 symbols completed. GCI took 31.7s. Estimated remaining: 3h 7m 59s. Rate: 7.8 symbols/min [2025-10-22T18:55:11.898489] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:11.918194] [DEBUG] [LOCAL ] GCTS: Loaded 20218 existing records from primary storage. [2025-10-22T18:55:11.918453] [INFO ] [MAIN ] GCTS: Loaded 20218 existing records. [2025-10-22T18:55:12.091021] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:12.091232] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-22T18:55:12.091285] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-22T18:55:12.091461] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-22T18:55:12.091517] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-22T18:55:12.122450] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-22T18:55:12.447829] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:12.461941] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T18:55:12.917629] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-22T18:55:13.630585] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T18:55:13.637104] [INFO ] [REMOTE ] GBTG: Full fetch complete (56931 records). [2025-10-22T18:55:13.637196] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-22T18:55:13.726022] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-22T18:55:14.038472] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T18:55:14.057112] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-22T18:55:14.057520] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-22T18:55:14.058368] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-22T18:55:14.058430] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-22T18:55:14.059523] [DEBUG] [LOCAL ] GBTG: Trimmed 56931 records to 40227 (keeping 200 days of data) [2025-10-22T18:55:14.276617] [DEBUG] [LOCAL ] GBTG: Primary data saved (40227 records). [2025-10-22T18:55:14.276763] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-22T18:55:14.277319] [INFO ] [MAIN ] Update Progress: 900/2367 symbols completed. GBTG took 37.1s. Estimated remaining: 3h 7m 43s. Rate: 7.8 symbols/min [2025-10-22T18:55:14.441258] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:14.451011] [DEBUG] [LOCAL ] GCV: Loaded 7809 existing records from primary storage. [2025-10-22T18:55:14.451228] [INFO ] [MAIN ] GCV: Loaded 7809 existing records. [2025-10-22T18:55:14.523255] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-22T18:55:14.625431] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:14.625623] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-22T18:55:14.625701] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-22T18:55:14.625859] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-22T18:55:14.625898] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-22T18:55:14.770548] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T18:55:14.980722] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:15.317711] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-22T18:55:15.943022] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T18:55:15.947420] [INFO ] [REMOTE ] GBX: Full fetch complete (42829 records). [2025-10-22T18:55:15.947519] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-22T18:55:16.128283] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-22T18:55:16.321460] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-22T18:55:16.321544] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-22T18:55:16.322210] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-22T18:55:16.322272] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-22T18:55:16.323267] [DEBUG] [LOCAL ] GBX: Trimmed 42829 records to 28211 (keeping 200 days of data) [2025-10-22T18:55:16.417157] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T18:55:16.502335] [DEBUG] [LOCAL ] GBX: Primary data saved (28211 records). [2025-10-22T18:55:16.502468] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-22T18:55:16.502582] [INFO ] [MAIN ] Update Progress: 901/2367 symbols completed. GBX took 38.9s. Estimated remaining: 3h 7m 26s. Rate: 7.8 symbols/min [2025-10-22T18:55:16.690557] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:16.731639] [DEBUG] [LOCAL ] GD: Loaded 46538 existing records from primary storage. [2025-10-22T18:55:16.731954] [INFO ] [MAIN ] GD: Loaded 46538 existing records. [2025-10-22T18:55:16.906071] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:16.906281] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-22T18:55:16.906336] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-22T18:55:16.906502] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-22T18:55:16.906541] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-22T18:55:16.926558] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-22T18:55:17.257188] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:17.283630] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T18:55:17.717630] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-22T18:55:17.901774] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T18:55:18.517617] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-22T18:55:18.910067] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T18:55:19.317717] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-22T18:55:19.405326] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T18:55:20.117637] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-22T18:55:20.357308] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T18:55:20.360370] [INFO ] [REMOTE ] GCO: Full fetch complete (34645 records). [2025-10-22T18:55:20.360449] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-22T18:55:20.724339] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-22T18:55:20.724433] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-22T18:55:20.725050] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-22T18:55:20.725114] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-22T18:55:20.726111] [DEBUG] [LOCAL ] GCO: Trimmed 34645 records to 22815 (keeping 200 days of data) [2025-10-22T18:55:20.856101] [DEBUG] [LOCAL ] GCO: Primary data saved (22815 records). [2025-10-22T18:55:20.856233] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-22T18:55:20.856314] [INFO ] [MAIN ] Update Progress: 902/2367 symbols completed. GCO took 23.3s. Estimated remaining: 3h 7m 13s. Rate: 7.8 symbols/min [2025-10-22T18:55:20.922884] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-22T18:55:21.030933] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:21.078470] [DEBUG] [LOCAL ] GDDY: Loaded 49671 existing records from primary storage. [2025-10-22T18:55:21.078869] [INFO ] [MAIN ] GDDY: Loaded 49671 existing records. [2025-10-22T18:55:21.271116] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:21.272314] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T18:55:21.272494] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-22T18:55:21.272671] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-22T18:55:21.277120] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-22T18:55:21.277175] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-22T18:55:21.619952] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:21.717620] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-22T18:55:22.517727] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-22T18:55:22.814752] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:55:22.928926] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-22T18:55:23.317720] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-22T18:55:23.483669] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:55:24.117712] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-22T18:55:24.910850] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T18:55:24.917611] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-22T18:55:24.943992] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:55:25.717631] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-22T18:55:25.837347] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T18:55:26.517686] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-22T18:55:26.787828] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T18:55:27.220632] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T18:55:27.317714] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-22T18:55:28.117737] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-22T18:55:28.917717] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-22T18:55:29.283238] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T18:55:29.717706] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-22T18:55:29.785414] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T18:55:30.022624] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T18:55:30.375553] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T18:55:30.517729] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-22T18:55:31.317631] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-22T18:55:31.664374] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T18:55:32.117693] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-22T18:55:32.917631] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-22T18:55:33.060544] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T18:55:33.652663] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:55:33.717638] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-22T18:55:34.090571] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T18:55:34.517707] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-22T18:55:35.317701] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-22T18:55:35.546787] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T18:55:35.737066] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:55:36.117727] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-22T18:55:36.917630] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-22T18:55:37.287419] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T18:55:37.445624] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T18:55:37.449034] [INFO ] [REMOTE ] GCTS: Full fetch complete (26762 records). [2025-10-22T18:55:37.449109] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-22T18:55:37.723737] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-22T18:55:37.826324] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-22T18:55:37.826403] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-22T18:55:37.827001] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-22T18:55:37.827063] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-22T18:55:37.827861] [DEBUG] [LOCAL ] GCTS: Trimmed 26762 records to 20286 (keeping 200 days of data) [2025-10-22T18:55:37.938953] [DEBUG] [LOCAL ] GCTS: Primary data saved (20286 records). [2025-10-22T18:55:37.939083] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-22T18:55:37.939159] [INFO ] [MAIN ] Update Progress: 903/2367 symbols completed. GCTS took 26.2s. Estimated remaining: 3h 7m 21s. Rate: 7.8 symbols/min [2025-10-22T18:55:38.107404] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:38.112434] [DEBUG] [LOCAL ] GDIV: Loaded 3542 existing records from primary storage. [2025-10-22T18:55:38.112580] [INFO ] [MAIN ] GDIV: Loaded 3542 existing records. [2025-10-22T18:55:38.284940] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:38.285174] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-22T18:55:38.285222] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-22T18:55:38.285408] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-22T18:55:38.285463] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-22T18:55:38.526127] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-22T18:55:38.674716] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:38.702582] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:55:39.317612] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-22T18:55:39.351937] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T18:55:39.639269] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T18:55:40.117638] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-22T18:55:40.898249] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T18:55:40.917682] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-22T18:55:41.338162] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T18:55:41.358797] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T18:55:41.717716] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-22T18:55:42.324493] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:55:42.517732] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-22T18:55:43.317741] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-22T18:55:43.944139] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T18:55:44.117742] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-22T18:55:44.203261] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T18:55:44.917695] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-22T18:55:45.719377] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-22T18:55:45.722469] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-22T18:55:45.771285] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T18:55:46.517731] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-22T18:55:47.317713] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-22T18:55:47.360145] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T18:55:47.563424] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T18:55:47.653589] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-22T18:55:48.117720] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-22T18:55:48.679224] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T18:55:48.917722] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-22T18:55:49.717669] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-22T18:55:50.266261] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T18:55:50.517633] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-22T18:55:50.609503] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T18:55:51.317639] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-22T18:55:51.384214] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T18:55:51.386288] [INFO ] [REMOTE ] GCV: Full fetch complete (9856 records). [2025-10-22T18:55:51.386360] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-22T18:55:51.738148] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-22T18:55:51.738420] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-22T18:55:51.738718] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-22T18:55:51.738811] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-22T18:55:51.739433] [DEBUG] [LOCAL ] GCV: Trimmed 9856 records to 7752 (keeping 200 days of data) [2025-10-22T18:55:51.786806] [DEBUG] [LOCAL ] GCV: Primary data saved (7752 records). [2025-10-22T18:55:51.786947] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-22T18:55:51.787031] [INFO ] [MAIN ] Update Progress: 904/2367 symbols completed. GCV took 37.5s. Estimated remaining: 3h 7m 23s. Rate: 7.8 symbols/min [2025-10-22T18:55:51.960704] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:51.964786] [DEBUG] [LOCAL ] GDL: Loaded 2519 existing records from primary storage. [2025-10-22T18:55:51.964948] [INFO ] [MAIN ] GDL: Loaded 2519 existing records. [2025-10-22T18:55:52.117990] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-22T18:55:52.140846] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:52.141294] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-22T18:55:52.141426] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-22T18:55:52.141621] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-22T18:55:52.141704] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-22T18:55:52.494266] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:52.917637] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-22T18:55:53.171870] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T18:55:53.179432] [INFO ] [REMOTE ] GD: Full fetch complete (69632 records). [2025-10-22T18:55:53.179602] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-22T18:55:53.278995] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-22T18:55:53.593758] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-22T18:55:53.593842] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-22T18:55:53.594966] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-22T18:55:53.595046] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-22T18:55:53.596530] [DEBUG] [LOCAL ] GD: Trimmed 69632 records to 46474 (keeping 200 days of data) [2025-10-22T18:55:53.719711] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-22T18:55:53.892357] [DEBUG] [LOCAL ] GD: Primary data saved (46474 records). [2025-10-22T18:55:53.892485] [INFO ] [MAIN ] GD: Full history saved. [2025-10-22T18:55:53.892563] [INFO ] [MAIN ] Update Progress: 905/2367 symbols completed. GD took 37.4s. Estimated remaining: 3h 7m 6s. Rate: 7.8 symbols/min [2025-10-22T18:55:54.071689] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:54.102976] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T18:55:54.116560] [DEBUG] [LOCAL ] GDO: Loaded 5860 existing records from primary storage. [2025-10-22T18:55:54.116898] [INFO ] [MAIN ] GDO: Loaded 5860 existing records. [2025-10-22T18:55:54.291908] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T18:55:54.313241] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:54.314631] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-22T18:55:54.314718] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-22T18:55:54.314882] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-22T18:55:54.314938] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-22T18:55:54.522887] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-22T18:55:54.699060] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:55.028606] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-22T18:55:55.317770] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-22T18:55:55.908603] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T18:55:55.909673] [INFO ] [REMOTE ] GDIV: Full fetch complete (5424 records). [2025-10-22T18:55:55.909757] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-22T18:55:56.122855] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-22T18:55:56.272326] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-22T18:55:56.272398] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-22T18:55:56.272549] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-22T18:55:56.272586] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-22T18:55:56.272965] [DEBUG] [LOCAL ] GDIV: Trimmed 5424 records to 3507 (keeping 200 days of data) [2025-10-22T18:55:56.294180] [DEBUG] [LOCAL ] GDIV: Primary data saved (3507 records). [2025-10-22T18:55:56.294247] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-22T18:55:56.294314] [INFO ] [MAIN ] Update Progress: 906/2367 symbols completed. GDIV took 18.4s. Estimated remaining: 3h 6m 50s. Rate: 7.8 symbols/min [2025-10-22T18:55:56.457382] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:56.492376] [DEBUG] [LOCAL ] GDOT: Loaded 37710 existing records from primary storage. [2025-10-22T18:55:56.492692] [INFO ] [MAIN ] GDOT: Loaded 37710 existing records. [2025-10-22T18:55:56.675297] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:56.675493] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-22T18:55:56.675540] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-22T18:55:56.675781] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-22T18:55:56.675838] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-22T18:55:56.922988] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-22T18:55:57.036446] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:57.618880] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T18:55:57.717740] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-22T18:55:58.338928] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T18:55:58.517739] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-22T18:55:58.811468] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T18:55:59.122824] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:55:59.317682] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-22T18:56:00.117729] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-22T18:56:00.581373] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T18:56:00.917756] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-22T18:56:01.010855] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T18:56:01.717736] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-22T18:56:02.238280] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T18:56:02.517700] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-22T18:56:03.225042] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T18:56:03.317639] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-22T18:56:03.490548] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:56:03.501066] [INFO ] [REMOTE ] GDDY: Full fetch complete (72139 records). [2025-10-22T18:56:03.501220] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-22T18:56:03.889015] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-22T18:56:03.889134] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-22T18:56:03.890114] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-22T18:56:03.890178] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-22T18:56:03.891618] [DEBUG] [LOCAL ] GDDY: Trimmed 72139 records to 49624 (keeping 200 days of data) [2025-10-22T18:56:03.956042] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T18:56:04.121717] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-22T18:56:04.193600] [DEBUG] [LOCAL ] GDDY: Primary data saved (49624 records). [2025-10-22T18:56:04.193761] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-22T18:56:04.193848] [INFO ] [MAIN ] Update Progress: 907/2367 symbols completed. GDDY took 43.3s. Estimated remaining: 3h 6m 43s. Rate: 7.8 symbols/min [2025-10-22T18:56:04.378484] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:04.398597] [DEBUG] [LOCAL ] GDV: Loaded 19319 existing records from primary storage. [2025-10-22T18:56:04.398894] [INFO ] [MAIN ] GDV: Loaded 19319 existing records. [2025-10-22T18:56:04.587532] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:04.587866] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-22T18:56:04.587938] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-22T18:56:04.588221] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-22T18:56:04.588277] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-22T18:56:04.935551] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-22T18:56:04.947924] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:05.416236] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T18:56:05.717634] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-22T18:56:05.815201] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:56:06.186946] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T18:56:06.517729] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-22T18:56:07.020854] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-22T18:56:07.317626] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-22T18:56:07.993971] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T18:56:08.117722] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-22T18:56:08.822690] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T18:56:08.917702] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-22T18:56:09.611743] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T18:56:09.717721] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-22T18:56:10.517732] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-22T18:56:11.012893] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-22T18:56:11.267637] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:56:11.317620] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-22T18:56:12.117707] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-22T18:56:12.728319] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T18:56:12.917691] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-22T18:56:13.426891] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T18:56:13.717717] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-22T18:56:14.223194] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-22T18:56:14.307941] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T18:56:14.517698] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-22T18:56:15.317737] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-22T18:56:16.001398] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T18:56:16.002867] [INFO ] [REMOTE ] GDO: Full fetch complete (8501 records). [2025-10-22T18:56:16.002937] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-22T18:56:16.118987] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-22T18:56:16.437928] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-22T18:56:16.429472] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T18:56:16.438088] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-22T18:56:16.446208] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-22T18:56:16.446516] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-22T18:56:16.447618] [DEBUG] [LOCAL ] GDO: Trimmed 8501 records to 5852 (keeping 200 days of data) [2025-10-22T18:56:16.485279] [DEBUG] [LOCAL ] GDO: Primary data saved (5852 records). [2025-10-22T18:56:16.485414] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-22T18:56:16.485503] [INFO ] [MAIN ] Update Progress: 908/2367 symbols completed. GDO took 22.6s. Estimated remaining: 3h 6m 43s. Rate: 7.8 symbols/min [2025-10-22T18:56:16.678405] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:16.728717] [DEBUG] [LOCAL ] GE: Loaded 53698 existing records from primary storage. [2025-10-22T18:56:16.729047] [INFO ] [MAIN ] GE: Loaded 53698 existing records. [2025-10-22T18:56:16.906313] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:16.906540] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-22T18:56:16.906612] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-22T18:56:16.906877] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-22T18:56:16.906945] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-22T18:56:16.922757] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-22T18:56:17.271540] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:17.504127] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:56:17.717723] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-22T18:56:18.257888] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-22T18:56:18.517635] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-22T18:56:18.594861] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T18:56:19.317752] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-22T18:56:19.649900] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T18:56:20.117709] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-22T18:56:20.917636] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-22T18:56:20.958405] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:56:21.356013] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T18:56:21.379637] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T18:56:21.717709] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-22T18:56:22.376346] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T18:56:22.517636] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-22T18:56:23.317701] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-22T18:56:24.117742] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-22T18:56:24.318130] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T18:56:24.325291] [INFO ] [REMOTE ] GDOT: Full fetch complete (53711 records). [2025-10-22T18:56:24.325459] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-22T18:56:24.627612] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T18:56:24.744952] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-22T18:56:24.745051] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-22T18:56:24.745824] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-22T18:56:24.745888] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-22T18:56:24.747092] [DEBUG] [LOCAL ] GDOT: Trimmed 53711 records to 37641 (keeping 200 days of data) [2025-10-22T18:56:24.929321] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-22T18:56:24.959796] [DEBUG] [LOCAL ] GDOT: Primary data saved (37641 records). [2025-10-22T18:56:24.960017] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-22T18:56:24.960109] [INFO ] [MAIN ] Update Progress: 909/2367 symbols completed. GDOT took 28.7s. Estimated remaining: 3h 6m 36s. Rate: 7.8 symbols/min [2025-10-22T18:56:25.129192] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:25.149716] [DEBUG] [LOCAL ] GEF: Loaded 20751 existing records from primary storage. [2025-10-22T18:56:25.149970] [INFO ] [MAIN ] GEF: Loaded 20751 existing records. [2025-10-22T18:56:25.341200] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:25.341450] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-22T18:56:25.341498] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-22T18:56:25.341706] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-22T18:56:25.341761] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-22T18:56:25.698176] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:25.717614] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-22T18:56:26.190496] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:56:26.396225] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-22T18:56:26.517616] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-22T18:56:26.952952] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T18:56:27.317741] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-22T18:56:28.117723] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-22T18:56:28.325043] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T18:56:28.594119] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-22T18:56:28.917681] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-22T18:56:29.202601] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-22T18:56:29.717749] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-22T18:56:29.954906] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T18:56:30.471350] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T18:56:30.517610] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-22T18:56:31.317622] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-22T18:56:31.563539] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T18:56:32.117626] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-22T18:56:32.363254] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T18:56:32.917637] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-22T18:56:33.362422] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T18:56:33.365568] [INFO ] [REMOTE ] GDV: Full fetch complete (28345 records). [2025-10-22T18:56:33.365665] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-22T18:56:33.722773] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-22T18:56:33.735911] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-22T18:56:33.735995] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-22T18:56:33.736530] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-22T18:56:33.736571] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-22T18:56:33.737364] [DEBUG] [LOCAL ] GDV: Trimmed 28345 records to 19143 (keeping 200 days of data) [2025-10-22T18:56:33.839107] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T18:56:33.864716] [DEBUG] [LOCAL ] GDV: Primary data saved (19143 records). [2025-10-22T18:56:33.864856] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-22T18:56:33.864933] [INFO ] [MAIN ] Update Progress: 910/2367 symbols completed. GDV took 29.7s. Estimated remaining: 3h 6m 30s. Rate: 7.8 symbols/min [2025-10-22T18:56:34.030549] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:34.061426] [DEBUG] [LOCAL ] GEL: Loaded 31309 existing records from primary storage. [2025-10-22T18:56:34.061717] [INFO ] [MAIN ] GEL: Loaded 31309 existing records. [2025-10-22T18:56:34.233066] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:34.233259] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-22T18:56:34.233306] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-22T18:56:34.233479] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-22T18:56:34.233517] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-22T18:56:34.406488] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T18:56:34.436093] [INFO ] [REMOTE ] GDL: Full fetch complete (3483 records). [2025-10-22T18:56:34.455203] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-22T18:56:34.528933] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-22T18:56:34.771523] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:34.954349] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-22T18:56:34.954428] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-22T18:56:34.954545] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-22T18:56:34.954582] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-22T18:56:34.954954] [DEBUG] [LOCAL ] GDL: Trimmed 3483 records to 2510 (keeping 200 days of data) [2025-10-22T18:56:34.969531] [DEBUG] [LOCAL ] GDL: Primary data saved (2510 records). [2025-10-22T18:56:34.969602] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-22T18:56:34.969693] [INFO ] [MAIN ] Update Progress: 911/2367 symbols completed. GDL took 43.2s. Estimated remaining: 3h 6m 12s. Rate: 7.8 symbols/min [2025-10-22T18:56:35.141496] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:35.193569] [DEBUG] [LOCAL ] GENI: Loaded 52937 existing records from primary storage. [2025-10-22T18:56:35.193921] [INFO ] [MAIN ] GENI: Loaded 52937 existing records. [2025-10-22T18:56:35.322754] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-22T18:56:35.376122] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:35.376328] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-22T18:56:35.376377] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-22T18:56:35.376561] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-22T18:56:35.376603] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-22T18:56:35.746865] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:36.117726] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-22T18:56:36.421454] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T18:56:36.792379] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:56:36.917722] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-22T18:56:37.717630] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-22T18:56:38.054083] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-22T18:56:38.205796] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-22T18:56:38.517774] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-22T18:56:39.317753] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-22T18:56:39.376982] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T18:56:40.117763] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-22T18:56:40.599027] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T18:56:40.741587] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-22T18:56:40.917721] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-22T18:56:41.693950] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T18:56:41.717611] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-22T18:56:41.754092] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T18:56:42.517735] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-22T18:56:43.317633] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-22T18:56:43.624017] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T18:56:43.658810] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T18:56:44.117624] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-22T18:56:44.917723] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-22T18:56:45.282220] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T18:56:45.620969] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-22T18:56:45.717723] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-22T18:56:46.333385] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T18:56:46.517694] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-22T18:56:47.317743] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-22T18:56:47.839141] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-22T18:56:47.869103] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T18:56:48.117598] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-22T18:56:48.917633] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-22T18:56:49.059758] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T18:56:49.589980] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T18:56:49.717747] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-22T18:56:50.517793] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-22T18:56:51.228680] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T18:56:51.277390] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:56:51.317617] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-22T18:56:52.059518] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T18:56:52.117792] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-22T18:56:52.713813] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T18:56:52.917716] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-22T18:56:53.352394] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T18:56:53.356157] [INFO ] [REMOTE ] GEF: Full fetch complete (29379 records). [2025-10-22T18:56:53.356238] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-22T18:56:53.721546] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-22T18:56:53.721966] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-22T18:56:53.722056] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-22T18:56:53.723610] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-22T18:56:53.723695] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-22T18:56:53.724510] [DEBUG] [LOCAL ] GEF: Trimmed 29379 records to 20692 (keeping 200 days of data) [2025-10-22T18:56:53.847324] [DEBUG] [LOCAL ] GEF: Primary data saved (20692 records). [2025-10-22T18:56:53.847453] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-22T18:56:53.847578] [INFO ] [MAIN ] Update Progress: 912/2367 symbols completed. GEF took 28.9s. Estimated remaining: 3h 6m 22s. Rate: 7.8 symbols/min [2025-10-22T18:56:54.011281] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:54.056472] [DEBUG] [LOCAL ] GEO: Loaded 51739 existing records from primary storage. [2025-10-22T18:56:54.056788] [INFO ] [MAIN ] GEO: Loaded 51739 existing records. [2025-10-22T18:56:54.229096] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:54.229308] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-22T18:56:54.229352] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-22T18:56:54.229532] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-22T18:56:54.229568] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-22T18:56:54.522898] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-22T18:56:54.586723] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:54.693350] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:56:55.317764] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-22T18:56:55.730044] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T18:56:56.032005] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-22T18:56:56.117712] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-22T18:56:56.917619] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-22T18:56:57.246241] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T18:56:57.294073] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T18:56:57.298388] [INFO ] [REMOTE ] GEL: Full fetch complete (48006 records). [2025-10-22T18:56:57.298491] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-22T18:56:57.684710] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-22T18:56:57.684796] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-22T18:56:57.685457] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-22T18:56:57.685496] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-22T18:56:57.686440] [DEBUG] [LOCAL ] GEL: Trimmed 48006 records to 31221 (keeping 200 days of data) [2025-10-22T18:56:57.737637] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-22T18:56:57.874943] [DEBUG] [LOCAL ] GEL: Primary data saved (31221 records). [2025-10-22T18:56:57.875106] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-22T18:56:57.875197] [INFO ] [MAIN ] Update Progress: 913/2367 symbols completed. GEL took 24.0s. Estimated remaining: 3h 6m 9s. Rate: 7.8 symbols/min [2025-10-22T18:56:58.038628] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:58.077262] [DEBUG] [LOCAL ] GES: Loaded 37978 existing records from primary storage. [2025-10-22T18:56:58.077574] [INFO ] [MAIN ] GES: Loaded 37978 existing records. [2025-10-22T18:56:58.280414] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:58.280693] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-22T18:56:58.280752] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-22T18:56:58.280949] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-22T18:56:58.281039] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-22T18:56:58.521929] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-22T18:56:58.673536] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:58.706127] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T18:56:59.317623] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-22T18:57:00.029343] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-22T18:57:00.117620] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-22T18:57:00.419384] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T18:57:00.917754] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-22T18:57:00.943964] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:57:01.717771] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-22T18:57:02.517630] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-22T18:57:02.980277] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-22T18:57:02.989120] [INFO ] [REMOTE ] GE: Full fetch complete (77864 records). [2025-10-22T18:57:02.989261] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-22T18:57:03.424543] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-22T18:57:03.424985] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-22T18:57:03.425954] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-22T18:57:03.426034] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-22T18:57:03.428673] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-22T18:57:03.440334] [DEBUG] [LOCAL ] GE: Trimmed 77864 records to 53697 (keeping 200 days of data) [2025-10-22T18:57:03.440217] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-22T18:57:03.703933] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-22T18:57:03.805707] [DEBUG] [LOCAL ] GE: Primary data saved (53697 records). [2025-10-22T18:57:03.805834] [INFO ] [MAIN ] GE: Full history saved. [2025-10-22T18:57:03.805910] [INFO ] [MAIN ] Update Progress: 914/2367 symbols completed. GE took 47.3s. Estimated remaining: 3h 5m 58s. Rate: 7.8 symbols/min [2025-10-22T18:57:03.970480] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:04.002885] [DEBUG] [LOCAL ] GETY: Loaded 35197 existing records from primary storage. [2025-10-22T18:57:04.003160] [INFO ] [MAIN ] GETY: Loaded 35197 existing records. [2025-10-22T18:57:04.125151] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-22T18:57:04.184439] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:04.185094] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-22T18:57:04.185238] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-22T18:57:04.185445] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-22T18:57:04.185490] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-22T18:57:04.471904] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T18:57:04.585701] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:04.917754] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-22T18:57:05.225750] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:57:05.717709] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-22T18:57:05.936033] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T18:57:06.517786] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-22T18:57:06.704739] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T18:57:07.254362] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T18:57:07.317689] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-22T18:57:08.117628] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-22T18:57:08.446057] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:57:08.456292] [INFO ] [REMOTE ] GENI: Full fetch complete (76102 records). [2025-10-22T18:57:08.456431] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-22T18:57:08.907289] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-22T18:57:08.907404] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-22T18:57:08.908400] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-22T18:57:08.908565] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-22T18:57:08.910208] [DEBUG] [LOCAL ] GENI: Trimmed 76102 records to 52937 (keeping 200 days of data) [2025-10-22T18:57:08.967709] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-22T18:57:09.043752] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T18:57:09.253063] [DEBUG] [LOCAL ] GENI: Primary data saved (52937 records). [2025-10-22T18:57:09.253204] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-22T18:57:09.253919] [INFO ] [MAIN ] Update Progress: 915/2367 symbols completed. GENI took 34.3s. Estimated remaining: 3h 5m 47s. Rate: 7.8 symbols/min [2025-10-22T18:57:09.428868] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:09.482486] [DEBUG] [LOCAL ] GEV: Loaded 52992 existing records from primary storage. [2025-10-22T18:57:09.482847] [INFO ] [MAIN ] GEV: Loaded 52992 existing records. [2025-10-22T18:57:09.663143] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:09.663461] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-22T18:57:09.663531] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-22T18:57:09.663874] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-22T18:57:09.663987] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-22T18:57:09.726714] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-22T18:57:09.799035] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T18:57:10.058476] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:10.517633] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-22T18:57:10.822233] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:57:11.317688] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-22T18:57:11.433630] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T18:57:12.117800] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-22T18:57:12.917753] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-22T18:57:12.973922] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-22T18:57:13.146088] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T18:57:13.653027] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T18:57:13.717608] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-22T18:57:14.377019] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T18:57:14.517700] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-22T18:57:15.076874] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T18:57:15.317707] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-22T18:57:16.117751] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-22T18:57:16.683020] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-22T18:57:16.812488] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T18:57:16.917694] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-22T18:57:17.717638] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-22T18:57:17.857043] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:57:18.517705] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-22T18:57:19.317820] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-22T18:57:19.890160] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T18:57:19.935466] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (3.02 seconds). [2025-10-22T18:57:20.117626] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-22T18:57:20.343725] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T18:57:20.917704] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-22T18:57:21.602389] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T18:57:21.707032] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T18:57:21.717610] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-22T18:57:22.304400] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T18:57:22.517685] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-22T18:57:23.232769] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T18:57:23.317619] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-22T18:57:24.117761] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-22T18:57:24.923513] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-22T18:57:24.929599] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-22T18:57:25.028483] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T18:57:25.202961] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T18:57:25.717698] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-22T18:57:26.517636] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-22T18:57:26.626883] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T18:57:27.317714] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-22T18:57:27.495064] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:57:27.500986] [INFO ] [REMOTE ] GES: Full fetch complete (58338 records). [2025-10-22T18:57:27.501108] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-22T18:57:27.890734] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-22T18:57:27.890833] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-22T18:57:27.891659] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-22T18:57:27.891721] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-22T18:57:27.892888] [DEBUG] [LOCAL ] GES: Trimmed 58338 records to 37820 (keeping 200 days of data) [2025-10-22T18:57:28.113069] [DEBUG] [LOCAL ] GES: Primary data saved (37820 records). [2025-10-22T18:57:28.113199] [INFO ] [MAIN ] GES: Full history saved. [2025-10-22T18:57:28.113276] [INFO ] [MAIN ] Update Progress: 916/2367 symbols completed. GES took 30.2s. Estimated remaining: 3h 5m 57s. Rate: 7.8 symbols/min [2025-10-22T18:57:28.124605] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-22T18:57:28.280285] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:28.284250] [DEBUG] [LOCAL ] GF: Loaded 2646 existing records from primary storage. [2025-10-22T18:57:28.284393] [INFO ] [MAIN ] GF: Loaded 2646 existing records. [2025-10-22T18:57:28.454816] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:28.455023] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-22T18:57:28.455070] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-22T18:57:28.455214] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-22T18:57:28.455251] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-22T18:57:28.808688] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:28.917723] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-22T18:57:29.172751] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-22T18:57:29.352999] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:57:29.362091] [INFO ] [REMOTE ] GEO: Full fetch complete (75510 records). [2025-10-22T18:57:29.362290] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-22T18:57:29.472792] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-22T18:57:29.559196] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T18:57:29.602758] [INFO ] [REMOTE ] GETY: Full fetch complete (55653 records). [2025-10-22T18:57:29.637564] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-22T18:57:29.722770] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-22T18:57:30.008080] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-22T18:57:30.008520] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-22T18:57:30.024961] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-22T18:57:30.027036] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-22T18:57:30.137125] [DEBUG] [LOCAL ] GEO: Trimmed 75510 records to 51707 (keeping 200 days of data) [2025-10-22T18:57:30.339771] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-22T18:57:30.344046] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-22T18:57:30.357628] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-22T18:57:30.357834] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-22T18:57:30.369064] [DEBUG] [LOCAL ] GETY: Trimmed 55653 records to 35237 (keeping 200 days of data) [2025-10-22T18:57:30.524692] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-22T18:57:30.900777] [DEBUG] [LOCAL ] GEO: Primary data saved (51707 records). [2025-10-22T18:57:30.922815] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-22T18:57:30.922985] [INFO ] [MAIN ] Update Progress: 917/2367 symbols completed. GEO took 37.1s. Estimated remaining: 3h 5m 42s. Rate: 7.8 symbols/min [2025-10-22T18:57:30.922702] [DEBUG] [LOCAL ] GETY: Primary data saved (35237 records). [2025-10-22T18:57:30.923335] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-22T18:57:30.923450] [INFO ] [MAIN ] Update Progress: 918/2367 symbols completed. GETY took 27.1s. Estimated remaining: 3h 5m 22s. Rate: 7.8 symbols/min [2025-10-22T18:57:31.213498] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-22T18:57:31.317699] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-22T18:57:32.094081] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T18:57:32.117614] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-22T18:57:32.173430] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-22T18:57:32.683220] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-22T18:57:32.917701] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-22T18:57:33.717751] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-22T18:57:34.383272] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T18:57:34.517707] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-22T18:57:35.141944] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T18:57:35.317788] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-22T18:57:35.607353] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-22T18:57:35.796464] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T18:57:36.117759] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-22T18:57:36.605028] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T18:57:36.917639] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-22T18:57:37.717746] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-22T18:57:38.187322] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-22T18:57:38.517700] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-22T18:57:39.312911] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-22T18:57:39.324152] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-22T18:57:39.333484] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T18:57:39.334266] [INFO ] [REMOTE ] GF: Full fetch complete (4789 records). [2025-10-22T18:57:39.334333] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-22T18:57:39.697901] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-22T18:57:39.697979] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-22T18:57:39.698180] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-22T18:57:39.698219] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-22T18:57:39.698565] [DEBUG] [LOCAL ] GF: Trimmed 4789 records to 2623 (keeping 200 days of data) [2025-10-22T18:57:39.714128] [DEBUG] [LOCAL ] GF: Primary data saved (2623 records). [2025-10-22T18:57:39.714195] [INFO ] [MAIN ] GF: Full history saved. [2025-10-22T18:57:39.714264] [INFO ] [MAIN ] Update Progress: 919/2367 symbols completed. GF took 11.6s. Estimated remaining: 3h 5m 16s. Rate: 7.8 symbols/min [2025-10-22T18:57:41.778316] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-22T18:57:41.789914] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-22T18:57:44.489030] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-22T18:57:44.498589] [INFO ] [REMOTE ] GEV: Full fetch complete (77050 records). [2025-10-22T18:57:44.498819] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-22T18:57:44.901158] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-22T18:57:44.901288] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-22T18:57:44.903006] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-22T18:57:44.903080] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-22T18:57:44.905306] [DEBUG] [LOCAL ] GEV: Trimmed 77050 records to 52992 (keeping 200 days of data) [2025-10-22T18:57:45.276882] [DEBUG] [LOCAL ] GEV: Primary data saved (52992 records). [2025-10-22T18:57:45.277251] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-22T18:57:45.277981] [INFO ] [MAIN ] Update Progress: 920/2367 symbols completed. GEV took 36.0s. Estimated remaining: 3h 5m 5s. Rate: 7.8 symbols/min [2025-10-22T18:57:45.917606] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:45.930403] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:45.969496] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:46.006828] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:46.015865] [DEBUG] [LOCAL ] GFR: Loaded 7423 existing records from primary storage. [2025-10-22T18:57:46.016281] [INFO ] [MAIN ] GFR: Loaded 7423 existing records. [2025-10-22T18:57:46.224444] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:46.225991] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-22T18:57:46.226051] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-22T18:57:46.226292] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-22T18:57:46.226358] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-22T18:57:46.225468] [DEBUG] [LOCAL ] GFF: Loaded 29542 existing records from primary storage. [2025-10-22T18:57:46.307040] [INFO ] [MAIN ] GFF: Loaded 29542 existing records. [2025-10-22T18:57:46.388379] [DEBUG] [LOCAL ] GFL: Loaded 47521 existing records from primary storage. [2025-10-22T18:57:46.412323] [INFO ] [MAIN ] GFL: Loaded 47521 existing records. [2025-10-22T18:57:46.546752] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-22T18:57:46.582621] [INFO ] [MAIN ] GFI: Loaded 53116 existing records. [2025-10-22T18:57:46.840467] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:46.956927] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-22T18:57:46.983312] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-22T18:57:46.977631] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:47.053525] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-22T18:57:47.058762] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-22T18:57:47.087854] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-22T18:57:47.099718] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-22T18:57:47.127484] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-22T18:57:47.183011] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:47.225075] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-22T18:57:47.239214] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-22T18:57:47.254749] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-22T18:57:47.316291] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-22T18:57:47.325363] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:47.393680] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-22T18:57:47.387181] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-22T18:57:48.187196] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:48.223033] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-22T18:57:48.336548] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T18:57:48.340865] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:48.371087] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-22T18:57:48.365584] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-22T18:57:48.479571] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:48.479970] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-22T18:57:49.111602] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T18:57:49.113872] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-22T18:57:49.390770] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T18:57:49.397346] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-22T18:57:49.935746] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T18:57:49.945447] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T18:57:49.946060] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-22T18:57:49.949258] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-22T18:57:50.259436] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T18:57:50.269953] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-22T18:57:50.287469] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T18:57:50.293671] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-22T18:57:50.831950] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T18:57:50.835188] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-22T18:57:51.196758] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T18:57:51.205733] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-22T18:57:51.275305] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T18:57:51.312874] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-22T18:57:51.317615] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-22T18:57:52.007266] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:57:52.117630] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-22T18:57:52.755282] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T18:57:52.915700] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T18:57:52.925558] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-22T18:57:53.717753] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-22T18:57:54.076031] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T18:57:54.334107] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T18:57:54.517739] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-22T18:57:54.980378] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T18:57:55.317631] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-22T18:57:55.693676] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T18:57:55.974906] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T18:57:56.117696] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-22T18:57:56.917732] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-22T18:57:57.717635] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-22T18:57:58.171428] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T18:57:58.261100] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-22T18:57:58.517702] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-22T18:57:59.327969] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-22T18:57:59.330532] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T18:58:00.117766] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-22T18:58:00.491687] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T18:58:00.560572] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T18:58:00.755302] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T18:58:00.917688] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-22T18:58:01.526864] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T18:58:01.717754] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-22T18:58:02.413204] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T18:58:02.517734] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-22T18:58:03.317636] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-22T18:58:04.117708] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-22T18:58:04.464958] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T18:58:04.470715] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T18:58:04.838499] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T18:58:04.840004] [INFO ] [REMOTE ] GFR: Full fetch complete (11976 records). [2025-10-22T18:58:04.840074] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-22T18:58:04.922925] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-22T18:58:05.204534] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-22T18:58:05.204608] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-22T18:58:05.204899] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-22T18:58:05.204960] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-22T18:58:05.205388] [DEBUG] [LOCAL ] GFR: Trimmed 11976 records to 7332 (keeping 200 days of data) [2025-10-22T18:58:05.244139] [DEBUG] [LOCAL ] GFR: Primary data saved (7332 records). [2025-10-22T18:58:05.244266] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-22T18:58:05.244352] [INFO ] [MAIN ] Update Progress: 921/2367 symbols completed. GFR took 20.0s. Estimated remaining: 3h 5m 17s. Rate: 7.8 symbols/min [2025-10-22T18:58:05.413377] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:05.459706] [DEBUG] [LOCAL ] GGB: Loaded 51551 existing records from primary storage. [2025-10-22T18:58:05.460048] [INFO ] [MAIN ] GGB: Loaded 51551 existing records. [2025-10-22T18:58:05.634930] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:05.635163] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-22T18:58:05.635210] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-22T18:58:05.635474] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-22T18:58:05.635532] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-22T18:58:05.725741] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-22T18:58:06.005811] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:06.517765] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-22T18:58:07.081841] [DEBUG] [REMOTE ] GGB: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-22T18:58:07.082147] [WARN ] [REMOTE ] GGB: No data returned for month 2025-01 [2025-10-22T18:58:07.082238] [FATAL] [REMOTE ] GGB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:58:07.082287] [FATAL] [MAIN ] GGB: Failed to fetch primary data. [2025-10-22T18:58:07.082321] [WARN ] [MAIN ] GGB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:58:07.082357] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-22T18:58:07.082410] [DEBUG] [LOCAL ] GGB: No primary data file found to delete. [2025-10-22T18:58:07.082444] [INFO ] [LOCAL ] GGB: Starting deletion of derivative data. [2025-10-22T18:58:07.082606] [DEBUG] [LOCAL ] GGB: Deleted derivative data file. [2025-10-22T18:58:07.083206] [INFO ] [MAIN ] Update Progress: 922/2367 symbols completed. GGB took 1.8s. Estimated remaining: 3h 4m 60s. Rate: 7.8 symbols/min [2025-10-22T18:58:07.224372] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-22T18:58:07.295697] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:07.319514] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-22T18:58:07.324830] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T18:58:07.367257] [DEBUG] [LOCAL ] GGG: Loaded 40582 existing records from primary storage. [2025-10-22T18:58:07.367589] [INFO ] [MAIN ] GGG: Loaded 40582 existing records. [2025-10-22T18:58:07.542043] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:07.542303] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-22T18:58:07.542364] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-22T18:58:07.542570] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-22T18:58:07.542623] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-22T18:58:07.879856] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:08.117697] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-22T18:58:08.556841] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T18:58:08.561140] [INFO ] [REMOTE ] GFF: Full fetch complete (43724 records). [2025-10-22T18:58:08.561219] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-22T18:58:08.917921] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-22T18:58:08.953144] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-22T18:58:08.953237] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-22T18:58:08.954016] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-22T18:58:08.954112] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-22T18:58:08.955366] [DEBUG] [LOCAL ] GFF: Trimmed 43724 records to 29398 (keeping 200 days of data) [2025-10-22T18:58:09.136795] [DEBUG] [LOCAL ] GFF: Primary data saved (29398 records). [2025-10-22T18:58:09.136926] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-22T18:58:09.137006] [INFO ] [MAIN ] Update Progress: 923/2367 symbols completed. GFF took 23.9s. Estimated remaining: 3h 4m 43s. Rate: 7.8 symbols/min [2025-10-22T18:58:09.307738] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:09.332466] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:58:09.352032] [DEBUG] [LOCAL ] GGT: Loaded 14524 existing records from primary storage. [2025-10-22T18:58:09.352277] [INFO ] [MAIN ] GGT: Loaded 14524 existing records. [2025-10-22T18:58:09.525841] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:09.526076] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-22T18:58:09.526123] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-22T18:58:09.526271] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-22T18:58:09.526308] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-22T18:58:09.722963] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-22T18:58:09.877013] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:10.517790] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-22T18:58:11.041602] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T18:58:11.084874] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T18:58:11.132492] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T18:58:11.317719] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-22T18:58:12.117753] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-22T18:58:12.862744] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T18:58:12.917616] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-22T18:58:13.538185] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T18:58:13.717702] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-22T18:58:14.522766] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-22T18:58:14.537212] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T18:58:15.317723] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-22T18:58:15.337329] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T18:58:15.594784] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T18:58:16.117688] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-22T18:58:16.724056] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:58:16.826521] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T18:58:16.834600] [INFO ] [REMOTE ] GFL: Full fetch complete (69714 records). [2025-10-22T18:58:16.834789] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-22T18:58:16.922812] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-22T18:58:17.213472] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-22T18:58:17.213556] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-22T18:58:17.214430] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-22T18:58:17.214493] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-22T18:58:17.215785] [DEBUG] [LOCAL ] GFL: Trimmed 69714 records to 47496 (keeping 200 days of data) [2025-10-22T18:58:17.501076] [DEBUG] [LOCAL ] GFL: Primary data saved (47496 records). [2025-10-22T18:58:17.501207] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-22T18:58:17.501286] [INFO ] [MAIN ] Update Progress: 924/2367 symbols completed. GFL took 32.2s. Estimated remaining: 3h 4m 37s. Rate: 7.8 symbols/min [2025-10-22T18:58:17.668207] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:17.673309] [DEBUG] [LOCAL ] GGZ: Loaded 2395 existing records from primary storage. [2025-10-22T18:58:17.673533] [INFO ] [MAIN ] GGZ: Loaded 2395 existing records. [2025-10-22T18:58:17.726341] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-22T18:58:17.854760] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:17.854980] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-22T18:58:17.855029] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-22T18:58:17.855161] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-22T18:58:17.855199] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-22T18:58:18.222470] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:18.517727] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-22T18:58:18.602266] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:58:19.317451] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T18:58:19.320322] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-22T18:58:20.110636] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-22T18:58:20.118849] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-22T18:58:20.120558] [INFO ] [REMOTE ] GFI: Full fetch complete (76982 records). [2025-10-22T18:58:20.120774] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-22T18:58:20.506331] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-22T18:58:20.506408] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-22T18:58:20.507284] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-22T18:58:20.507346] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-22T18:58:20.508794] [DEBUG] [LOCAL ] GFI: Trimmed 76982 records to 53116 (keeping 200 days of data) [2025-10-22T18:58:20.816919] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T18:58:20.839175] [DEBUG] [LOCAL ] GFI: Primary data saved (53116 records). [2025-10-22T18:58:20.839286] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-22T18:58:20.839366] [INFO ] [MAIN ] Update Progress: 925/2367 symbols completed. GFI took 35.5s. Estimated remaining: 3h 4m 22s. Rate: 7.8 symbols/min [2025-10-22T18:58:20.926734] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-22T18:58:21.019514] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:21.025398] [DEBUG] [LOCAL ] GHC: Loaded 2964 existing records from primary storage. [2025-10-22T18:58:21.025610] [INFO ] [MAIN ] GHC: Loaded 2964 existing records. [2025-10-22T18:58:21.212496] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:21.234270] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-22T18:58:21.237109] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-22T18:58:21.237522] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-22T18:58:21.238855] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T18:58:21.237923] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-22T18:58:21.593426] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:21.717701] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-22T18:58:22.359752] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T18:58:22.517758] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-22T18:58:22.552314] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T18:58:23.317724] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-22T18:58:23.829978] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T18:58:24.024754] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T18:58:24.117711] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-22T18:58:24.659210] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T18:58:24.917729] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-22T18:58:25.380890] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T18:58:25.717705] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-22T18:58:26.517711] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-22T18:58:26.767389] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T18:58:27.300677] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T18:58:27.317614] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-22T18:58:27.815242] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-22T18:58:28.117723] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-22T18:58:28.775242] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T18:58:28.917689] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-22T18:58:29.717737] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-22T18:58:30.306182] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-22T18:58:30.331305] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T18:58:30.517712] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-22T18:58:31.317705] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-22T18:58:31.947715] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T18:58:32.117711] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-22T18:58:32.692132] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T18:58:32.917616] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-22T18:58:33.435254] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-22T18:58:33.465835] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-22T18:58:33.717696] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-22T18:58:34.320861] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:58:34.517712] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-22T18:58:35.317698] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-22T18:58:35.470871] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T18:58:35.802202] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-22T18:58:36.117698] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-22T18:58:36.688390] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-22T18:58:36.917734] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-22T18:58:37.717689] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-22T18:58:37.970723] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T18:58:37.973713] [INFO ] [REMOTE ] GGT: Full fetch complete (19022 records). [2025-10-22T18:58:37.973797] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-22T18:58:38.335175] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-22T18:58:38.335246] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-22T18:58:38.335714] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-22T18:58:38.335777] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-22T18:58:38.336327] [DEBUG] [LOCAL ] GGT: Trimmed 19022 records to 14455 (keeping 200 days of data) [2025-10-22T18:58:38.418890] [DEBUG] [LOCAL ] GGT: Primary data saved (14455 records). [2025-10-22T18:58:38.419022] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-22T18:58:38.419099] [INFO ] [MAIN ] Update Progress: 926/2367 symbols completed. GGT took 29.3s. Estimated remaining: 3h 4m 30s. Rate: 7.8 symbols/min [2025-10-22T18:58:38.491353] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T18:58:38.503731] [INFO ] [REMOTE ] GHC: Full fetch complete (3692 records). [2025-10-22T18:58:38.514344] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-22T18:58:38.527583] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-22T18:58:38.699303] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:38.761255] [DEBUG] [LOCAL ] GHG: Loaded 3279 existing records from primary storage. [2025-10-22T18:58:38.763046] [INFO ] [MAIN ] GHG: Loaded 3279 existing records. [2025-10-22T18:58:39.182512] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-22T18:58:39.182321] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:39.182698] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-22T18:58:39.182779] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-22T18:58:39.182929] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-22T18:58:39.183005] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-22T18:58:39.183048] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-22T18:58:39.183521] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-22T18:58:39.183807] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-22T18:58:39.183888] [DEBUG] [LOCAL ] GHC: Trimmed 3692 records to 2954 (keeping 200 days of data) [2025-10-22T18:58:39.310424] [DEBUG] [LOCAL ] GHC: Primary data saved (2954 records). [2025-10-22T18:58:39.313319] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-22T18:58:39.313409] [INFO ] [MAIN ] Update Progress: 927/2367 symbols completed. GHC took 18.5s. Estimated remaining: 3h 4m 12s. Rate: 7.8 symbols/min [2025-10-22T18:58:39.325003] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-22T18:58:39.693610] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:39.768433] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:39.773104] [DEBUG] [LOCAL ] GHI: Loaded 7700 existing records from primary storage. [2025-10-22T18:58:39.773383] [INFO ] [MAIN ] GHI: Loaded 7700 existing records. [2025-10-22T18:58:39.954914] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:39.955174] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-22T18:58:39.955250] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-22T18:58:39.955573] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-22T18:58:39.955704] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-22T18:58:40.035184] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T18:58:40.133076] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-22T18:58:40.138871] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T18:58:40.344229] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:40.618905] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-22T18:58:40.917726] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-22T18:58:41.714126] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T18:58:41.717602] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-22T18:58:42.357927] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T18:58:42.517713] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-22T18:58:43.033823] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-22T18:58:43.317713] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-22T18:58:43.763388] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-22T18:58:44.117697] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-22T18:58:44.564416] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T18:58:44.917702] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-22T18:58:45.376369] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T18:58:45.717702] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-22T18:58:46.168537] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T18:58:46.517634] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-22T18:58:47.317715] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-22T18:58:47.762739] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-22T18:58:47.929092] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T18:58:48.117691] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-22T18:58:48.775199] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T18:58:48.917690] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-22T18:58:49.487856] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T18:58:49.717732] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-22T18:58:50.517636] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-22T18:58:50.659142] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T18:58:51.317689] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-22T18:58:51.522406] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T18:58:51.523366] [INFO ] [REMOTE ] GGZ: Full fetch complete (3842 records). [2025-10-22T18:58:51.523433] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-22T18:58:51.870228] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-22T18:58:51.870302] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-22T18:58:51.870414] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-22T18:58:51.870453] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-22T18:58:51.870815] [DEBUG] [LOCAL ] GGZ: Trimmed 3842 records to 2348 (keeping 200 days of data) [2025-10-22T18:58:51.885046] [DEBUG] [LOCAL ] GGZ: Primary data saved (2348 records). [2025-10-22T18:58:51.885114] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-22T18:58:51.885178] [INFO ] [MAIN ] Update Progress: 928/2367 symbols completed. GGZ took 34.4s. Estimated remaining: 3h 4m 12s. Rate: 7.8 symbols/min [2025-10-22T18:58:52.047974] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:52.054674] [DEBUG] [LOCAL ] GHLD: Loaded 4289 existing records from primary storage. [2025-10-22T18:58:52.054874] [INFO ] [MAIN ] GHLD: Loaded 4289 existing records. [2025-10-22T18:58:52.122910] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-22T18:58:52.233638] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:52.233893] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-22T18:58:52.233943] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-22T18:58:52.234105] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-22T18:58:52.234159] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-22T18:58:52.586829] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:52.897564] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T18:58:52.905039] [INFO ] [REMOTE ] GGG: Full fetch complete (59524 records). [2025-10-22T18:58:52.905229] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-22T18:58:52.922762] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-22T18:58:53.038739] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T18:58:53.314817] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-22T18:58:53.314899] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-22T18:58:53.315687] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-22T18:58:53.315749] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-22T18:58:53.316861] [DEBUG] [LOCAL ] GGG: Trimmed 59524 records to 40560 (keeping 200 days of data) [2025-10-22T18:58:53.528375] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T18:58:53.566982] [DEBUG] [LOCAL ] GGG: Primary data saved (40560 records). [2025-10-22T18:58:53.567111] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-22T18:58:53.567728] [INFO ] [MAIN ] Update Progress: 929/2367 symbols completed. GGG took 46.5s. Estimated remaining: 3h 3m 55s. Rate: 7.8 symbols/min [2025-10-22T18:58:53.733371] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:53.729170] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-22T18:58:53.754161] [DEBUG] [LOCAL ] GHM: Loaded 14348 existing records from primary storage. [2025-10-22T18:58:53.754509] [INFO ] [MAIN ] GHM: Loaded 14348 existing records. [2025-10-22T18:58:53.988871] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:53.989118] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-22T18:58:53.989178] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-22T18:58:53.989336] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-22T18:58:53.989375] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-22T18:58:54.288318] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T18:58:54.402032] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:54.517619] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-22T18:58:55.317696] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-22T18:58:55.354202] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T18:58:55.933847] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T18:58:56.117739] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-22T18:58:56.917700] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-22T18:58:57.717737] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-22T18:58:57.745225] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:58:58.215132] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T18:58:58.363786] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T18:58:58.517706] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-22T18:58:58.865672] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-22T18:58:59.317692] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-22T18:58:59.781340] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T18:59:00.117627] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-22T18:59:00.917682] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-22T18:59:01.314195] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T18:59:01.717760] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-22T18:59:02.517757] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-22T18:59:02.742828] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T18:59:03.149113] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-22T18:59:03.317704] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-22T18:59:04.117618] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-22T18:59:04.256800] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T18:59:04.403194] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T18:59:04.660132] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-22T18:59:04.917705] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-22T18:59:05.717728] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-22T18:59:05.908471] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T18:59:05.909836] [INFO ] [REMOTE ] GHG: Full fetch complete (4190 records). [2025-10-22T18:59:05.909907] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-22T18:59:06.283831] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-22T18:59:06.283929] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-22T18:59:06.284081] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-22T18:59:06.284122] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-22T18:59:06.284461] [DEBUG] [LOCAL ] GHG: Trimmed 4190 records to 3269 (keeping 200 days of data) [2025-10-22T18:59:06.305147] [DEBUG] [LOCAL ] GHG: Primary data saved (3269 records). [2025-10-22T18:59:06.305222] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-22T18:59:06.305290] [INFO ] [MAIN ] Update Progress: 930/2367 symbols completed. GHG took 27.9s. Estimated remaining: 3h 3m 55s. Rate: 7.8 symbols/min [2025-10-22T18:59:06.475323] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:06.495747] [DEBUG] [LOCAL ] GHY: Loaded 20916 existing records from primary storage. [2025-10-22T18:59:06.495981] [INFO ] [MAIN ] GHY: Loaded 20916 existing records. [2025-10-22T18:59:06.522102] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-22T18:59:06.624399] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T18:59:06.700966] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:06.701200] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-22T18:59:06.701259] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-22T18:59:06.701421] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-22T18:59:06.701459] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-22T18:59:07.045526] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:07.317720] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-22T18:59:07.343342] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T18:59:08.117726] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-22T18:59:08.203042] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T18:59:08.554706] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-22T18:59:08.917773] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-22T18:59:09.717622] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-22T18:59:10.198032] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T18:59:10.302531] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T18:59:10.305123] [INFO ] [REMOTE ] GHI: Full fetch complete (11240 records). [2025-10-22T18:59:10.305193] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-22T18:59:10.522910] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-22T18:59:10.658823] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-22T18:59:10.658930] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-22T18:59:10.659231] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-22T18:59:10.659273] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-22T18:59:10.659729] [DEBUG] [LOCAL ] GHI: Trimmed 11240 records to 7763 (keeping 200 days of data) [2025-10-22T18:59:10.705048] [DEBUG] [LOCAL ] GHI: Primary data saved (7763 records). [2025-10-22T18:59:10.705186] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-22T18:59:10.705306] [INFO ] [MAIN ] Update Progress: 931/2367 symbols completed. GHI took 31.4s. Estimated remaining: 3h 3m 42s. Rate: 7.8 symbols/min [2025-10-22T18:59:10.871168] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:10.901165] [DEBUG] [LOCAL ] GIB: Loaded 31436 existing records from primary storage. [2025-10-22T18:59:10.901418] [INFO ] [MAIN ] GIB: Loaded 31436 existing records. [2025-10-22T18:59:11.072218] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:11.072407] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-22T18:59:11.072453] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-22T18:59:11.072621] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-22T18:59:11.072761] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-22T18:59:11.322990] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-22T18:59:11.418760] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:11.609511] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T18:59:12.117622] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-22T18:59:12.354720] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T18:59:12.917729] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-22T18:59:13.704468] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T18:59:13.717604] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-22T18:59:14.058292] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T18:59:14.517710] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-22T18:59:15.096426] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:59:15.123728] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T18:59:15.317697] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-22T18:59:15.938485] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T18:59:16.117701] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-22T18:59:16.917735] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-22T18:59:17.495128] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T18:59:17.717716] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-22T18:59:17.910389] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T18:59:18.517745] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-22T18:59:18.883200] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T18:59:19.283762] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T18:59:19.317618] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-22T18:59:19.884793] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-22T18:59:20.117700] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-22T18:59:20.917633] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-22T18:59:21.156299] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T18:59:21.717756] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-22T18:59:21.864221] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T18:59:22.517634] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-22T18:59:22.738531] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T18:59:22.739901] [INFO ] [REMOTE ] GHLD: Full fetch complete (5130 records). [2025-10-22T18:59:22.739968] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-22T18:59:23.094372] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-22T18:59:23.094452] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-22T18:59:23.094659] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-22T18:59:23.094724] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-22T18:59:23.095094] [DEBUG] [LOCAL ] GHLD: Trimmed 5130 records to 4327 (keeping 200 days of data) [2025-10-22T18:59:23.120690] [DEBUG] [LOCAL ] GHLD: Primary data saved (4327 records). [2025-10-22T18:59:23.120765] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-22T18:59:23.120835] [INFO ] [MAIN ] Update Progress: 932/2367 symbols completed. GHLD took 31.2s. Estimated remaining: 3h 3m 42s. Rate: 7.8 symbols/min [2025-10-22T18:59:23.294031] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:23.307341] [DEBUG] [LOCAL ] GIC: Loaded 13257 existing records from primary storage. [2025-10-22T18:59:23.307545] [INFO ] [MAIN ] GIC: Loaded 13257 existing records. [2025-10-22T18:59:23.327564] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-22T18:59:23.484795] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:23.485026] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-22T18:59:23.485080] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-22T18:59:23.485320] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-22T18:59:23.485376] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-22T18:59:23.830958] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:24.117747] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-22T18:59:24.270235] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:59:24.341554] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T18:59:24.761018] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T18:59:24.917742] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-22T18:59:25.717731] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-22T18:59:26.006210] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T18:59:26.009358] [INFO ] [REMOTE ] GHM: Full fetch complete (21956 records). [2025-10-22T18:59:26.009428] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-22T18:59:26.375497] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-22T18:59:26.375577] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-22T18:59:26.376090] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-22T18:59:26.376151] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-22T18:59:26.376826] [DEBUG] [LOCAL ] GHM: Trimmed 21956 records to 14307 (keeping 200 days of data) [2025-10-22T18:59:26.463669] [DEBUG] [LOCAL ] GHM: Primary data saved (14307 records). [2025-10-22T18:59:26.463822] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-22T18:59:26.463915] [INFO ] [MAIN ] Update Progress: 933/2367 symbols completed. GHM took 32.9s. Estimated remaining: 3h 3m 28s. Rate: 7.8 symbols/min [2025-10-22T18:59:26.527699] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-22T18:59:26.666302] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T18:59:26.669457] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:26.715706] [DEBUG] [LOCAL ] GIL: Loaded 43981 existing records from primary storage. [2025-10-22T18:59:26.716010] [INFO ] [MAIN ] GIL: Loaded 43981 existing records. [2025-10-22T18:59:26.886329] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:26.886561] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-22T18:59:26.886608] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-22T18:59:26.886819] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-22T18:59:26.886873] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-22T18:59:27.233099] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:27.317624] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-22T18:59:27.583566] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T18:59:28.117711] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-22T18:59:28.313764] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T18:59:28.917735] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-22T18:59:29.330898] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T18:59:29.717747] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-22T18:59:29.826708] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T18:59:30.517736] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-22T18:59:30.709023] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T18:59:31.317696] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-22T18:59:31.444039] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T18:59:32.117749] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-22T18:59:32.437034] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T18:59:32.441454] [INFO ] [REMOTE ] GHY: Full fetch complete (32399 records). [2025-10-22T18:59:32.441552] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-22T18:59:32.830669] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-22T18:59:32.830767] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-22T18:59:32.831341] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-22T18:59:32.831384] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-22T18:59:32.832290] [DEBUG] [LOCAL ] GHY: Trimmed 32399 records to 20840 (keeping 200 days of data) [2025-10-22T18:59:32.918111] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-22T18:59:32.956883] [DEBUG] [LOCAL ] GHY: Primary data saved (20840 records). [2025-10-22T18:59:32.956994] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-22T18:59:32.957070] [INFO ] [MAIN ] Update Progress: 934/2367 symbols completed. GHY took 26.7s. Estimated remaining: 3h 3m 18s. Rate: 7.8 symbols/min [2025-10-22T18:59:33.122188] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:33.169012] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-22T18:59:33.169303] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-10-22T18:59:33.344210] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:33.344581] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-22T18:59:33.344752] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-22T18:59:33.344984] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-22T18:59:33.345040] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-22T18:59:33.697832] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:33.718198] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-22T18:59:33.720467] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:59:33.885689] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T18:59:34.517752] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-22T18:59:35.050501] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T18:59:35.317722] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-22T18:59:35.526875] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T18:59:36.117757] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-22T18:59:36.701322] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T18:59:36.917684] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-22T18:59:37.649111] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:59:37.717612] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-22T18:59:38.372950] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T18:59:38.517751] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-22T18:59:39.186699] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T18:59:39.311123] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T18:59:39.317598] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-22T18:59:40.115738] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T18:59:40.118717] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-22T18:59:40.917702] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-22T18:59:41.717724] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-22T18:59:42.054472] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-22T18:59:42.517698] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-22T18:59:42.816918] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-10-22T18:59:43.055284] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T18:59:43.060764] [INFO ] [REMOTE ] GIB: Full fetch complete (46463 records). [2025-10-22T18:59:43.060920] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-22T18:59:43.321282] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-22T18:59:43.450453] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-22T18:59:43.450612] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-22T18:59:43.451400] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-22T18:59:43.451478] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-22T18:59:43.452604] [DEBUG] [LOCAL ] GIB: Trimmed 46463 records to 31346 (keeping 200 days of data) [2025-10-22T18:59:43.602757] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T18:59:43.676465] [DEBUG] [LOCAL ] GIB: Primary data saved (31346 records). [2025-10-22T18:59:43.676671] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-22T18:59:43.676788] [INFO ] [MAIN ] Update Progress: 935/2367 symbols completed. GIB took 33.0s. Estimated remaining: 3h 3m 15s. Rate: 7.8 symbols/min [2025-10-22T18:59:43.848678] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:43.887350] [DEBUG] [LOCAL ] GKOS: Loaded 42499 existing records from primary storage. [2025-10-22T18:59:43.887726] [INFO ] [MAIN ] GKOS: Loaded 42499 existing records. [2025-10-22T18:59:44.073601] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:44.073861] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-22T18:59:44.073910] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-22T18:59:44.074201] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-22T18:59:44.074259] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-22T18:59:44.123008] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-22T18:59:44.451398] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:44.917729] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-22T18:59:45.002743] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T18:59:45.070289] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:59:45.717714] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-22T18:59:46.063873] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T18:59:46.517695] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-22T18:59:46.676411] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T18:59:46.678751] [INFO ] [REMOTE ] GIC: Full fetch complete (19821 records). [2025-10-22T18:59:46.678827] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-22T18:59:47.035758] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-22T18:59:47.035835] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-22T18:59:47.036240] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-22T18:59:47.036278] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-22T18:59:47.036829] [DEBUG] [LOCAL ] GIC: Trimmed 19821 records to 13184 (keeping 200 days of data) [2025-10-22T18:59:47.115323] [DEBUG] [LOCAL ] GIC: Primary data saved (13184 records). [2025-10-22T18:59:47.115450] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-22T18:59:47.115531] [INFO ] [MAIN ] Update Progress: 936/2367 symbols completed. GIC took 24.0s. Estimated remaining: 3h 3m 1s. Rate: 7.8 symbols/min [2025-10-22T18:59:47.278094] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:47.313771] [DEBUG] [LOCAL ] GL: Loaded 37443 existing records from primary storage. [2025-10-22T18:59:47.314055] [INFO ] [MAIN ] GL: Loaded 37443 existing records. [2025-10-22T18:59:47.325300] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-22T18:59:47.488806] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:47.489000] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-22T18:59:47.489056] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-22T18:59:47.489272] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-22T18:59:47.489309] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-22T18:59:47.846385] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:48.063711] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T18:59:48.117715] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-22T18:59:48.853158] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:59:48.917629] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-22T18:59:49.628439] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:59:49.717745] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-22T18:59:50.522803] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-22T18:59:50.543835] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:59:51.283418] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T18:59:51.317693] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-22T18:59:51.994421] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:59:52.117707] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-22T18:59:52.917712] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-22T18:59:52.984921] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T18:59:53.717757] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-22T18:59:53.895161] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T18:59:54.153942] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T18:59:54.517697] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-22T18:59:55.317770] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-22T18:59:55.370452] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T18:59:56.093351] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T18:59:56.117620] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-22T18:59:56.917756] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-22T18:59:57.284043] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T18:59:57.672857] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T18:59:57.717760] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-22T18:59:58.459366] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T18:59:58.517634] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-22T18:59:59.317729] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-22T18:59:59.694492] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T18:59:59.736634] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T19:00:00.117743] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-22T19:00:00.917729] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-22T19:00:00.994125] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T19:00:01.213544] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T19:00:01.717886] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-22T19:00:02.517792] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-22T19:00:03.318125] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-22T19:00:03.322133] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-22T19:00:03.333254] [INFO ] [REMOTE ] GIL: Full fetch complete (62589 records). [2025-10-22T19:00:03.333500] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-22T19:00:03.749783] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T19:00:03.850824] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-22T19:00:03.850944] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-22T19:00:03.852028] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-22T19:00:03.852101] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-22T19:00:03.853688] [DEBUG] [LOCAL ] GIL: Trimmed 62589 records to 43951 (keeping 200 days of data) [2025-10-22T19:00:04.121018] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-22T19:00:04.129217] [DEBUG] [LOCAL ] GIL: Primary data saved (43951 records). [2025-10-22T19:00:04.129307] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-22T19:00:04.130109] [INFO ] [MAIN ] Update Progress: 937/2367 symbols completed. GIL took 37.7s. Estimated remaining: 3h 3m 8s. Rate: 7.8 symbols/min [2025-10-22T19:00:04.315201] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:04.315365] [DEBUG] [LOCAL ] GLOB: No existing data file found in primary storage. [2025-10-22T19:00:04.315402] [WARN ] [MAIN ] GLOB: No existing data found, performing full refresh instead. [2025-10-22T19:00:04.315535] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-22T19:00:04.315596] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-22T19:00:04.315698] [DEBUG] [LOCAL ] GLOB: No primary data file found to delete. [2025-10-22T19:00:04.315745] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-22T19:00:04.673566] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:04.925381] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-22T19:00:04.932571] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-22T19:00:05.717781] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-22T19:00:06.262301] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-10-22T19:00:06.517690] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-22T19:00:07.297350] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T19:00:07.317614] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-22T19:00:07.419489] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-10-22T19:00:07.672057] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-22T19:00:08.036735] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T19:00:08.117632] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-22T19:00:08.876019] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T19:00:08.917701] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-22T19:00:09.680374] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:00:09.717621] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-22T19:00:10.517781] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-22T19:00:10.783557] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T19:00:10.790062] [INFO ] [REMOTE ] GL: Full fetch complete (54933 records). [2025-10-22T19:00:10.790179] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-22T19:00:11.173830] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-22T19:00:11.173911] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-22T19:00:11.174626] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-22T19:00:11.174700] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-22T19:00:11.175775] [DEBUG] [LOCAL ] GL: Trimmed 54933 records to 37380 (keeping 200 days of data) [2025-10-22T19:00:11.352619] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-22T19:00:11.438770] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T19:00:11.452907] [DEBUG] [LOCAL ] GL: Primary data saved (37380 records). [2025-10-22T19:00:11.453351] [INFO ] [MAIN ] GL: Full history saved. [2025-10-22T19:00:11.453444] [INFO ] [MAIN ] Update Progress: 938/2367 symbols completed. GL took 24.3s. Estimated remaining: 3h 2m 59s. Rate: 7.8 symbols/min [2025-10-22T19:00:11.624774] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:11.634989] [DEBUG] [LOCAL ] GLP: Loaded 9296 existing records from primary storage. [2025-10-22T19:00:11.635156] [INFO ] [MAIN ] GLP: Loaded 9296 existing records. [2025-10-22T19:00:11.813224] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:11.813596] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-22T19:00:11.813761] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-22T19:00:11.814173] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-22T19:00:11.814301] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-22T19:00:12.012137] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T19:00:12.123837] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-22T19:00:12.201558] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:12.917639] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-22T19:00:13.674367] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T19:00:13.719239] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-22T19:00:13.748515] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:00:13.746395] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-22T19:00:14.517717] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-22T19:00:15.317764] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-22T19:00:15.339376] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:00:16.117690] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-22T19:00:16.315100] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-22T19:00:16.322548] [INFO ] [REMOTE ] GKOS: Full fetch complete (60680 records). [2025-10-22T19:00:16.322796] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-22T19:00:16.773540] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-22T19:00:16.773722] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-22T19:00:16.774777] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-22T19:00:16.774915] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-22T19:00:16.776388] [DEBUG] [LOCAL ] GKOS: Trimmed 60680 records to 42465 (keeping 200 days of data) [2025-10-22T19:00:16.907358] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T19:00:16.918689] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-22T19:00:17.067968] [DEBUG] [LOCAL ] GKOS: Primary data saved (42465 records). [2025-10-22T19:00:17.068149] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-22T19:00:17.068253] [INFO ] [MAIN ] Update Progress: 939/2367 symbols completed. GKOS took 33.4s. Estimated remaining: 3h 2m 48s. Rate: 7.8 symbols/min [2025-10-22T19:00:17.229585] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T19:00:17.309490] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:17.363014] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-22T19:00:17.363402] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-10-22T19:00:17.573388] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:17.573621] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-22T19:00:17.573702] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-22T19:00:17.574067] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-22T19:00:17.574125] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-22T19:00:17.722785] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-22T19:00:17.988627] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:18.517742] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-22T19:00:19.317706] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-22T19:00:19.499566] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T19:00:19.506784] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-22T19:00:19.977716] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-22T19:00:20.117698] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-22T19:00:20.917707] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-22T19:00:21.467604] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-22T19:00:21.717714] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-22T19:00:21.964043] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T19:00:22.384030] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-22T19:00:22.517711] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-22T19:00:23.317713] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-22T19:00:23.957038] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:00:23.971451] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-22T19:00:23.971711] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-22T19:00:24.132318] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-22T19:00:24.208091] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-22T19:00:24.565730] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-22T19:00:24.565833] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-22T19:00:24.566868] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-22T19:00:24.566933] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-22T19:00:24.568462] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 53675 (keeping 200 days of data) [2025-10-22T19:00:24.887048] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-10-22T19:00:24.887163] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-22T19:00:24.887237] [INFO ] [MAIN ] Update Progress: 940/2367 symbols completed. GIS took 51.9s. Estimated remaining: 3h 2m 41s. Rate: 7.8 symbols/min [2025-10-22T19:00:24.941982] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-22T19:00:25.057751] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:25.105385] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-22T19:00:25.105704] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-22T19:00:25.216518] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T19:00:25.297314] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:25.297508] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-22T19:00:25.297557] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-22T19:00:25.297791] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-22T19:00:25.297847] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-22T19:00:25.688759] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:25.682839] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-22T19:00:25.717618] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-22T19:00:26.517697] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-22T19:00:27.282894] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T19:00:27.326533] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-22T19:00:27.346147] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T19:00:27.531086] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-22T19:00:28.117697] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-22T19:00:28.917749] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-22T19:00:29.516931] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T19:00:29.717714] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-22T19:00:29.894893] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T19:00:30.517628] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-22T19:00:30.528467] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T19:00:30.991728] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T19:00:31.317715] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-22T19:00:31.963494] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:00:32.117617] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-22T19:00:32.195803] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T19:00:32.917698] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-22T19:00:33.717619] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-22T19:00:34.100544] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T19:00:34.102470] [INFO ] [REMOTE ] GLP: Full fetch complete (14257 records). [2025-10-22T19:00:34.102540] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-22T19:00:34.499264] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-22T19:00:34.487503] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-22T19:00:34.508568] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-22T19:00:34.509270] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-22T19:00:34.509349] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-22T19:00:34.510118] [DEBUG] [LOCAL ] GLP: Trimmed 14257 records to 9234 (keeping 200 days of data) [2025-10-22T19:00:34.532508] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-22T19:00:34.566356] [DEBUG] [LOCAL ] GLP: Primary data saved (9234 records). [2025-10-22T19:00:34.566535] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-22T19:00:34.566619] [INFO ] [MAIN ] Update Progress: 941/2367 symbols completed. GLP took 23.1s. Estimated remaining: 3h 2m 36s. Rate: 7.8 symbols/min [2025-10-22T19:00:34.756277] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:34.803987] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-22T19:00:34.804338] [INFO ] [MAIN ] GME: Loaded 53781 existing records. [2025-10-22T19:00:34.978416] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:34.978612] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-22T19:00:34.978685] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-22T19:00:34.978962] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-22T19:00:34.979001] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-22T19:00:35.334304] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:35.329897] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-22T19:00:35.788936] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T19:00:36.117731] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-22T19:00:36.642157] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-22T19:00:36.917630] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-22T19:00:37.210844] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T19:00:37.218811] [INFO ] [REMOTE ] GLOB: Full fetch complete (66253 records). [2025-10-22T19:00:37.218927] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-22T19:00:37.609027] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-22T19:00:37.609122] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-22T19:00:37.610040] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-22T19:00:37.610115] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-22T19:00:37.611612] [DEBUG] [LOCAL ] GLOB: Trimmed 66253 records to 48049 (keeping 200 days of data) [2025-10-22T19:00:37.723678] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-22T19:00:37.726063] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T19:00:37.932729] [DEBUG] [LOCAL ] GLOB: Primary data saved (48049 records). [2025-10-22T19:00:37.932861] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-22T19:00:37.932930] [INFO ] [MAIN ] Update Progress: 942/2367 symbols completed. GLOB took 33.8s. Estimated remaining: 3h 2m 22s. Rate: 7.8 symbols/min [2025-10-22T19:00:38.098117] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:38.160088] [DEBUG] [LOCAL ] GMED: Loaded 48118 existing records from primary storage. [2025-10-22T19:00:38.160413] [INFO ] [MAIN ] GMED: Loaded 48118 existing records. [2025-10-22T19:00:38.332081] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:38.332294] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-22T19:00:38.332352] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-22T19:00:38.332553] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-22T19:00:38.332607] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-22T19:00:38.522771] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-22T19:00:38.725501] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:39.158845] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-22T19:00:39.317701] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-22T19:00:39.908619] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-22T19:00:40.117633] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-22T19:00:40.695404] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T19:00:40.853786] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T19:00:40.917617] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-22T19:00:41.717625] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-22T19:00:41.750817] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:00:42.517745] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-22T19:00:42.816580] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T19:00:43.317704] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-22T19:00:44.117629] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-22T19:00:44.255203] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-22T19:00:44.430913] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T19:00:44.631101] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T19:00:44.917699] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-22T19:00:45.717639] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-22T19:00:46.217841] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T19:00:46.517747] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-22T19:00:47.317741] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-22T19:00:47.506870] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-22T19:00:47.970741] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-22T19:00:48.117613] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-22T19:00:48.214205] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:00:48.917623] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-22T19:00:49.018382] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:00:49.717732] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-22T19:00:50.526628] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-22T19:00:50.529462] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-22T19:00:50.539214] [INFO ] [REMOTE ] GLW: Full fetch complete (77798 records). [2025-10-22T19:00:50.539336] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-22T19:00:50.928031] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T19:00:50.976494] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-22T19:00:50.976878] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-22T19:00:50.978162] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-22T19:00:50.978227] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-22T19:00:50.979509] [DEBUG] [LOCAL ] GLW: Trimmed 77798 records to 53635 (keeping 200 days of data) [2025-10-22T19:00:51.295235] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-10-22T19:00:51.295441] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-22T19:00:51.295531] [INFO ] [MAIN ] Update Progress: 943/2367 symbols completed. GLW took 34.2s. Estimated remaining: 3h 2m 23s. Rate: 7.8 symbols/min [2025-10-22T19:00:51.326554] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-22T19:00:51.471314] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:51.504801] [DEBUG] [LOCAL ] GMRE: Loaded 36650 existing records from primary storage. [2025-10-22T19:00:51.505071] [INFO ] [MAIN ] GMRE: Loaded 36650 existing records. [2025-10-22T19:00:51.686066] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:51.686289] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-22T19:00:51.686400] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-22T19:00:51.686693] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-22T19:00:51.686750] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-22T19:00:51.962542] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-22T19:00:52.092958] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:52.117634] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-22T19:00:52.917759] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-22T19:00:52.971145] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:00:53.222265] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-22T19:00:53.317770] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:00:53.415077] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-22T19:00:53.423740] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-22T19:00:53.423901] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-22T19:00:53.722952] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-22T19:00:53.804524] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-22T19:00:53.804610] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-22T19:00:53.805556] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-22T19:00:53.805617] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-22T19:00:53.807058] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-22T19:00:54.124959] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-22T19:00:54.125094] [INFO ] [MAIN ] GM: Full history saved. [2025-10-22T19:00:54.125198] [INFO ] [MAIN ] Update Progress: 944/2367 symbols completed. GM took 29.2s. Estimated remaining: 3h 2m 8s. Rate: 7.8 symbols/min [2025-10-22T19:00:54.288253] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:54.306038] [DEBUG] [LOCAL ] GNE: Loaded 18119 existing records from primary storage. [2025-10-22T19:00:54.306265] [INFO ] [MAIN ] GNE: Loaded 18119 existing records. [2025-10-22T19:00:54.478378] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:54.478567] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-22T19:00:54.478684] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-22T19:00:54.478883] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-22T19:00:54.478952] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-22T19:00:54.522722] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-22T19:00:54.849499] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:55.317704] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-22T19:00:55.346946] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T19:00:56.117760] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-22T19:00:56.141212] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T19:00:56.917700] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-22T19:00:57.098134] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-22T19:00:57.125423] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T19:00:57.380322] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T19:00:57.717712] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-22T19:00:58.517765] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-22T19:00:59.055884] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:00:59.069833] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T19:00:59.317716] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-22T19:01:00.117693] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-22T19:01:00.749445] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:01:00.917622] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-22T19:01:01.717632] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-22T19:01:02.015908] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T19:01:02.517703] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-22T19:01:02.557901] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:01:02.572283] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T19:01:03.317731] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-22T19:01:04.117709] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-22T19:01:04.188723] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:01:04.321568] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T19:01:04.917697] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-22T19:01:05.605369] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:01:05.717620] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-22T19:01:06.517666] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-22T19:01:06.665318] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:01:06.820831] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T19:01:07.317638] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-22T19:01:07.779636] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T19:01:08.117697] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-22T19:01:08.917696] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-22T19:01:09.057830] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:01:09.067873] [INFO ] [REMOTE ] GMED: Full fetch complete (70113 records). [2025-10-22T19:01:09.068254] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-22T19:01:09.262946] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T19:01:09.491734] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-22T19:01:09.491830] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-22T19:01:09.492703] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-22T19:01:09.492767] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-22T19:01:09.494186] [DEBUG] [LOCAL ] GMED: Trimmed 70113 records to 48094 (keeping 200 days of data) [2025-10-22T19:01:09.735757] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-22T19:01:09.765310] [DEBUG] [LOCAL ] GMED: Primary data saved (48094 records). [2025-10-22T19:01:09.765488] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-22T19:01:09.766113] [INFO ] [MAIN ] Update Progress: 945/2367 symbols completed. GMED took 31.8s. Estimated remaining: 3h 2m 12s. Rate: 7.8 symbols/min [2025-10-22T19:01:09.930052] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:09.969316] [DEBUG] [LOCAL ] GNK: Loaded 39630 existing records from primary storage. [2025-10-22T19:01:09.969575] [INFO ] [MAIN ] GNK: Loaded 39630 existing records. [2025-10-22T19:01:10.148664] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:10.148880] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-22T19:01:10.148934] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-22T19:01:10.149170] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-22T19:01:10.149224] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-22T19:01:10.490720] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:10.517609] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-22T19:01:11.317636] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-22T19:01:11.362116] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T19:01:11.604380] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-22T19:01:11.663522] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T19:01:12.117636] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-22T19:01:12.346131] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T19:01:12.917798] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-22T19:01:13.449622] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T19:01:13.717711] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-22T19:01:14.517711] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-22T19:01:15.296578] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T19:01:15.317607] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-22T19:01:15.487932] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-22T19:01:15.488939] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T19:01:16.117746] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-22T19:01:16.723918] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T19:01:16.862343] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T19:01:16.866040] [INFO ] [REMOTE ] GNE: Full fetch complete (22564 records). [2025-10-22T19:01:16.866253] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-22T19:01:16.927069] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-22T19:01:17.299142] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-22T19:01:17.299276] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-22T19:01:17.300062] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-22T19:01:17.300131] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-22T19:01:17.300926] [DEBUG] [LOCAL ] GNE: Trimmed 22564 records to 18074 (keeping 200 days of data) [2025-10-22T19:01:17.414240] [DEBUG] [LOCAL ] GNE: Primary data saved (18074 records). [2025-10-22T19:01:17.414384] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-22T19:01:17.414465] [INFO ] [MAIN ] Update Progress: 946/2367 symbols completed. GNE took 23.3s. Estimated remaining: 3h 2m 5s. Rate: 7.8 symbols/min [2025-10-22T19:01:17.586911] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:17.628675] [DEBUG] [LOCAL ] GNL: Loaded 46556 existing records from primary storage. [2025-10-22T19:01:17.628976] [INFO ] [MAIN ] GNL: Loaded 46556 existing records. [2025-10-22T19:01:17.723949] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-22T19:01:17.804964] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:17.805169] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-22T19:01:17.805216] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-22T19:01:17.805478] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-22T19:01:17.805534] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-22T19:01:18.154965] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:18.517699] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-22T19:01:19.317794] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-22T19:01:19.355799] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T19:01:19.488564] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-22T19:01:19.616688] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T19:01:20.117747] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-22T19:01:20.797910] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T19:01:20.917640] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-22T19:01:21.547092] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T19:01:21.551814] [INFO ] [REMOTE ] GMRE: Full fetch complete (51970 records). [2025-10-22T19:01:21.551952] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-22T19:01:21.722871] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-22T19:01:21.979895] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-22T19:01:21.979990] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-22T19:01:21.980780] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-22T19:01:21.980843] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-22T19:01:21.982017] [DEBUG] [LOCAL ] GMRE: Trimmed 51970 records to 36438 (keeping 200 days of data) [2025-10-22T19:01:22.198589] [DEBUG] [LOCAL ] GMRE: Primary data saved (36438 records). [2025-10-22T19:01:22.198742] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-22T19:01:22.198829] [INFO ] [MAIN ] Update Progress: 947/2367 symbols completed. GMRE took 30.9s. Estimated remaining: 3h 1m 53s. Rate: 7.8 symbols/min [2025-10-22T19:01:22.365790] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:22.408344] [DEBUG] [LOCAL ] GNRC: Loaded 45398 existing records from primary storage. [2025-10-22T19:01:22.408623] [INFO ] [MAIN ] GNRC: Loaded 45398 existing records. [2025-10-22T19:01:22.520428] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-22T19:01:22.599308] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T19:01:22.650035] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:22.650634] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-22T19:01:22.650727] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-22T19:01:22.650948] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-22T19:01:22.651005] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-22T19:01:23.003006] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:23.317754] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-22T19:01:24.094077] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:01:24.122816] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-22T19:01:24.143757] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-22T19:01:24.924073] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-22T19:01:24.940218] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:01:25.455760] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T19:01:25.717725] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-22T19:01:26.475151] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T19:01:26.517622] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-22T19:01:27.317698] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-22T19:01:27.845546] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T19:01:28.117703] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-22T19:01:28.281707] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-22T19:01:28.290465] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-22T19:01:28.290595] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-22T19:01:28.677589] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-22T19:01:28.677711] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-22T19:01:28.678680] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-22T19:01:28.678742] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-22T19:01:28.680161] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 53781 (keeping 200 days of data) [2025-10-22T19:01:28.945144] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-22T19:01:28.995521] [DEBUG] [LOCAL ] GME: Primary data saved (53781 records). [2025-10-22T19:01:28.995755] [INFO ] [MAIN ] GME: Full history saved. [2025-10-22T19:01:28.995844] [INFO ] [MAIN ] Update Progress: 948/2367 symbols completed. GME took 54.4s. Estimated remaining: 3h 1m 44s. Rate: 7.8 symbols/min [2025-10-22T19:01:29.127367] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:01:29.205218] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:29.213625] [DEBUG] [LOCAL ] GNT: Loaded 8676 existing records from primary storage. [2025-10-22T19:01:29.213829] [INFO ] [MAIN ] GNT: Loaded 8676 existing records. [2025-10-22T19:01:29.389319] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:29.389514] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-22T19:01:29.389560] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-22T19:01:29.389763] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-22T19:01:29.389818] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-22T19:01:29.725605] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-22T19:01:29.770706] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:01:29.806073] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:30.517717] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-22T19:01:30.815120] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T19:01:31.317705] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-22T19:01:31.378772] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T19:01:32.077423] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:01:32.087945] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T19:01:32.089977] [INFO ] [REMOTE ] GNK: Full fetch complete (57298 records). [2025-10-22T19:01:32.090579] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-22T19:01:32.122817] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-22T19:01:32.477360] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-22T19:01:32.477455] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-22T19:01:32.478269] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-22T19:01:32.478334] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-22T19:01:32.479569] [DEBUG] [LOCAL ] GNK: Trimmed 57298 records to 39524 (keeping 200 days of data) [2025-10-22T19:01:32.712533] [DEBUG] [LOCAL ] GNK: Primary data saved (39524 records). [2025-10-22T19:01:32.712720] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-22T19:01:32.713241] [INFO ] [MAIN ] Update Progress: 949/2367 symbols completed. GNK took 22.9s. Estimated remaining: 3h 1m 30s. Rate: 7.8 symbols/min [2025-10-22T19:01:32.884938] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:32.930173] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-22T19:01:32.933569] [DEBUG] [LOCAL ] GNW: Loaded 51379 existing records from primary storage. [2025-10-22T19:01:32.933954] [INFO ] [MAIN ] GNW: Loaded 51379 existing records. [2025-10-22T19:01:33.115031] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:33.115300] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-22T19:01:33.115365] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-22T19:01:33.115811] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-22T19:01:33.115866] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-22T19:01:33.486748] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:33.699675] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T19:01:33.717608] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-22T19:01:34.517738] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-22T19:01:34.609095] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T19:01:35.317921] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-22T19:01:35.475270] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T19:01:36.117729] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-22T19:01:36.163205] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T19:01:36.917665] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-22T19:01:37.048516] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:01:37.665449] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T19:01:37.717624] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-22T19:01:38.415635] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:01:38.517784] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-22T19:01:39.238333] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T19:01:39.317699] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-22T19:01:40.082923] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T19:01:40.117722] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-22T19:01:40.895311] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T19:01:40.919221] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-22T19:01:40.925215] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T19:01:41.543385] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T19:01:41.717726] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-22T19:01:42.465217] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T19:01:42.517708] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-22T19:01:43.317637] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-22T19:01:44.087429] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T19:01:44.117723] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-22T19:01:44.176957] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T19:01:44.917885] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T19:01:44.918013] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-22T19:01:45.717712] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-22T19:01:46.517622] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-22T19:01:46.626452] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T19:01:47.317693] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-22T19:01:47.353299] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T19:01:47.360926] [INFO ] [REMOTE ] GNL: Full fetch complete (68148 records). [2025-10-22T19:01:47.361071] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-22T19:01:47.752574] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-22T19:01:47.752693] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-22T19:01:47.754184] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-22T19:01:47.754250] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-22T19:01:47.755720] [DEBUG] [LOCAL ] GNL: Trimmed 68148 records to 46512 (keeping 200 days of data) [2025-10-22T19:01:48.026327] [DEBUG] [LOCAL ] GNL: Primary data saved (46512 records). [2025-10-22T19:01:48.026523] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-22T19:01:48.026610] [INFO ] [MAIN ] Update Progress: 950/2367 symbols completed. GNL took 30.6s. Estimated remaining: 3h 1m 34s. Rate: 7.8 symbols/min [2025-10-22T19:01:48.118127] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T19:01:48.118200] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-22T19:01:48.211474] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:48.251036] [DEBUG] [LOCAL ] GOF: Loaded 42730 existing records from primary storage. [2025-10-22T19:01:48.251355] [INFO ] [MAIN ] GOF: Loaded 42730 existing records. [2025-10-22T19:01:48.433197] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:48.433560] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-22T19:01:48.433638] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-22T19:01:48.444630] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-22T19:01:48.449877] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-22T19:01:48.555588] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T19:01:48.826027] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:48.917626] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-22T19:01:49.717667] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-22T19:01:49.927550] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T19:01:50.339628] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T19:01:50.517752] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-22T19:01:50.678803] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T19:01:51.317755] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-22T19:01:52.117705] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-22T19:01:52.525407] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T19:01:52.907880] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T19:01:52.917630] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-22T19:01:53.717748] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-22T19:01:53.781959] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:01:53.784456] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T19:01:54.517751] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-22T19:01:55.317756] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-22T19:01:55.595322] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T19:01:55.603359] [INFO ] [REMOTE ] GNRC: Full fetch complete (65712 records). [2025-10-22T19:01:55.603524] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-22T19:01:56.011008] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-22T19:01:56.011127] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-22T19:01:56.012079] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-22T19:01:56.012145] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-22T19:01:56.013810] [DEBUG] [LOCAL ] GNRC: Trimmed 65712 records to 45359 (keeping 200 days of data) [2025-10-22T19:01:56.117666] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-22T19:01:56.304682] [DEBUG] [LOCAL ] GNRC: Primary data saved (45359 records). [2025-10-22T19:01:56.304975] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-22T19:01:56.305077] [INFO ] [MAIN ] Update Progress: 951/2367 symbols completed. GNRC took 34.1s. Estimated remaining: 3h 1m 27s. Rate: 7.8 symbols/min [2025-10-22T19:01:56.507828] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:56.540275] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T19:01:56.575469] [DEBUG] [LOCAL ] GOLF: Loaded 30473 existing records from primary storage. [2025-10-22T19:01:56.575773] [INFO ] [MAIN ] GOLF: Loaded 30473 existing records. [2025-10-22T19:01:56.754178] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:56.754437] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-22T19:01:56.754484] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-22T19:01:56.754787] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-22T19:01:56.754843] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-22T19:01:56.930171] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-22T19:01:57.128834] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:57.428953] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-22T19:01:57.445524] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T19:01:57.448260] [INFO ] [REMOTE ] GNT: Full fetch complete (11455 records). [2025-10-22T19:01:57.448330] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-22T19:01:57.722796] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-22T19:01:57.837268] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-22T19:01:57.837354] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-22T19:01:57.837630] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-22T19:01:57.837730] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-22T19:01:57.838319] [DEBUG] [LOCAL ] GNT: Trimmed 11455 records to 8632 (keeping 200 days of data) [2025-10-22T19:01:57.896074] [DEBUG] [LOCAL ] GNT: Primary data saved (8632 records). [2025-10-22T19:01:57.896220] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-22T19:01:57.896303] [INFO ] [MAIN ] Update Progress: 952/2367 symbols completed. GNT took 28.9s. Estimated remaining: 3h 1m 10s. Rate: 7.8 symbols/min [2025-10-22T19:01:58.071669] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:58.113851] [DEBUG] [LOCAL ] GOOS: Loaded 44145 existing records from primary storage. [2025-10-22T19:01:58.114177] [INFO ] [MAIN ] GOOS: Loaded 44145 existing records. [2025-10-22T19:01:58.288814] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:58.289054] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-22T19:01:58.289101] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-22T19:01:58.289284] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-22T19:01:58.289321] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-22T19:01:58.528458] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-22T19:01:58.666424] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:58.931306] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T19:01:59.317631] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-22T19:01:59.579104] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T19:01:59.613008] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T19:02:00.117718] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-22T19:02:00.917732] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-22T19:02:01.238442] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T19:02:01.717736] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-22T19:02:02.362102] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-22T19:02:02.517787] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-22T19:02:03.317811] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-22T19:02:03.971044] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-22T19:02:04.117708] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-22T19:02:04.787858] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (3.07 seconds). [2025-10-22T19:02:04.818575] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-22T19:02:04.917753] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-22T19:02:05.479109] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-22T19:02:05.717730] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-22T19:02:06.517805] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-22T19:02:06.807387] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-22T19:02:07.238518] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-22T19:02:07.317666] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-22T19:02:07.797104] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T19:02:07.877534] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T19:02:08.117743] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-22T19:02:08.331238] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T19:02:08.917759] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-22T19:02:09.717767] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-22T19:02:10.182086] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T19:02:10.192471] [INFO ] [REMOTE ] GNW: Full fetch complete (73888 records). [2025-10-22T19:02:10.192755] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-22T19:02:10.522796] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-22T19:02:10.609494] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-22T19:02:10.609617] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-22T19:02:10.610818] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-22T19:02:10.610887] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-22T19:02:10.612921] [DEBUG] [LOCAL ] GNW: Trimmed 73888 records to 51369 (keeping 200 days of data) [2025-10-22T19:02:10.940240] [DEBUG] [LOCAL ] GNW: Primary data saved (51369 records). [2025-10-22T19:02:10.940467] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-22T19:02:10.941193] [INFO ] [MAIN ] Update Progress: 953/2367 symbols completed. GNW took 38.2s. Estimated remaining: 3h 1m 10s. Rate: 7.8 symbols/min [2025-10-22T19:02:11.140197] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:11.175709] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-22T19:02:11.216400] [DEBUG] [LOCAL ] GOTU: Loaded 37040 existing records from primary storage. [2025-10-22T19:02:11.216704] [INFO ] [MAIN ] GOTU: Loaded 37040 existing records. [2025-10-22T19:02:11.322860] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-22T19:02:11.452580] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:11.470423] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-22T19:02:11.472872] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T19:02:11.480807] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-22T19:02:11.481824] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-22T19:02:11.481886] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-22T19:02:11.867897] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:12.117773] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-22T19:02:12.632265] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-22T19:02:12.917797] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-22T19:02:13.161266] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T19:02:13.717738] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-22T19:02:13.838226] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T19:02:14.267515] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T19:02:14.517699] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-22T19:02:15.021024] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T19:02:15.317709] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-22T19:02:16.084661] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T19:02:16.117615] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-22T19:02:16.917630] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-22T19:02:17.311486] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:02:17.717700] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-22T19:02:18.141304] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T19:02:18.430852] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T19:02:18.517705] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-22T19:02:19.016947] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T19:02:19.317709] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-22T19:02:19.769165] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T19:02:20.117725] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-22T19:02:20.917742] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-22T19:02:21.259893] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T19:02:21.268001] [INFO ] [REMOTE ] GOF: Full fetch complete (62674 records). [2025-10-22T19:02:21.268160] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-22T19:02:21.641596] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T19:02:21.701250] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-22T19:02:21.701351] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-22T19:02:21.702218] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-22T19:02:21.702288] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-22T19:02:21.703735] [DEBUG] [LOCAL ] GOF: Trimmed 62674 records to 42713 (keeping 200 days of data) [2025-10-22T19:02:21.759300] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-22T19:02:21.988394] [DEBUG] [LOCAL ] GOF: Primary data saved (42713 records). [2025-10-22T19:02:21.988539] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-22T19:02:21.988623] [INFO ] [MAIN ] Update Progress: 954/2367 symbols completed. GOF took 34.0s. Estimated remaining: 3h 1m 8s. Rate: 7.8 symbols/min [2025-10-22T19:02:22.185007] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:22.232604] [DEBUG] [LOCAL ] GPC: Loaded 45944 existing records from primary storage. [2025-10-22T19:02:22.233042] [INFO ] [MAIN ] GPC: Loaded 45944 existing records. [2025-10-22T19:02:22.460735] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:22.461034] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-22T19:02:22.461100] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-22T19:02:22.461356] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-22T19:02:22.461425] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-22T19:02:22.524262] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-22T19:02:22.831678] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T19:02:22.916388] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:23.317742] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-22T19:02:23.464331] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T19:02:23.620346] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T19:02:24.117738] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-22T19:02:24.917666] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-22T19:02:25.268573] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T19:02:25.623144] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:02:25.717700] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-22T19:02:25.963447] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T19:02:26.517735] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-22T19:02:27.317741] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-22T19:02:27.493237] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T19:02:27.501010] [INFO ] [REMOTE ] GOOS: Full fetch complete (64671 records). [2025-10-22T19:02:27.501455] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-22T19:02:27.950196] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-22T19:02:27.950324] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-22T19:02:27.951406] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-22T19:02:27.951479] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-22T19:02:27.953337] [DEBUG] [LOCAL ] GOOS: Trimmed 64671 records to 44038 (keeping 200 days of data) [2025-10-22T19:02:28.132813] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-22T19:02:28.239518] [DEBUG] [LOCAL ] GOOS: Primary data saved (44038 records). [2025-10-22T19:02:28.239681] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-22T19:02:28.239779] [INFO ] [MAIN ] Update Progress: 955/2367 symbols completed. GOOS took 30.3s. Estimated remaining: 3h 0m 58s. Rate: 7.8 symbols/min [2025-10-22T19:02:28.412249] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:28.445723] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-22T19:02:28.461331] [DEBUG] [LOCAL ] GPI: Loaded 14752 existing records from primary storage. [2025-10-22T19:02:28.461570] [INFO ] [MAIN ] GPI: Loaded 14752 existing records. [2025-10-22T19:02:28.645310] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:28.645975] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-22T19:02:28.646079] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-22T19:02:28.646272] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-22T19:02:28.646340] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-22T19:02:28.829391] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T19:02:28.885963] [INFO ] [REMOTE ] GOLF: Full fetch complete (45310 records). [2025-10-22T19:02:28.905378] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-22T19:02:28.927939] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-22T19:02:29.279850] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:29.496934] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-22T19:02:29.497039] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-22T19:02:29.497741] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-22T19:02:29.497803] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-22T19:02:29.498738] [DEBUG] [LOCAL ] GOLF: Trimmed 45310 records to 30311 (keeping 200 days of data) [2025-10-22T19:02:29.698747] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T19:02:29.721332] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-22T19:02:29.730083] [DEBUG] [LOCAL ] GOLF: Primary data saved (30311 records). [2025-10-22T19:02:29.730447] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-22T19:02:29.730539] [INFO ] [MAIN ] Update Progress: 956/2367 symbols completed. GOLF took 33.4s. Estimated remaining: 3h 0m 41s. Rate: 7.8 symbols/min [2025-10-22T19:02:29.905478] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:29.912569] [DEBUG] [LOCAL ] GPJA: Loaded 4112 existing records from primary storage. [2025-10-22T19:02:29.912834] [INFO ] [MAIN ] GPJA: Loaded 4112 existing records. [2025-10-22T19:02:30.100939] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:30.101189] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-22T19:02:30.101237] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-22T19:02:30.101393] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-22T19:02:30.101449] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-22T19:02:30.523527] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-22T19:02:30.563996] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:30.775133] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T19:02:30.895045] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T19:02:31.317753] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-22T19:02:31.673570] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T19:02:32.074031] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T19:02:32.117770] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-22T19:02:32.917670] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-22T19:02:33.495874] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T19:02:33.717622] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-22T19:02:33.813435] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T19:02:34.517716] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-22T19:02:35.317630] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-22T19:02:35.405794] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:02:35.875884] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T19:02:36.001168] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T19:02:36.006801] [INFO ] [REMOTE ] GOTU: Full fetch complete (58322 records). [2025-10-22T19:02:36.006904] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-22T19:02:36.122718] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-22T19:02:36.398303] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-22T19:02:36.398377] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-22T19:02:36.399146] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-22T19:02:36.399206] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-22T19:02:36.400382] [DEBUG] [LOCAL ] GOTU: Trimmed 58322 records to 36876 (keeping 200 days of data) [2025-10-22T19:02:36.602910] [DEBUG] [LOCAL ] GOTU: Primary data saved (36876 records). [2025-10-22T19:02:36.603077] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-22T19:02:36.603352] [INFO ] [MAIN ] Update Progress: 957/2367 symbols completed. GOTU took 25.7s. Estimated remaining: 3h 0m 32s. Rate: 7.8 symbols/min [2025-10-22T19:02:36.917742] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-22T19:02:37.717742] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-22T19:02:37.764725] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:02:37.786235] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T19:02:38.269738] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T19:02:38.517699] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-22T19:02:39.317689] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-22T19:02:39.866028] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-22T19:02:39.965959] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T19:02:40.117668] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-22T19:02:40.917731] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-22T19:02:41.380919] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T19:02:41.717726] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-22T19:02:41.929687] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T19:02:42.366483] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T19:02:42.517701] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-22T19:02:43.168090] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T19:02:43.317692] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-22T19:02:43.886958] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T19:02:44.117690] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-22T19:02:44.917718] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-22T19:02:45.524691] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T19:02:45.584553] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T19:02:45.717696] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-22T19:02:46.517634] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-22T19:02:46.861997] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T19:02:47.317799] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-22T19:02:47.981722] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T19:02:48.023504] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T19:02:48.117743] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-22T19:02:48.917720] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-22T19:02:49.033696] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T19:02:49.717632] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-22T19:02:50.280593] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-22T19:02:50.281585] [INFO ] [REMOTE ] GPJA: Full fetch complete (6834 records). [2025-10-22T19:02:50.281676] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-22T19:02:50.527337] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-22T19:02:50.632866] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-22T19:02:50.632946] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-22T19:02:50.633118] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-22T19:02:50.633156] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-22T19:02:50.633630] [DEBUG] [LOCAL ] GPJA: Trimmed 6834 records to 4108 (keeping 200 days of data) [2025-10-22T19:02:50.657809] [DEBUG] [LOCAL ] GPJA: Primary data saved (4108 records). [2025-10-22T19:02:50.657869] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-22T19:02:50.657936] [INFO ] [MAIN ] Update Progress: 958/2367 symbols completed. GPJA took 20.9s. Estimated remaining: 3h 0m 34s. Rate: 7.8 symbols/min [2025-10-22T19:02:51.049954] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-22T19:02:51.061951] [INFO ] [REMOTE ] GPC: Full fetch complete (68689 records). [2025-10-22T19:02:51.062193] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-22T19:02:51.494316] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-22T19:02:51.494532] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-22T19:02:51.495409] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-22T19:02:51.495474] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-22T19:02:51.496789] [DEBUG] [LOCAL ] GPC: Trimmed 68689 records to 45916 (keeping 200 days of data) [2025-10-22T19:02:51.721160] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T19:02:51.729181] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-22T19:02:51.806559] [DEBUG] [LOCAL ] GPC: Primary data saved (45916 records). [2025-10-22T19:02:51.806722] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-22T19:02:51.806814] [INFO ] [MAIN ] Update Progress: 959/2367 symbols completed. GPC took 29.8s. Estimated remaining: 3h 0m 16s. Rate: 7.8 symbols/min [2025-10-22T19:02:52.590492] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T19:02:52.593843] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-22T19:02:53.546696] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T19:02:53.550545] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-22T19:02:54.634447] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T19:02:54.637760] [INFO ] [REMOTE ] GPI: Full fetch complete (21842 records). [2025-10-22T19:02:54.637840] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-22T19:02:55.030362] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-22T19:02:55.030453] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-22T19:02:55.031183] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-22T19:02:55.031248] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-22T19:02:55.032209] [DEBUG] [LOCAL ] GPI: Trimmed 21842 records to 14678 (keeping 200 days of data) [2025-10-22T19:02:55.123957] [DEBUG] [LOCAL ] GPI: Primary data saved (14678 records). [2025-10-22T19:02:55.124115] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-22T19:02:55.124201] [INFO ] [MAIN ] Update Progress: 960/2367 symbols completed. GPI took 26.9s. Estimated remaining: 3h 0m 2s. Rate: 7.8 symbols/min [2025-10-22T19:02:55.760239] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:55.759394] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:55.842404] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:55.860719] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:55.897478] [DEBUG] [LOCAL ] GPOR: Loaded 23342 existing records from primary storage. [2025-10-22T19:02:55.898374] [DEBUG] [LOCAL ] GPMT: Loaded 26021 existing records from primary storage. [2025-10-22T19:02:55.911283] [INFO ] [MAIN ] GPOR: Loaded 23342 existing records. [2025-10-22T19:02:55.917026] [INFO ] [MAIN ] GPMT: Loaded 26021 existing records. [2025-10-22T19:02:56.163418] [DEBUG] [LOCAL ] GPK: Loaded 52780 existing records from primary storage. [2025-10-22T19:02:56.224357] [INFO ] [MAIN ] GPK: Loaded 52780 existing records. [2025-10-22T19:02:56.254973] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:56.272998] [DEBUG] [LOCAL ] GPN: Loaded 51923 existing records from primary storage. [2025-10-22T19:02:56.292861] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-22T19:02:56.313723] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-22T19:02:56.298228] [INFO ] [MAIN ] GPN: Loaded 51923 existing records. [2025-10-22T19:02:56.434699] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-22T19:02:56.437337] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-22T19:02:56.579085] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:56.620436] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-22T19:02:56.641163] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-22T19:02:56.791689] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-22T19:02:56.851344] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:56.847955] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-22T19:02:56.872051] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-22T19:02:56.916405] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:56.949008] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-22T19:02:57.016008] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-22T19:02:57.042382] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-22T19:02:57.036990] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-22T19:02:57.062868] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-22T19:02:57.093049] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-22T19:02:57.092954] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-22T19:02:57.548853] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:57.672883] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-22T19:02:58.038582] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:58.099314] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-22T19:02:58.160835] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:58.173193] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-22T19:02:58.256413] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:58.256767] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-22T19:02:59.173144] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T19:02:59.179141] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-22T19:02:59.245904] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T19:02:59.251201] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-22T19:02:59.512638] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T19:02:59.522917] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-22T19:02:59.966314] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T19:02:59.976352] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-22T19:02:59.995605] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:03:00.117708] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-22T19:03:00.402369] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T19:03:00.917698] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-22T19:03:01.389811] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T19:03:01.423050] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T19:03:01.636378] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:03:01.717918] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-22T19:03:02.054452] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T19:03:02.517784] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-22T19:03:03.317770] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-22T19:03:03.459141] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T19:03:04.117750] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-22T19:03:04.148062] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T19:03:04.917723] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-22T19:03:05.024457] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T19:03:05.071180] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T19:03:05.717762] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-22T19:03:06.517720] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-22T19:03:06.627460] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:03:06.786099] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T19:03:07.317732] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-22T19:03:07.744764] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T19:03:08.117711] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-22T19:03:08.917635] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-22T19:03:09.119695] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T19:03:09.241025] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T19:03:09.717764] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-22T19:03:10.519752] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-22T19:03:10.525776] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T19:03:11.318200] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T19:03:11.318308] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-22T19:03:11.715880] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T19:03:12.117745] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-22T19:03:12.773575] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:03:12.917718] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-22T19:03:13.717665] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-22T19:03:13.885873] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:03:13.913629] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T19:03:14.517715] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-22T19:03:15.128397] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T19:03:15.317636] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-22T19:03:15.617474] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T19:03:16.117784] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-22T19:03:16.685791] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T19:03:16.917632] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-22T19:03:17.717731] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-22T19:03:17.881571] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:03:17.954059] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T19:03:18.517757] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-22T19:03:19.317704] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-22T19:03:19.505819] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:03:20.117629] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-22T19:03:20.320778] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T19:03:20.394149] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T19:03:20.399413] [INFO ] [REMOTE ] GPOR: Full fetch complete (34870 records). [2025-10-22T19:03:20.399605] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-22T19:03:20.800505] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-22T19:03:20.800675] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-22T19:03:20.801479] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-22T19:03:20.801524] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-22T19:03:20.802699] [DEBUG] [LOCAL ] GPOR: Trimmed 34870 records to 23317 (keeping 200 days of data) [2025-10-22T19:03:20.919725] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-22T19:03:20.967604] [DEBUG] [LOCAL ] GPOR: Primary data saved (23317 records). [2025-10-22T19:03:20.967886] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-22T19:03:20.968044] [INFO ] [MAIN ] Update Progress: 961/2367 symbols completed. GPOR took 25.8s. Estimated remaining: 3h 0m 21s. Rate: 7.8 symbols/min [2025-10-22T19:03:21.166310] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:21.208800] [DEBUG] [LOCAL ] GPRK: Loaded 39820 existing records from primary storage. [2025-10-22T19:03:21.209291] [INFO ] [MAIN ] GPRK: Loaded 39820 existing records. [2025-10-22T19:03:21.404473] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:21.404901] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-22T19:03:21.404962] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-22T19:03:21.405222] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-22T19:03:21.405280] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-22T19:03:21.718967] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-22T19:03:21.796987] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:21.947030] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T19:03:22.356730] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-22T19:03:22.517689] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-22T19:03:23.317631] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-22T19:03:23.678704] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:03:23.687428] [INFO ] [REMOTE ] GPK: Full fetch complete (76083 records). [2025-10-22T19:03:23.687607] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-22T19:03:24.107744] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-22T19:03:24.107914] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-22T19:03:24.114206] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-22T19:03:24.119676] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-22T19:03:24.121722] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T19:03:24.121381] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-22T19:03:24.126099] [INFO ] [REMOTE ] GPMT: Full fetch complete (36370 records). [2025-10-22T19:03:24.126301] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-22T19:03:24.147465] [DEBUG] [LOCAL ] GPK: Trimmed 76083 records to 52780 (keeping 200 days of data) [2025-10-22T19:03:24.722237] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-22T19:03:24.725412] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-22T19:03:24.749402] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-22T19:03:24.754253] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-22T19:03:24.760198] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-22T19:03:24.774928] [DEBUG] [LOCAL ] GPMT: Trimmed 36370 records to 25950 (keeping 200 days of data) [2025-10-22T19:03:24.938809] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-22T19:03:24.985428] [DEBUG] [LOCAL ] GPK: Primary data saved (52780 records). [2025-10-22T19:03:24.986314] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-22T19:03:24.986911] [INFO ] [MAIN ] Update Progress: 962/2367 symbols completed. GPK took 29.9s. Estimated remaining: 3h 0m 8s. Rate: 7.8 symbols/min [2025-10-22T19:03:25.190159] [DEBUG] [LOCAL ] GPMT: Primary data saved (25950 records). [2025-10-22T19:03:25.209675] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-22T19:03:25.215034] [INFO ] [MAIN ] Update Progress: 963/2367 symbols completed. GPMT took 30.1s. Estimated remaining: 2h 59m 50s. Rate: 7.8 symbols/min [2025-10-22T19:03:25.283125] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:25.422156] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:25.435579] [DEBUG] [LOCAL ] GRBK: Loaded 26836 existing records from primary storage. [2025-10-22T19:03:25.435961] [INFO ] [MAIN ] GRBK: Loaded 26836 existing records. [2025-10-22T19:03:25.487697] [DEBUG] [LOCAL ] GRC: Loaded 9277 existing records from primary storage. [2025-10-22T19:03:25.503913] [INFO ] [MAIN ] GRC: Loaded 9277 existing records. [2025-10-22T19:03:25.785814] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:25.810344] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-22T19:03:25.810127] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:25.810680] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-22T19:03:25.810601] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-22T19:03:25.811105] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-22T19:03:25.811207] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-22T19:03:25.811311] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-22T19:03:25.811407] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-22T19:03:25.816808] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-22T19:03:26.253016] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T19:03:26.354791] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-22T19:03:26.601233] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:26.617633] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-22T19:03:26.637955] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:26.786199] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T19:03:27.317766] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-22T19:03:27.839711] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T19:03:27.899610] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T19:03:28.101339] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T19:03:28.117625] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-22T19:03:28.913837] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T19:03:28.917603] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-22T19:03:29.717715] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-22T19:03:29.751682] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T19:03:30.517672] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-22T19:03:30.972215] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T19:03:31.317747] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-22T19:03:31.966981] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T19:03:32.117634] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-22T19:03:32.917777] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-22T19:03:33.020638] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:03:33.029589] [INFO ] [REMOTE ] GPN: Full fetch complete (75058 records). [2025-10-22T19:03:33.029814] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-22T19:03:33.447833] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-22T19:03:33.447928] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-22T19:03:33.449141] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-22T19:03:33.449207] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-22T19:03:33.450727] [DEBUG] [LOCAL ] GPN: Trimmed 75058 records to 51867 (keeping 200 days of data) [2025-10-22T19:03:33.729861] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-22T19:03:33.775602] [DEBUG] [LOCAL ] GPN: Primary data saved (51867 records). [2025-10-22T19:03:33.775801] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-22T19:03:33.775905] [INFO ] [MAIN ] Update Progress: 964/2367 symbols completed. GPN took 38.6s. Estimated remaining: 2h 59m 43s. Rate: 7.8 symbols/min [2025-10-22T19:03:33.905576] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T19:03:33.981091] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:34.000145] [DEBUG] [LOCAL ] GRDN: Loaded 21184 existing records from primary storage. [2025-10-22T19:03:34.000436] [INFO ] [MAIN ] GRDN: Loaded 21184 existing records. [2025-10-22T19:03:34.174433] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:34.174693] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-22T19:03:34.174752] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-22T19:03:34.174942] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-22T19:03:34.174982] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-22T19:03:34.524746] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-22T19:03:34.529440] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:34.718983] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T19:03:34.791803] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T19:03:35.317626] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-22T19:03:35.463232] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-22T19:03:36.117696] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-22T19:03:36.848295] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:03:36.917620] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-22T19:03:37.285804] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T19:03:37.717758] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-22T19:03:38.459421] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T19:03:38.484995] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T19:03:38.517628] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-22T19:03:39.319122] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-22T19:03:39.324060] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T19:03:40.117697] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-22T19:03:40.812956] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:03:40.826245] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T19:03:40.917672] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-22T19:03:41.717777] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-22T19:03:42.517702] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-22T19:03:42.790768] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T19:03:43.072552] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T19:03:43.317672] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-22T19:03:43.652823] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:03:44.117614] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-22T19:03:44.422018] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T19:03:44.917672] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-22T19:03:45.717707] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-22T19:03:46.409465] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T19:03:46.517734] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-22T19:03:46.869044] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T19:03:47.212904] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-22T19:03:47.317626] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-22T19:03:47.649803] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T19:03:48.117702] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-22T19:03:48.506329] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T19:03:48.514212] [INFO ] [REMOTE ] GPRK: Full fetch complete (58436 records). [2025-10-22T19:03:48.514365] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-22T19:03:48.906802] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-22T19:03:48.906951] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-22T19:03:48.907855] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-22T19:03:48.907934] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-22T19:03:48.922084] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-22T19:03:48.926313] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T19:03:48.932518] [DEBUG] [LOCAL ] GPRK: Trimmed 58436 records to 39851 (keeping 200 days of data) [2025-10-22T19:03:49.159796] [DEBUG] [LOCAL ] GPRK: Primary data saved (39851 records). [2025-10-22T19:03:49.159954] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-22T19:03:49.160057] [INFO ] [MAIN ] Update Progress: 965/2367 symbols completed. GPRK took 28.2s. Estimated remaining: 2h 59m 47s. Rate: 7.8 symbols/min [2025-10-22T19:03:49.324506] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:49.360593] [DEBUG] [LOCAL ] GRMN: Loaded 39939 existing records from primary storage. [2025-10-22T19:03:49.360907] [INFO ] [MAIN ] GRMN: Loaded 39939 existing records. [2025-10-22T19:03:49.534527] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:49.534796] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-22T19:03:49.534852] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-22T19:03:49.535037] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-22T19:03:49.535075] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-22T19:03:49.727285] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-22T19:03:49.839228] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T19:03:49.903061] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:50.517730] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-22T19:03:51.254265] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T19:03:51.317638] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-22T19:03:52.117736] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-22T19:03:52.361066] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:03:52.726530] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T19:03:52.731108] [INFO ] [REMOTE ] GRBK: Full fetch complete (39984 records). [2025-10-22T19:03:52.731200] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-22T19:03:52.900074] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T19:03:52.919018] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-22T19:03:53.118051] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-22T19:03:53.118128] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-22T19:03:53.118807] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-22T19:03:53.118870] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-22T19:03:53.119846] [DEBUG] [LOCAL ] GRBK: Trimmed 39984 records to 26691 (keeping 200 days of data) [2025-10-22T19:03:53.270810] [DEBUG] [LOCAL ] GRBK: Primary data saved (26691 records). [2025-10-22T19:03:53.270935] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-22T19:03:53.271022] [INFO ] [MAIN ] Update Progress: 966/2367 symbols completed. GRBK took 28.3s. Estimated remaining: 2h 59m 34s. Rate: 7.8 symbols/min [2025-10-22T19:03:53.434390] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:53.478380] [DEBUG] [LOCAL ] GRND: Loaded 50203 existing records from primary storage. [2025-10-22T19:03:53.478703] [INFO ] [MAIN ] GRND: Loaded 50203 existing records. [2025-10-22T19:03:53.653147] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:53.653365] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-22T19:03:53.653419] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-22T19:03:53.653595] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-22T19:03:53.653632] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-22T19:03:53.725221] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-22T19:03:54.053510] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:54.277412] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T19:03:54.517638] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-22T19:03:55.257371] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T19:03:55.260095] [INFO ] [REMOTE ] GRC: Full fetch complete (13470 records). [2025-10-22T19:03:55.260181] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-22T19:03:55.326020] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-22T19:03:55.629288] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-22T19:03:55.629364] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-22T19:03:55.629672] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-22T19:03:55.629734] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-22T19:03:55.630197] [DEBUG] [LOCAL ] GRC: Trimmed 13470 records to 9268 (keeping 200 days of data) [2025-10-22T19:03:55.685069] [DEBUG] [LOCAL ] GRC: Primary data saved (9268 records). [2025-10-22T19:03:55.685234] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-22T19:03:55.685366] [INFO ] [MAIN ] Update Progress: 967/2367 symbols completed. GRC took 30.5s. Estimated remaining: 2h 59m 19s. Rate: 7.8 symbols/min [2025-10-22T19:03:55.856985] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:55.893817] [DEBUG] [LOCAL ] GRNT: Loaded 34016 existing records from primary storage. [2025-10-22T19:03:55.894276] [INFO ] [MAIN ] GRNT: Loaded 34016 existing records. [2025-10-22T19:03:56.076385] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:56.076715] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-22T19:03:56.076804] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-22T19:03:56.077072] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-22T19:03:56.077207] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-22T19:03:56.120502] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-22T19:03:56.247622] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T19:03:56.476268] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T19:03:56.504430] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:56.917719] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-22T19:03:57.717751] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-22T19:03:58.311034] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-22T19:03:58.484671] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T19:03:58.517704] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-22T19:03:58.929195] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:03:59.317667] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-22T19:04:00.117628] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-22T19:04:00.147049] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:04:00.421815] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:04:00.917704] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-22T19:04:01.717745] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-22T19:04:02.335766] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-22T19:04:02.517718] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-22T19:04:03.317789] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-22T19:04:04.025104] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-10-22T19:04:04.092689] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-22T19:04:04.117618] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-22T19:04:04.917674] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-22T19:04:04.957561] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-22T19:04:05.716949] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T19:04:05.722113] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-22T19:04:05.723458] [INFO ] [REMOTE ] GRDN: Full fetch complete (26531 records). [2025-10-22T19:04:05.723550] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-22T19:04:06.050762] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-22T19:04:06.137184] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-22T19:04:06.137266] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-22T19:04:06.137812] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-22T19:04:06.137873] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-22T19:04:06.138618] [DEBUG] [LOCAL ] GRDN: Trimmed 26531 records to 21258 (keeping 200 days of data) [2025-10-22T19:04:06.261421] [DEBUG] [LOCAL ] GRDN: Primary data saved (21258 records). [2025-10-22T19:04:06.261575] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-22T19:04:06.261695] [INFO ] [MAIN ] Update Progress: 968/2367 symbols completed. GRDN took 32.5s. Estimated remaining: 2h 59m 15s. Rate: 7.8 symbols/min [2025-10-22T19:04:06.440708] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:06.450823] [DEBUG] [LOCAL ] GROV: Loaded 8701 existing records from primary storage. [2025-10-22T19:04:06.451044] [INFO ] [MAIN ] GROV: Loaded 8701 existing records. [2025-10-22T19:04:06.523486] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-22T19:04:06.624451] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:06.624677] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-22T19:04:06.624736] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-22T19:04:06.624914] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-22T19:04:06.624968] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-22T19:04:06.967390] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:07.317777] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-22T19:04:07.419061] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-22T19:04:08.117710] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-22T19:04:08.205152] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-22T19:04:08.595974] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T19:04:08.754799] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T19:04:08.917738] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-22T19:04:09.717738] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-22T19:04:09.983077] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T19:04:10.213463] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T19:04:10.517696] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-22T19:04:10.590445] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T19:04:11.317631] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-22T19:04:12.117632] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-22T19:04:12.540188] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T19:04:12.917732] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-22T19:04:13.032451] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T19:04:13.059566] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T19:04:13.717703] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-22T19:04:14.261387] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T19:04:14.517727] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-22T19:04:15.317632] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-22T19:04:15.393474] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:04:16.117740] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-22T19:04:16.313571] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T19:04:16.586051] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T19:04:16.917736] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-22T19:04:17.644369] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:04:17.717638] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-22T19:04:17.957469] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T19:04:18.461676] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T19:04:18.517673] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-22T19:04:19.317733] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-22T19:04:19.524084] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:04:20.117724] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-22T19:04:20.813894] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T19:04:20.917667] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-22T19:04:21.717702] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-22T19:04:21.905066] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:04:22.517739] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-22T19:04:22.876070] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T19:04:23.065469] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T19:04:23.317667] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-22T19:04:24.117720] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-22T19:04:24.608422] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T19:04:24.912584] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T19:04:24.918323] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-22T19:04:24.920063] [INFO ] [REMOTE ] GRMN: Full fetch complete (59556 records). [2025-10-22T19:04:24.920218] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-22T19:04:25.303120] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-22T19:04:25.303209] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-22T19:04:25.304044] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-22T19:04:25.304106] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-22T19:04:25.305271] [DEBUG] [LOCAL ] GRMN: Trimmed 59556 records to 39812 (keeping 200 days of data) [2025-10-22T19:04:25.559746] [DEBUG] [LOCAL ] GRMN: Primary data saved (39812 records). [2025-10-22T19:04:25.559894] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-22T19:04:25.559973] [INFO ] [MAIN ] Update Progress: 969/2367 symbols completed. GRMN took 36.4s. Estimated remaining: 2h 59m 24s. Rate: 7.8 symbols/min [2025-10-22T19:04:25.666692] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T19:04:25.713523] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T19:04:25.718803] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-22T19:04:25.782967] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:25.790205] [DEBUG] [LOCAL ] GRX: Loaded 4844 existing records from primary storage. [2025-10-22T19:04:25.790392] [INFO ] [MAIN ] GRX: Loaded 4844 existing records. [2025-10-22T19:04:25.963181] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:25.963415] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-22T19:04:25.963476] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-22T19:04:25.963691] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-22T19:04:25.963749] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-22T19:04:26.330107] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:26.517701] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-22T19:04:27.126962] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T19:04:27.317725] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-22T19:04:27.473889] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T19:04:27.855467] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-22T19:04:27.857102] [INFO ] [REMOTE ] GROV: Full fetch complete (13646 records). [2025-10-22T19:04:27.857192] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-22T19:04:28.122828] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-22T19:04:28.215894] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-22T19:04:28.216008] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-22T19:04:28.216336] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-22T19:04:28.216416] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-22T19:04:28.216915] [DEBUG] [LOCAL ] GROV: Trimmed 13646 records to 8616 (keeping 200 days of data) [2025-10-22T19:04:28.263397] [DEBUG] [LOCAL ] GROV: Primary data saved (8616 records). [2025-10-22T19:04:28.263492] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-22T19:04:28.263571] [INFO ] [MAIN ] Update Progress: 970/2367 symbols completed. GROV took 22.0s. Estimated remaining: 2h 59m 9s. Rate: 7.8 symbols/min [2025-10-22T19:04:28.428007] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:28.472832] [DEBUG] [LOCAL ] GS: Loaded 51777 existing records from primary storage. [2025-10-22T19:04:28.473122] [INFO ] [MAIN ] GS: Loaded 51777 existing records. [2025-10-22T19:04:28.644597] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:28.644819] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-22T19:04:28.644865] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-22T19:04:28.645127] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-22T19:04:28.645163] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-22T19:04:28.938916] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-22T19:04:29.018991] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:29.558761] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T19:04:29.717745] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-22T19:04:30.169037] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T19:04:30.177751] [INFO ] [REMOTE ] GRND: Full fetch complete (71824 records). [2025-10-22T19:04:30.177896] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-22T19:04:30.307822] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T19:04:30.526389] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-22T19:04:30.573747] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-22T19:04:30.573838] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-22T19:04:30.574764] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-22T19:04:30.574837] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-22T19:04:30.576222] [DEBUG] [LOCAL ] GRND: Trimmed 71824 records to 50191 (keeping 200 days of data) [2025-10-22T19:04:30.860717] [DEBUG] [LOCAL ] GRND: Primary data saved (50191 records). [2025-10-22T19:04:30.860853] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-22T19:04:30.861417] [INFO ] [MAIN ] Update Progress: 971/2367 symbols completed. GRND took 37.6s. Estimated remaining: 2h 58m 54s. Rate: 7.8 symbols/min [2025-10-22T19:04:31.026832] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:31.064982] [DEBUG] [LOCAL ] GSBD: Loaded 39579 existing records from primary storage. [2025-10-22T19:04:31.065269] [INFO ] [MAIN ] GSBD: Loaded 39579 existing records. [2025-10-22T19:04:31.241414] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:31.241625] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-22T19:04:31.241706] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-22T19:04:31.241973] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-22T19:04:31.242028] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-22T19:04:31.322786] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-22T19:04:31.597268] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:32.008637] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T19:04:32.117760] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-22T19:04:32.533385] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T19:04:32.917670] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-22T19:04:33.620848] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T19:04:33.717731] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-22T19:04:34.304928] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T19:04:34.372959] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T19:04:34.517709] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-22T19:04:35.317712] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-22T19:04:35.349214] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T19:04:36.117740] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-22T19:04:36.917701] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-22T19:04:37.495837] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-22T19:04:37.501736] [INFO ] [REMOTE ] GRNT: Full fetch complete (48355 records). [2025-10-22T19:04:37.501856] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-22T19:04:37.718561] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-22T19:04:37.735010] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:04:37.923689] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-22T19:04:37.923776] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-22T19:04:37.924517] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-22T19:04:37.924558] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-22T19:04:37.925549] [DEBUG] [LOCAL ] GRNT: Trimmed 48355 records to 33953 (keeping 200 days of data) [2025-10-22T19:04:38.117616] [DEBUG] [LOCAL ] GRNT: Primary data saved (33953 records). [2025-10-22T19:04:38.117786] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-22T19:04:38.117874] [INFO ] [MAIN ] Update Progress: 972/2367 symbols completed. GRNT took 42.4s. Estimated remaining: 2h 58m 46s. Rate: 7.8 symbols/min [2025-10-22T19:04:38.297448] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:38.345367] [DEBUG] [LOCAL ] GSK: Loaded 53512 existing records from primary storage. [2025-10-22T19:04:38.345814] [INFO ] [MAIN ] GSK: Loaded 53512 existing records. [2025-10-22T19:04:38.518694] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-22T19:04:38.519063] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T19:04:38.545384] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:38.545867] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-22T19:04:38.545919] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-22T19:04:38.546136] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-22T19:04:38.546189] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-22T19:04:38.911348] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:38.941193] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-22T19:04:39.317712] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-22T19:04:40.104029] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:04:40.117609] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-22T19:04:40.917675] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-22T19:04:41.625736] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-22T19:04:41.717637] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-22T19:04:41.843289] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:04:42.073731] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-22T19:04:42.517669] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-22T19:04:43.122391] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-22T19:04:43.317674] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-22T19:04:43.975164] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T19:04:44.117690] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-22T19:04:44.828396] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T19:04:44.917723] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-22T19:04:45.237368] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T19:04:45.683592] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T19:04:45.685039] [INFO ] [REMOTE ] GRX: Full fetch complete (6558 records). [2025-10-22T19:04:45.685111] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-22T19:04:45.723329] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-22T19:04:46.045152] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-22T19:04:46.045227] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-22T19:04:46.045398] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-22T19:04:46.045437] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-22T19:04:46.045841] [DEBUG] [LOCAL ] GRX: Trimmed 6558 records to 4839 (keeping 200 days of data) [2025-10-22T19:04:46.073831] [DEBUG] [LOCAL ] GRX: Primary data saved (4839 records). [2025-10-22T19:04:46.073944] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-22T19:04:46.074020] [INFO ] [MAIN ] Update Progress: 973/2367 symbols completed. GRX took 20.5s. Estimated remaining: 2h 58m 39s. Rate: 7.8 symbols/min [2025-10-22T19:04:46.238571] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:46.267735] [DEBUG] [LOCAL ] GSL: Loaded 33081 existing records from primary storage. [2025-10-22T19:04:46.268039] [INFO ] [MAIN ] GSL: Loaded 33081 existing records. [2025-10-22T19:04:46.440495] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:46.440712] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-22T19:04:46.440767] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-22T19:04:46.440996] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-22T19:04:46.441051] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-22T19:04:46.522885] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-22T19:04:46.790693] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:47.317742] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-22T19:04:48.059146] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-22T19:04:48.117634] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-22T19:04:48.509584] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T19:04:48.809673] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:04:48.917675] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-22T19:04:49.484143] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T19:04:49.717753] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-22T19:04:50.517712] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-22T19:04:51.317722] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-22T19:04:52.356929] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (3.44 seconds). [2025-10-22T19:04:52.368060] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-22T19:04:52.434556] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-22T19:04:52.675576] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-22T19:04:52.917708] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-22T19:04:53.093120] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T19:04:53.717717] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-22T19:04:54.517705] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-22T19:04:54.802844] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T19:04:54.914078] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-22T19:04:55.317712] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-22T19:04:55.753036] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T19:04:56.109222] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-22T19:04:56.120000] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-22T19:04:56.667914] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-22T19:04:56.917675] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-22T19:04:57.717734] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-22T19:04:58.351878] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-22T19:04:58.517736] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-22T19:04:59.317746] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-22T19:04:59.515972] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-22T19:04:59.524280] [INFO ] [REMOTE ] GSBD: Full fetch complete (58536 records). [2025-10-22T19:04:59.524418] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-22T19:04:59.898385] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-22T19:04:59.898483] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-22T19:04:59.899363] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-22T19:04:59.899434] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-22T19:04:59.900715] [DEBUG] [LOCAL ] GSBD: Trimmed 58536 records to 39527 (keeping 200 days of data) [2025-10-22T19:05:00.139713] [DEBUG] [LOCAL ] GSBD: Primary data saved (39527 records). [2025-10-22T19:05:00.139855] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-22T19:05:00.140685] [INFO ] [MAIN ] Update Progress: 974/2367 symbols completed. GSBD took 29.3s. Estimated remaining: 2h 58m 40s. Rate: 7.8 symbols/min [2025-10-22T19:05:00.309764] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:00.331026] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T19:05:00.338857] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-22T19:05:00.383294] [DEBUG] [LOCAL ] GTES: Loaded 50305 existing records from primary storage. [2025-10-22T19:05:00.383615] [INFO ] [MAIN ] GTES: Loaded 50305 existing records. [2025-10-22T19:05:00.572273] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:00.572796] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-22T19:05:00.572869] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-22T19:05:00.573112] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-22T19:05:00.573180] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-22T19:05:01.140818] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:01.141305] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-22T19:05:01.321956] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (3.60 seconds). [2025-10-22T19:05:01.717728] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-22T19:05:02.101035] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T19:05:02.199603] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-10-22T19:05:02.517747] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-22T19:05:03.317734] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-22T19:05:03.571144] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-22T19:05:04.117714] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-22T19:05:05.499009] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (3.78 seconds). [2025-10-22T19:05:05.510011] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-22T19:05:05.601270] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (3.08 seconds). [2025-10-22T19:05:05.625038] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T19:05:05.717671] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-22T19:05:06.517752] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-22T19:05:07.421449] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (3.30 seconds). [2025-10-22T19:05:07.431363] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-22T19:05:08.100344] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-22T19:05:08.117704] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-22T19:05:08.544796] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (3.03 seconds). [2025-10-22T19:05:08.917675] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-22T19:05:09.919121] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (3.40 seconds). [2025-10-22T19:05:09.930889] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-22T19:05:10.043155] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-22T19:05:10.517720] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-22T19:05:11.635006] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (3.52 seconds). [2025-10-22T19:05:11.643811] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-22T19:05:12.289705] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-22T19:05:12.302307] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-22T19:05:12.884076] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (3.97 seconds). [2025-10-22T19:05:12.893760] [INFO ] [REMOTE ] GS: Full fetch complete (75847 records). [2025-10-22T19:05:12.894028] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-22T19:05:13.334990] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-22T19:05:13.335261] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-22T19:05:13.336771] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-22T19:05:13.337037] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-22T19:05:13.354272] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T19:05:13.360101] [DEBUG] [LOCAL ] GS: Trimmed 75847 records to 51777 (keeping 200 days of data) [2025-10-22T19:05:13.391242] [INFO ] [REMOTE ] GSL: Full fetch complete (48242 records). [2025-10-22T19:05:13.393564] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-10-22T19:05:13.393740] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-22T19:05:13.537275] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-22T19:05:14.115373] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-22T19:05:14.146758] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-22T19:05:14.155627] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-22T19:05:14.156224] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-22T19:05:14.186530] [DEBUG] [LOCAL ] GSL: Trimmed 48242 records to 32919 (keeping 200 days of data) [2025-10-22T19:05:14.202815] [DEBUG] [LOCAL ] GS: Primary data saved (51777 records). [2025-10-22T19:05:14.203376] [INFO ] [MAIN ] GS: Full history saved. [2025-10-22T19:05:14.203796] [INFO ] [MAIN ] Update Progress: 975/2367 symbols completed. GS took 45.9s. Estimated remaining: 2h 58m 41s. Rate: 7.8 symbols/min [2025-10-22T19:05:14.594946] [DEBUG] [LOCAL ] GSL: Primary data saved (32919 records). [2025-10-22T19:05:14.611961] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-22T19:05:14.612105] [INFO ] [MAIN ] Update Progress: 976/2367 symbols completed. GSL took 28.5s. Estimated remaining: 2h 58m 23s. Rate: 7.8 symbols/min [2025-10-22T19:05:14.618515] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:14.807623] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:14.859306] [DEBUG] [LOCAL ] GTLS: Loaded 43183 existing records from primary storage. [2025-10-22T19:05:14.860126] [INFO ] [MAIN ] GTLS: Loaded 43183 existing records. [2025-10-22T19:05:14.996270] [DEBUG] [LOCAL ] GTN: Loaded 44864 existing records from primary storage. [2025-10-22T19:05:15.013424] [INFO ] [MAIN ] GTN: Loaded 44864 existing records. [2025-10-22T19:05:15.156399] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:15.195315] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-22T19:05:15.199409] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-22T19:05:15.256940] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-22T19:05:15.282362] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-22T19:05:15.281924] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:15.283020] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-22T19:05:15.288597] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-22T19:05:15.347921] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-22T19:05:15.374927] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-22T19:05:15.542011] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (3.24 seconds). [2025-10-22T19:05:15.654712] [INFO ] [REMOTE ] GSK: Full fetch complete (77635 records). [2025-10-22T19:05:15.670607] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-22T19:05:15.701636] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-22T19:05:16.011364] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-22T19:05:16.477629] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:16.560171] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-22T19:05:16.571260] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:16.583425] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-22T19:05:16.694105] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-22T19:05:16.694223] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-22T19:05:16.695730] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-22T19:05:16.695806] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-22T19:05:16.698031] [DEBUG] [LOCAL ] GSK: Trimmed 77635 records to 53511 (keeping 200 days of data) [2025-10-22T19:05:17.062836] [DEBUG] [LOCAL ] GSK: Primary data saved (53511 records). [2025-10-22T19:05:17.063040] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-22T19:05:17.063150] [INFO ] [MAIN ] Update Progress: 977/2367 symbols completed. GSK took 38.9s. Estimated remaining: 2h 58m 8s. Rate: 7.8 symbols/min [2025-10-22T19:05:17.243001] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:17.276259] [DEBUG] [LOCAL ] GTY: Loaded 30068 existing records from primary storage. [2025-10-22T19:05:17.276636] [INFO ] [MAIN ] GTY: Loaded 30068 existing records. [2025-10-22T19:05:17.483722] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:17.484057] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-22T19:05:17.484117] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-22T19:05:17.484409] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-22T19:05:17.484468] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-22T19:05:17.874612] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:17.875111] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-22T19:05:17.910876] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T19:05:17.923136] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-22T19:05:18.640170] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T19:05:18.649783] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-22T19:05:18.753720] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-22T19:05:18.763167] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-22T19:05:18.937971] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T19:05:19.317798] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-22T19:05:19.716018] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:05:19.972135] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T19:05:20.117742] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-22T19:05:20.409632] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T19:05:20.802532] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-22T19:05:20.917718] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-22T19:05:21.717766] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-22T19:05:22.209362] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T19:05:22.517745] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-22T19:05:23.317750] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-22T19:05:23.649969] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-22T19:05:23.943731] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-22T19:05:24.117732] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-22T19:05:24.917718] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-22T19:05:25.111506] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-22T19:05:25.418832] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-22T19:05:25.526436] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T19:05:25.717750] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-22T19:05:26.517745] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-22T19:05:26.649328] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:05:27.322790] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-22T19:05:27.337000] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T19:05:27.820955] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T19:05:28.117738] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-22T19:05:28.917701] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-22T19:05:29.286350] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:05:29.294773] [INFO ] [REMOTE ] GTES: Full fetch complete (73889 records). [2025-10-22T19:05:29.294920] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-22T19:05:29.716750] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-22T19:05:29.716589] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T19:05:29.722868] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-22T19:05:29.723962] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-22T19:05:29.724107] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-22T19:05:29.722698] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-22T19:05:29.726886] [DEBUG] [LOCAL ] GTES: Trimmed 73889 records to 50288 (keeping 200 days of data) [2025-10-22T19:05:30.019806] [DEBUG] [LOCAL ] GTES: Primary data saved (50288 records). [2025-10-22T19:05:30.019960] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-22T19:05:30.020834] [INFO ] [MAIN ] Update Progress: 978/2367 symbols completed. GTES took 29.9s. Estimated remaining: 2h 58m 8s. Rate: 7.8 symbols/min [2025-10-22T19:05:30.218455] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:30.233817] [DEBUG] [LOCAL ] GUG: Loaded 12192 existing records from primary storage. [2025-10-22T19:05:30.234053] [INFO ] [MAIN ] GUG: Loaded 12192 existing records. [2025-10-22T19:05:30.469939] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:30.470287] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-22T19:05:30.470456] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-22T19:05:30.470813] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-22T19:05:30.470931] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-22T19:05:30.522969] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-22T19:05:30.634066] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:05:30.913759] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:31.186092] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T19:05:31.317631] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-22T19:05:31.732462] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:05:32.117749] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-22T19:05:32.331740] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T19:05:32.917746] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-22T19:05:33.717628] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-22T19:05:33.879153] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T19:05:34.139808] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T19:05:34.517765] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-22T19:05:35.284573] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:05:35.317626] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-22T19:05:35.851751] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T19:05:36.117765] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-22T19:05:36.908699] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T19:05:36.917604] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-22T19:05:36.996359] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T19:05:37.717771] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-22T19:05:38.505914] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T19:05:38.517606] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-22T19:05:38.545904] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T19:05:39.317669] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-22T19:05:39.409912] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T19:05:40.117725] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-22T19:05:40.922806] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-22T19:05:40.938107] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T19:05:41.171575] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T19:05:41.177802] [INFO ] [REMOTE ] GTY: Full fetch complete (43843 records). [2025-10-22T19:05:41.177954] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-22T19:05:41.597863] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-22T19:05:41.597950] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-22T19:05:41.598625] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-22T19:05:41.598878] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-22T19:05:41.599955] [DEBUG] [LOCAL ] GTY: Trimmed 43843 records to 30006 (keeping 200 days of data) [2025-10-22T19:05:41.716526] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:05:41.722559] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-22T19:05:41.801346] [DEBUG] [LOCAL ] GTY: Primary data saved (30006 records). [2025-10-22T19:05:41.801502] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-22T19:05:41.801587] [INFO ] [MAIN ] Update Progress: 979/2367 symbols completed. GTY took 24.7s. Estimated remaining: 2h 58m 6s. Rate: 7.8 symbols/min [2025-10-22T19:05:41.998397] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:42.014563] [DEBUG] [LOCAL ] GUT: Loaded 15651 existing records from primary storage. [2025-10-22T19:05:42.014876] [INFO ] [MAIN ] GUT: Loaded 15651 existing records. [2025-10-22T19:05:42.210094] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:42.210371] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-22T19:05:42.210445] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-22T19:05:42.210616] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-22T19:05:42.210689] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-22T19:05:42.532318] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-22T19:05:42.574108] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:43.295065] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T19:05:43.317611] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-22T19:05:43.674635] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:05:44.117715] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-22T19:05:44.917714] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-22T19:05:45.253620] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T19:05:45.261039] [INFO ] [REMOTE ] GTLS: Full fetch complete (61576 records). [2025-10-22T19:05:45.261233] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-22T19:05:45.655286] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-22T19:05:45.655370] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-22T19:05:45.656189] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-22T19:05:45.656253] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-22T19:05:45.657514] [DEBUG] [LOCAL ] GTLS: Trimmed 61576 records to 43141 (keeping 200 days of data) [2025-10-22T19:05:45.743090] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-22T19:05:45.959512] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T19:05:45.964503] [DEBUG] [LOCAL ] GTLS: Primary data saved (43141 records). [2025-10-22T19:05:45.971100] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-22T19:05:45.971237] [INFO ] [MAIN ] Update Progress: 980/2367 symbols completed. GTLS took 31.8s. Estimated remaining: 2h 57m 53s. Rate: 7.8 symbols/min [2025-10-22T19:05:45.966855] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T19:05:46.153723] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:46.185866] [DEBUG] [LOCAL ] GVA: Loaded 32612 existing records from primary storage. [2025-10-22T19:05:46.186156] [INFO ] [MAIN ] GVA: Loaded 32612 existing records. [2025-10-22T19:05:46.364546] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:46.364976] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-22T19:05:46.365024] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-22T19:05:46.365206] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-22T19:05:46.365243] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-22T19:05:46.518181] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-22T19:05:46.727232] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:46.855724] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T19:05:47.317736] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-22T19:05:48.117743] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-22T19:05:48.227907] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T19:05:48.254722] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T19:05:48.917633] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-22T19:05:49.045916] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T19:05:49.717702] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-22T19:05:49.792309] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T19:05:50.516395] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T19:05:50.519314] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-22T19:05:51.317745] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-22T19:05:51.931522] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T19:05:52.117753] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-22T19:05:52.226829] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T19:05:52.229122] [INFO ] [REMOTE ] GUG: Full fetch complete (18808 records). [2025-10-22T19:05:52.229197] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-22T19:05:52.590939] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-22T19:05:52.591018] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-22T19:05:52.591398] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-22T19:05:52.591437] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-22T19:05:52.592074] [DEBUG] [LOCAL ] GUG: Trimmed 18808 records to 12168 (keeping 200 days of data) [2025-10-22T19:05:52.666179] [DEBUG] [LOCAL ] GUG: Primary data saved (12168 records). [2025-10-22T19:05:52.666326] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-22T19:05:52.666421] [INFO ] [MAIN ] Update Progress: 981/2367 symbols completed. GUG took 22.6s. Estimated remaining: 2h 57m 44s. Rate: 7.8 symbols/min [2025-10-22T19:05:52.837332] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:52.857133] [DEBUG] [LOCAL ] GWH: Loaded 19825 existing records from primary storage. [2025-10-22T19:05:52.857388] [INFO ] [MAIN ] GWH: Loaded 19825 existing records. [2025-10-22T19:05:52.920867] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-22T19:05:53.039120] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:53.039428] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-22T19:05:53.039549] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-22T19:05:53.039751] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-22T19:05:53.039806] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-22T19:05:53.330817] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T19:05:53.410583] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:53.717752] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-22T19:05:54.396831] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T19:05:54.517744] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-22T19:05:55.317746] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-22T19:05:55.367993] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-22T19:05:55.375288] [INFO ] [REMOTE ] GTN: Full fetch complete (65847 records). [2025-10-22T19:05:55.375492] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-22T19:05:55.544322] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T19:05:55.805287] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-22T19:05:55.805382] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-22T19:05:55.806235] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-22T19:05:55.806300] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-22T19:05:55.807620] [DEBUG] [LOCAL ] GTN: Trimmed 65847 records to 44840 (keeping 200 days of data) [2025-10-22T19:05:56.067135] [DEBUG] [LOCAL ] GTN: Primary data saved (44840 records). [2025-10-22T19:05:56.067282] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-22T19:05:56.067369] [INFO ] [MAIN ] Update Progress: 982/2367 symbols completed. GTN took 41.4s. Estimated remaining: 2h 57m 30s. Rate: 7.8 symbols/min [2025-10-22T19:05:56.133906] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-22T19:05:56.222818] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T19:05:56.257205] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:56.294874] [DEBUG] [LOCAL ] GWRE: Loaded 39681 existing records from primary storage. [2025-10-22T19:05:56.295160] [INFO ] [MAIN ] GWRE: Loaded 39681 existing records. [2025-10-22T19:05:56.466050] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:56.466265] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-22T19:05:56.466312] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-22T19:05:56.466526] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-22T19:05:56.466580] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-22T19:05:56.812993] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:56.917612] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-22T19:05:57.639210] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T19:05:57.717635] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-22T19:05:58.250902] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T19:05:58.517713] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-22T19:05:59.117078] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T19:05:59.317672] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-22T19:05:59.333505] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:06:00.117636] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-22T19:06:00.818958] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T19:06:00.917729] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-22T19:06:01.304984] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T19:06:01.717737] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-22T19:06:02.517756] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-22T19:06:02.607603] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T19:06:02.759729] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T19:06:03.317742] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-22T19:06:03.885420] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T19:06:04.117738] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-22T19:06:04.326240] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:06:04.917746] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-22T19:06:05.555463] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T19:06:05.717736] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-22T19:06:06.430126] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T19:06:06.517713] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-22T19:06:07.101603] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T19:06:07.310599] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T19:06:07.317600] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-22T19:06:08.117729] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-22T19:06:08.394710] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T19:06:08.917747] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-22T19:06:09.416414] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T19:06:09.717778] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-22T19:06:10.115521] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T19:06:10.517635] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-22T19:06:11.317728] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-22T19:06:11.889617] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T19:06:11.981294] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-22T19:06:11.986782] [INFO ] [REMOTE ] GVA: Full fetch complete (48473 records). [2025-10-22T19:06:11.986892] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-22T19:06:12.122722] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-22T19:06:12.434161] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-22T19:06:12.434243] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-22T19:06:12.435021] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-22T19:06:12.435085] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-22T19:06:12.436144] [DEBUG] [LOCAL ] GVA: Trimmed 48473 records to 32580 (keeping 200 days of data) [2025-10-22T19:06:12.667661] [DEBUG] [LOCAL ] GVA: Primary data saved (32580 records). [2025-10-22T19:06:12.667822] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-22T19:06:12.667906] [INFO ] [MAIN ] Update Progress: 983/2367 symbols completed. GVA took 26.7s. Estimated remaining: 2h 57m 35s. Rate: 7.8 symbols/min [2025-10-22T19:06:12.877901] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:12.899700] [DEBUG] [LOCAL ] GWW: Loaded 19293 existing records from primary storage. [2025-10-22T19:06:12.900047] [INFO ] [MAIN ] GWW: Loaded 19293 existing records. [2025-10-22T19:06:12.934435] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-22T19:06:13.098691] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:13.098962] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-22T19:06:13.099023] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-22T19:06:13.099352] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-22T19:06:13.099432] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-22T19:06:13.217101] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T19:06:13.501977] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-22T19:06:13.505234] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:13.717724] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-22T19:06:14.122513] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T19:06:14.517731] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-22T19:06:14.886298] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T19:06:15.259295] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T19:06:15.317619] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-22T19:06:16.117754] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-22T19:06:16.397947] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T19:06:16.401155] [INFO ] [REMOTE ] GUT: Full fetch complete (22465 records). [2025-10-22T19:06:16.401293] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-22T19:06:16.782089] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-22T19:06:16.782198] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-22T19:06:16.782768] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-22T19:06:16.782832] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-22T19:06:16.783485] [DEBUG] [LOCAL ] GUT: Trimmed 22465 records to 15487 (keeping 200 days of data) [2025-10-22T19:06:16.877109] [DEBUG] [LOCAL ] GUT: Primary data saved (15487 records). [2025-10-22T19:06:16.877253] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-22T19:06:16.877331] [INFO ] [MAIN ] Update Progress: 984/2367 symbols completed. GUT took 35.1s. Estimated remaining: 2h 57m 23s. Rate: 7.8 symbols/min [2025-10-22T19:06:16.919709] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-22T19:06:17.052890] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:17.093475] [DEBUG] [LOCAL ] GXO: Loaded 46525 existing records from primary storage. [2025-10-22T19:06:17.093810] [INFO ] [MAIN ] GXO: Loaded 46525 existing records. [2025-10-22T19:06:17.279374] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:17.294233] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-22T19:06:17.295046] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-22T19:06:17.295793] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:06:17.301866] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-22T19:06:17.302586] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-22T19:06:17.685575] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:17.717620] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-22T19:06:18.146811] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T19:06:18.517765] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-22T19:06:19.290315] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:06:19.317722] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-22T19:06:19.794956] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T19:06:20.117750] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-22T19:06:20.917707] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-22T19:06:21.017573] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T19:06:21.717739] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-22T19:06:21.909155] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T19:06:21.916181] [INFO ] [REMOTE ] GWH: Full fetch complete (24648 records). [2025-10-22T19:06:21.916272] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-22T19:06:22.327615] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T19:06:22.359697] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-22T19:06:22.359813] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-22T19:06:22.360360] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-22T19:06:22.360405] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-22T19:06:22.361350] [DEBUG] [LOCAL ] GWH: Trimmed 24648 records to 20115 (keeping 200 days of data) [2025-10-22T19:06:22.472295] [DEBUG] [LOCAL ] GWH: Primary data saved (20115 records). [2025-10-22T19:06:22.472414] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-22T19:06:22.472485] [INFO ] [MAIN ] Update Progress: 985/2367 symbols completed. GWH took 29.8s. Estimated remaining: 2h 57m 12s. Rate: 7.8 symbols/min [2025-10-22T19:06:22.526068] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-22T19:06:22.646417] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:22.650252] [DEBUG] [LOCAL ] GYLD: Loaded 1549 existing records from primary storage. [2025-10-22T19:06:22.650419] [INFO ] [MAIN ] GYLD: Loaded 1549 existing records. [2025-10-22T19:06:22.823245] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:22.823471] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-22T19:06:22.823518] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-22T19:06:22.823751] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-22T19:06:22.823808] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-22T19:06:23.174524] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:23.317678] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-22T19:06:23.420470] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:06:23.658621] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-22T19:06:24.117717] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-22T19:06:24.356398] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T19:06:24.917745] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-22T19:06:25.717631] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-22T19:06:25.792771] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T19:06:26.517676] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-22T19:06:26.794614] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T19:06:26.815034] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T19:06:26.890476] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-22T19:06:27.317664] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-22T19:06:28.117668] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-22T19:06:28.340318] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T19:06:28.917671] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-22T19:06:29.645451] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:06:29.717672] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-22T19:06:30.517673] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-22T19:06:30.648690] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T19:06:31.129704] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T19:06:31.317755] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-22T19:06:31.706329] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T19:06:32.117711] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-22T19:06:32.770141] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T19:06:32.917620] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-22T19:06:33.230903] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T19:06:33.717675] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-22T19:06:34.528255] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-22T19:06:34.533148] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T19:06:34.586053] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T19:06:34.975996] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T19:06:35.317678] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-22T19:06:35.808825] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-22T19:06:36.117678] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-22T19:06:36.917724] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-22T19:06:37.580182] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T19:06:37.586249] [INFO ] [REMOTE ] GWRE: Full fetch complete (60128 records). [2025-10-22T19:06:37.586394] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-22T19:06:37.728855] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-22T19:06:37.983916] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-22T19:06:37.984010] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-22T19:06:37.985067] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-22T19:06:37.985132] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-22T19:06:37.986326] [DEBUG] [LOCAL ] GWRE: Trimmed 60128 records to 39608 (keeping 200 days of data) [2025-10-22T19:06:38.107235] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T19:06:38.112012] [INFO ] [REMOTE ] GWW: Full fetch complete (29064 records). [2025-10-22T19:06:38.113392] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-22T19:06:38.291717] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T19:06:38.525619] [DEBUG] [LOCAL ] GWRE: Primary data saved (39608 records). [2025-10-22T19:06:38.536296] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-22T19:06:38.519227] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-22T19:06:38.553901] [INFO ] [MAIN ] Update Progress: 986/2367 symbols completed. GWRE took 42.5s. Estimated remaining: 2h 57m 16s. Rate: 7.8 symbols/min [2025-10-22T19:06:38.743766] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-22T19:06:38.743913] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-22T19:06:38.745018] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-22T19:06:38.750453] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-22T19:06:38.796151] [DEBUG] [LOCAL ] GWW: Trimmed 29064 records to 19181 (keeping 200 days of data) [2025-10-22T19:06:38.815207] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:38.951028] [DEBUG] [LOCAL ] GWW: Primary data saved (19181 records). [2025-10-22T19:06:38.951286] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-22T19:06:38.951384] [INFO ] [MAIN ] Update Progress: 987/2367 symbols completed. GWW took 26.3s. Estimated remaining: 2h 56m 58s. Rate: 7.8 symbols/min [2025-10-22T19:06:39.090457] [DEBUG] [LOCAL ] H: Loaded 44375 existing records from primary storage. [2025-10-22T19:06:39.127386] [INFO ] [MAIN ] H: Loaded 44375 existing records. [2025-10-22T19:06:39.136048] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:39.347834] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-22T19:06:39.352792] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:39.354438] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-22T19:06:39.354531] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-22T19:06:39.354869] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-22T19:06:39.354929] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-22T19:06:39.478169] [DEBUG] [LOCAL ] HAE: Loaded 39378 existing records from primary storage. [2025-10-22T19:06:39.484513] [INFO ] [MAIN ] HAE: Loaded 39378 existing records. [2025-10-22T19:06:39.912254] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:39.927979] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-22T19:06:39.928092] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-22T19:06:39.954955] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-22T19:06:39.966282] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-22T19:06:39.994097] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:40.125239] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-22T19:06:40.197749] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-22T19:06:40.415709] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:40.418093] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T19:06:40.917722] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-22T19:06:41.699289] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:06:41.717617] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-22T19:06:42.377201] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T19:06:42.517733] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-22T19:06:42.899699] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:06:43.317732] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-22T19:06:43.779469] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T19:06:43.781607] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T19:06:44.117730] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-22T19:06:44.568269] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T19:06:44.917736] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-22T19:06:45.376628] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T19:06:45.717629] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-22T19:06:46.517764] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-22T19:06:47.267200] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T19:06:47.268075] [INFO ] [REMOTE ] GYLD: Full fetch complete (2094 records). [2025-10-22T19:06:47.268142] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-22T19:06:47.328581] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-22T19:06:47.544227] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T19:06:47.653051] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-22T19:06:47.653121] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-22T19:06:47.653208] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-22T19:06:47.653246] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-22T19:06:47.653549] [DEBUG] [LOCAL ] GYLD: Trimmed 2094 records to 1532 (keeping 200 days of data) [2025-10-22T19:06:47.662904] [DEBUG] [LOCAL ] GYLD: Primary data saved (1532 records). [2025-10-22T19:06:47.662960] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-22T19:06:47.663020] [INFO ] [MAIN ] Update Progress: 988/2367 symbols completed. GYLD took 25.2s. Estimated remaining: 2h 56m 52s. Rate: 7.8 symbols/min [2025-10-22T19:06:47.826357] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:47.866487] [DEBUG] [LOCAL ] HAFN: Loaded 42724 existing records from primary storage. [2025-10-22T19:06:47.866802] [INFO ] [MAIN ] HAFN: Loaded 42724 existing records. [2025-10-22T19:06:48.037218] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:48.037416] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-22T19:06:48.037474] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-22T19:06:48.037717] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-22T19:06:48.037774] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-22T19:06:48.124374] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-22T19:06:48.381188] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:48.917705] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-22T19:06:48.978610] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:06:49.680507] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T19:06:49.717680] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-22T19:06:50.256274] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:06:50.517704] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-22T19:06:51.317734] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-22T19:06:51.444722] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T19:06:51.451969] [INFO ] [REMOTE ] GXO: Full fetch complete (69376 records). [2025-10-22T19:06:51.452087] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-22T19:06:51.827736] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-22T19:06:51.827824] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-22T19:06:51.828685] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-22T19:06:51.828766] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-22T19:06:51.830051] [DEBUG] [LOCAL ] GXO: Trimmed 69376 records to 46455 (keeping 200 days of data) [2025-10-22T19:06:52.097145] [DEBUG] [LOCAL ] GXO: Primary data saved (46455 records). [2025-10-22T19:06:52.097350] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-22T19:06:52.097470] [INFO ] [MAIN ] Update Progress: 989/2367 symbols completed. GXO took 35.2s. Estimated remaining: 2h 56m 40s. Rate: 7.8 symbols/min [2025-10-22T19:06:52.118374] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-22T19:06:52.272389] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:52.320050] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-22T19:06:52.320390] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-22T19:06:52.498772] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T19:06:52.525218] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:52.534461] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-22T19:06:52.535058] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-22T19:06:52.535869] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-22T19:06:52.535941] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-22T19:06:52.842797] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T19:06:52.924533] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-22T19:06:52.929168] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:53.717764] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-22T19:06:53.815551] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:06:54.309694] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T19:06:54.517667] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-22T19:06:55.317710] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-22T19:06:55.693184] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T19:06:56.117638] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-22T19:06:56.322564] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T19:06:56.407812] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T19:06:56.917757] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-22T19:06:57.717739] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-22T19:06:57.961861] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T19:06:58.488988] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T19:06:58.517614] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-22T19:06:59.144448] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T19:06:59.317678] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-22T19:07:00.033299] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T19:07:00.117617] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-22T19:07:00.917627] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-22T19:07:01.472102] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T19:07:01.517506] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T19:07:01.717731] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-22T19:07:02.517812] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-22T19:07:02.637960] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T19:07:03.317702] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-22T19:07:03.716191] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T19:07:03.832396] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T19:07:04.117713] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-22T19:07:04.816942] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T19:07:04.917704] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-22T19:07:05.717665] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-22T19:07:05.809247] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T19:07:06.517669] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-22T19:07:06.624612] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T19:07:07.257844] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T19:07:07.317615] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-22T19:07:08.117672] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-22T19:07:08.180369] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T19:07:08.917633] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-22T19:07:09.057341] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:07:09.064777] [INFO ] [REMOTE ] H: Full fetch complete (63416 records). [2025-10-22T19:07:09.064895] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-22T19:07:09.449941] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-22T19:07:09.450025] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-22T19:07:09.450893] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-22T19:07:09.450956] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-22T19:07:09.452149] [DEBUG] [LOCAL ] H: Trimmed 63416 records to 44372 (keeping 200 days of data) [2025-10-22T19:07:09.717842] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-22T19:07:09.745295] [DEBUG] [LOCAL ] H: Primary data saved (44372 records). [2025-10-22T19:07:09.745432] [INFO ] [MAIN ] H: Full history saved. [2025-10-22T19:07:09.745514] [INFO ] [MAIN ] Update Progress: 990/2367 symbols completed. H took 31.2s. Estimated remaining: 2h 56m 46s. Rate: 7.8 symbols/min [2025-10-22T19:07:09.915825] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:09.948046] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T19:07:09.994735] [DEBUG] [LOCAL ] HASI: Loaded 47751 existing records from primary storage. [2025-10-22T19:07:09.995072] [INFO ] [MAIN ] HASI: Loaded 47751 existing records. [2025-10-22T19:07:10.178744] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:07:10.178999] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-22T19:07:10.179050] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-22T19:07:10.179251] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-22T19:07:10.179308] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-22T19:07:10.527556] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-22T19:07:10.585756] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:10.610246] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T19:07:11.316428] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T19:07:11.325299] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-22T19:07:12.117682] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-22T19:07:12.600985] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T19:07:12.917734] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-22T19:07:12.957290] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:07:13.384698] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T19:07:13.717629] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-22T19:07:14.517630] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-22T19:07:14.556799] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T19:07:14.566171] [INFO ] [REMOTE ] HAE: Full fetch complete (59291 records). [2025-10-22T19:07:14.566330] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-22T19:07:14.942260] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-22T19:07:14.942402] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-22T19:07:14.943276] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-22T19:07:14.943356] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-22T19:07:14.944819] [DEBUG] [LOCAL ] HAE: Trimmed 59291 records to 39324 (keeping 200 days of data) [2025-10-22T19:07:15.171398] [DEBUG] [LOCAL ] HAE: Primary data saved (39324 records). [2025-10-22T19:07:15.171563] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-22T19:07:15.171693] [INFO ] [MAIN ] Update Progress: 991/2367 symbols completed. HAE took 36.2s. Estimated remaining: 2h 56m 35s. Rate: 7.8 symbols/min [2025-10-22T19:07:15.314332] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T19:07:15.331104] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-22T19:07:15.371198] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:15.414557] [DEBUG] [LOCAL ] HAYW: Loaded 48821 existing records from primary storage. [2025-10-22T19:07:15.414898] [INFO ] [MAIN ] HAYW: Loaded 48821 existing records. [2025-10-22T19:07:15.586929] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:07:15.587086] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-22T19:07:15.587132] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-22T19:07:15.587372] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-22T19:07:15.587410] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-22T19:07:15.942291] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:16.117759] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-22T19:07:16.444731] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T19:07:16.610855] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T19:07:16.917792] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-22T19:07:17.656196] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T19:07:17.717734] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-22T19:07:18.517724] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-22T19:07:18.694852] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T19:07:18.849590] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:07:19.317716] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-22T19:07:20.123723] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-22T19:07:20.144189] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T19:07:20.152187] [INFO ] [REMOTE ] HAFN: Full fetch complete (64630 records). [2025-10-22T19:07:20.152374] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-22T19:07:20.626812] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-22T19:07:20.626965] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-22T19:07:20.628288] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-22T19:07:20.628395] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-22T19:07:20.630180] [DEBUG] [LOCAL ] HAFN: Trimmed 64630 records to 42607 (keeping 200 days of data) [2025-10-22T19:07:20.908198] [DEBUG] [LOCAL ] HAFN: Primary data saved (42607 records). [2025-10-22T19:07:20.908415] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-22T19:07:20.908915] [INFO ] [MAIN ] Update Progress: 992/2367 symbols completed. HAFN took 33.2s. Estimated remaining: 2h 56m 25s. Rate: 7.8 symbols/min [2025-10-22T19:07:20.922786] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-22T19:07:21.092434] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:21.092807] [DEBUG] [LOCAL ] HBB: No existing data file found in primary storage. [2025-10-22T19:07:21.092986] [WARN ] [MAIN ] HBB: No existing data found, performing full refresh instead. [2025-10-22T19:07:21.093163] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-22T19:07:21.119832] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-22T19:07:21.120034] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-22T19:07:21.120208] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-22T19:07:21.188532] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:07:21.483018] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:21.717629] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-22T19:07:22.209456] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T19:07:22.522359] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-22T19:07:22.527617] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T19:07:22.547128] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:07:23.321246] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-22T19:07:24.049391] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T19:07:24.058187] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-22T19:07:24.058317] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-22T19:07:24.125603] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-22T19:07:24.465883] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-22T19:07:24.465998] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-22T19:07:24.466937] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-22T19:07:24.466999] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-22T19:07:24.468416] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-22T19:07:24.789631] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-22T19:07:24.789789] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-22T19:07:24.789874] [INFO ] [MAIN ] Update Progress: 993/2367 symbols completed. HAL took 32.7s. Estimated remaining: 2h 56m 12s. Rate: 7.8 symbols/min [2025-10-22T19:07:24.929130] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-22T19:07:24.962529] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:25.013790] [DEBUG] [LOCAL ] HBI: Loaded 52933 existing records from primary storage. [2025-10-22T19:07:25.014176] [INFO ] [MAIN ] HBI: Loaded 52933 existing records. [2025-10-22T19:07:25.167543] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T19:07:25.228234] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:07:25.228434] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-22T19:07:25.228480] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-22T19:07:25.228684] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-22T19:07:25.228739] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-22T19:07:25.565192] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T19:07:25.587972] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:25.717628] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-22T19:07:26.196913] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T19:07:26.517678] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-22T19:07:27.317751] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-22T19:07:27.668297] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T19:07:28.126425] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-22T19:07:28.136171] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T19:07:28.141186] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T19:07:28.917712] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-22T19:07:29.717731] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-22T19:07:29.779000] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T19:07:29.814618] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T19:07:30.517721] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-22T19:07:31.317637] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-22T19:07:31.467021] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T19:07:32.035419] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T19:07:32.117674] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-22T19:07:32.397245] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T19:07:32.735926] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T19:07:32.917671] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-22T19:07:33.717724] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-22T19:07:33.799511] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-22T19:07:34.517667] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-22T19:07:35.217933] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T19:07:35.317716] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-22T19:07:36.018885] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-22T19:07:36.117674] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-22T19:07:36.707539] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T19:07:36.917663] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-22T19:07:37.028686] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T19:07:37.717684] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-22T19:07:38.517733] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-22T19:07:38.974886] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T19:07:39.273719] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T19:07:39.274955] [INFO ] [REMOTE ] HBB: Full fetch complete (9208 records). [2025-10-22T19:07:39.275026] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-22T19:07:39.317916] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-22T19:07:39.652584] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-22T19:07:39.652748] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-22T19:07:39.653175] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-22T19:07:39.653383] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-22T19:07:39.654289] [DEBUG] [LOCAL ] HBB: Trimmed 9208 records to 6298 (keeping 200 days of data) [2025-10-22T19:07:39.726617] [DEBUG] [LOCAL ] HBB: Primary data saved (6298 records). [2025-10-22T19:07:39.727247] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-22T19:07:39.728691] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T19:07:39.728829] [INFO ] [MAIN ] Update Progress: 994/2367 symbols completed. HBB took 18.8s. Estimated remaining: 2h 56m 14s. Rate: 7.8 symbols/min [2025-10-22T19:07:39.907782] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:39.907949] [DEBUG] [LOCAL ] HBM: No existing data file found in primary storage. [2025-10-22T19:07:39.907987] [WARN ] [MAIN ] HBM: No existing data found, performing full refresh instead. [2025-10-22T19:07:39.908099] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-22T19:07:39.908142] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-22T19:07:39.908188] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-22T19:07:39.908262] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-22T19:07:40.123268] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-22T19:07:40.256962] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:40.917764] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-22T19:07:41.717749] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-22T19:07:41.774263] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-22T19:07:41.889338] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T19:07:42.517737] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-22T19:07:42.772706] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T19:07:43.214630] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T19:07:43.317726] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-22T19:07:44.117719] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-22T19:07:44.159330] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:07:44.917711] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-22T19:07:45.238406] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T19:07:45.717675] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-22T19:07:46.517835] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-22T19:07:47.058896] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-10-22T19:07:47.317764] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-22T19:07:47.411134] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-22T19:07:47.959321] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-22T19:07:48.117763] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-22T19:07:48.917757] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-22T19:07:49.089957] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T19:07:49.098571] [INFO ] [REMOTE ] HASI: Full fetch complete (68378 records). [2025-10-22T19:07:49.098809] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-22T19:07:49.385274] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-10-22T19:07:49.550275] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-22T19:07:49.550375] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-22T19:07:49.551258] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-22T19:07:49.551325] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-22T19:07:49.552814] [DEBUG] [LOCAL ] HASI: Trimmed 68378 records to 47728 (keeping 200 days of data) [2025-10-22T19:07:49.731527] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-22T19:07:49.847519] [DEBUG] [LOCAL ] HASI: Primary data saved (47728 records). [2025-10-22T19:07:49.847709] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-22T19:07:49.847824] [INFO ] [MAIN ] Update Progress: 995/2367 symbols completed. HASI took 40.1s. Estimated remaining: 2h 56m 10s. Rate: 7.8 symbols/min [2025-10-22T19:07:50.012687] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:50.052564] [DEBUG] [LOCAL ] HCA: Loaded 46914 existing records from primary storage. [2025-10-22T19:07:50.052907] [INFO ] [MAIN ] HCA: Loaded 46914 existing records. [2025-10-22T19:07:50.225791] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:07:50.225989] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-22T19:07:50.226035] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-22T19:07:50.226216] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-22T19:07:50.226252] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-22T19:07:50.588016] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:50.588394] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-22T19:07:50.766829] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-22T19:07:51.317625] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-22T19:07:51.387251] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-22T19:07:51.395340] [INFO ] [REMOTE ] HAYW: Full fetch complete (70911 records). [2025-10-22T19:07:51.395480] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-22T19:07:51.822039] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-22T19:07:51.835322] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-22T19:07:51.841746] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-22T19:07:51.841838] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-22T19:07:51.862200] [DEBUG] [LOCAL ] HAYW: Trimmed 70911 records to 48803 (keeping 200 days of data) [2025-10-22T19:07:51.865813] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T19:07:52.130874] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-22T19:07:52.165213] [DEBUG] [LOCAL ] HAYW: Primary data saved (48803 records). [2025-10-22T19:07:52.165552] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-22T19:07:52.165693] [INFO ] [MAIN ] Update Progress: 996/2367 symbols completed. HAYW took 37.0s. Estimated remaining: 2h 55m 54s. Rate: 7.8 symbols/min [2025-10-22T19:07:52.342433] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:52.377862] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T19:07:52.422339] [DEBUG] [LOCAL ] HCC: Loaded 45053 existing records from primary storage. [2025-10-22T19:07:52.422693] [INFO ] [MAIN ] HCC: Loaded 45053 existing records. [2025-10-22T19:07:52.594693] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:07:52.594901] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-22T19:07:52.594949] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-22T19:07:52.595133] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-22T19:07:52.595171] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-22T19:07:52.923887] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-22T19:07:52.954418] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:52.988258] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:07:53.717754] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-22T19:07:53.970687] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T19:07:54.517747] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-22T19:07:54.572464] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T19:07:55.317776] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-22T19:07:55.404357] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T19:07:56.117749] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-22T19:07:56.238829] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:07:56.917673] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-22T19:07:57.156476] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T19:07:57.363434] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T19:07:57.717761] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-22T19:07:58.517702] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-22T19:07:59.037913] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T19:07:59.046996] [INFO ] [REMOTE ] HBI: Full fetch complete (76969 records). [2025-10-22T19:07:59.047155] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-22T19:07:59.320719] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-22T19:07:59.463915] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-22T19:07:59.464047] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-22T19:07:59.465187] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-22T19:07:59.465280] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-22T19:07:59.467177] [DEBUG] [LOCAL ] HBI: Trimmed 76969 records to 52906 (keeping 200 days of data) [2025-10-22T19:07:59.798992] [DEBUG] [LOCAL ] HBI: Primary data saved (52906 records). [2025-10-22T19:07:59.799769] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-22T19:07:59.799901] [INFO ] [MAIN ] Update Progress: 997/2367 symbols completed. HBI took 35.0s. Estimated remaining: 2h 55m 47s. Rate: 7.8 symbols/min [2025-10-22T19:07:59.801007] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-22T19:08:00.117679] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-22T19:08:00.340954] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T19:08:00.917635] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-22T19:08:01.333560] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T19:08:01.717790] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-22T19:08:01.941913] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T19:08:02.517749] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-22T19:08:02.976710] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T19:08:03.247092] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T19:08:03.317790] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-22T19:08:04.117635] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-22T19:08:04.311475] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:08:04.917763] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-22T19:08:05.158397] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T19:08:05.717804] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-22T19:08:05.878427] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T19:08:06.517745] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-22T19:08:06.828809] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T19:08:07.317753] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-22T19:08:07.859639] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-22T19:08:07.868632] [INFO ] [REMOTE ] HBM: Full fetch complete (76740 records). [2025-10-22T19:08:07.868812] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-22T19:08:08.290762] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-22T19:08:08.291387] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-22T19:08:08.292377] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-22T19:08:08.293961] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-22T19:08:08.293880] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T19:08:08.304946] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-22T19:08:08.306507] [DEBUG] [LOCAL ] HBM: Trimmed 76740 records to 52980 (keeping 200 days of data) [2025-10-22T19:08:08.623429] [DEBUG] [LOCAL ] HBM: Primary data saved (52980 records). [2025-10-22T19:08:08.623684] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-22T19:08:08.623779] [INFO ] [MAIN ] Update Progress: 998/2367 symbols completed. HBM took 28.9s. Estimated remaining: 2h 55m 40s. Rate: 7.8 symbols/min [2025-10-22T19:08:09.044313] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T19:08:09.053997] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-22T19:08:09.910900] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T19:08:09.921146] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-22T19:08:10.657261] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T19:08:10.668640] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-22T19:08:11.760368] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T19:08:11.770583] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-22T19:08:12.529176] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T19:08:12.537922] [INFO ] [REMOTE ] HCA: Full fetch complete (68935 records). [2025-10-22T19:08:12.538053] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-22T19:08:12.924583] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-22T19:08:12.924685] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-22T19:08:12.925542] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-22T19:08:12.925605] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-22T19:08:12.926992] [DEBUG] [LOCAL ] HCA: Trimmed 68935 records to 46893 (keeping 200 days of data) [2025-10-22T19:08:13.217192] [DEBUG] [LOCAL ] HCA: Primary data saved (46893 records). [2025-10-22T19:08:13.217449] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-22T19:08:13.217583] [INFO ] [MAIN ] Update Progress: 999/2367 symbols completed. HCA took 23.4s. Estimated remaining: 2h 55m 29s. Rate: 7.8 symbols/min [2025-10-22T19:08:13.241989] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T19:08:13.251866] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-22T19:08:15.461340] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T19:08:15.470721] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-22T19:08:17.659475] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T19:08:17.666446] [INFO ] [REMOTE ] HCC: Full fetch complete (64877 records). [2025-10-22T19:08:17.666551] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-22T19:08:18.042477] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-22T19:08:18.042555] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-22T19:08:18.043348] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-22T19:08:18.043410] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-22T19:08:18.044624] [DEBUG] [LOCAL ] HCC: Trimmed 64877 records to 44974 (keeping 200 days of data) [2025-10-22T19:08:18.304258] [DEBUG] [LOCAL ] HCC: Primary data saved (44974 records). [2025-10-22T19:08:18.304383] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-22T19:08:18.304459] [INFO ] [MAIN ] Update Progress: 1000/2367 symbols completed. HCC took 26.1s. Estimated remaining: 2h 55m 17s. Rate: 7.8 symbols/min [2025-10-22T19:08:18.897459] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:19.023257] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-22T19:08:19.025704] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:19.057084] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:19.057667] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-22T19:08:19.078536] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-22T19:08:19.078760] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-22T19:08:19.078347] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:19.078915] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-22T19:08:19.078990] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-22T19:08:19.200340] [DEBUG] [LOCAL ] HCI: Loaded 14056 existing records from primary storage. [2025-10-22T19:08:19.206077] [INFO ] [MAIN ] HCI: Loaded 14056 existing records. [2025-10-22T19:08:19.537851] [DEBUG] [LOCAL ] HDB: Loaded 51909 existing records from primary storage. [2025-10-22T19:08:19.581987] [INFO ] [MAIN ] HDB: Loaded 51909 existing records. [2025-10-22T19:08:19.779152] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:19.779870] [DEBUG] [LOCAL ] HD: Loaded 53476 existing records from primary storage. [2025-10-22T19:08:19.789476] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:19.807448] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-22T19:08:19.812564] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-22T19:08:19.813066] [INFO ] [MAIN ] HD: Loaded 53476 existing records. [2025-10-22T19:08:19.828636] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-22T19:08:19.921547] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-22T19:08:19.985782] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:20.004339] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-22T19:08:20.036245] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-22T19:08:20.074125] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-22T19:08:20.208296] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-22T19:08:20.208472] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-22T19:08:20.204843] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:20.214266] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-22T19:08:20.236293] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-22T19:08:20.269543] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-22T19:08:20.329481] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-22T19:08:20.483067] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-22T19:08:20.534017] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-22T19:08:20.928280] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:20.973903] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-22T19:08:21.013294] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T19:08:21.014293] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-22T19:08:21.235815] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:21.254260] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-22T19:08:21.276498] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:21.276783] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-22T19:08:21.454373] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-22T19:08:21.455212] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-22T19:08:21.799846] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-22T19:08:21.800629] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-22T19:08:22.101454] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-22T19:08:22.102272] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-22T19:08:22.119511] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T19:08:22.122515] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-22T19:08:22.469165] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T19:08:22.470116] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-22T19:08:22.934021] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T19:08:22.935073] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-22T19:08:22.943314] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:08:23.152720] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T19:08:23.199932] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-22T19:08:23.317616] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-22T19:08:23.358921] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T19:08:24.117671] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-22T19:08:24.282270] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T19:08:24.383109] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-22T19:08:24.917729] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-22T19:08:25.717728] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-22T19:08:25.895544] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T19:08:26.139767] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-22T19:08:26.140678] [INFO ] [REMOTE ] HCXY: Full fetch complete (515 records). [2025-10-22T19:08:26.140765] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-22T19:08:26.318837] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-22T19:08:26.319016] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:08:26.319083] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:08:26.319155] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-22T19:08:26.319221] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-22T19:08:26.319256] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-22T19:08:26.319296] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-22T19:08:26.319351] [INFO ] [MAIN ] Update Progress: 1001/2367 symbols completed. HCXY took 8.0s. Estimated remaining: 2h 55m 10s. Rate: 7.8 symbols/min [2025-10-22T19:08:26.485807] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:26.517750] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-22T19:08:26.534496] [DEBUG] [LOCAL ] HE: Loaded 48826 existing records from primary storage. [2025-10-22T19:08:26.534852] [INFO ] [MAIN ] HE: Loaded 48826 existing records. [2025-10-22T19:08:26.717001] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:26.717215] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-22T19:08:26.717262] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-22T19:08:26.717444] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-22T19:08:26.717481] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-22T19:08:27.068031] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:27.317719] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-22T19:08:28.117675] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-22T19:08:28.241975] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T19:08:28.917727] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-22T19:08:29.030366] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:08:29.717733] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-22T19:08:29.787181] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T19:08:30.517788] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-22T19:08:31.297277] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-22T19:08:31.317619] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-22T19:08:31.367710] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T19:08:31.980613] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-22T19:08:32.117724] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-22T19:08:32.917632] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-22T19:08:33.152681] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T19:08:33.717738] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-22T19:08:34.001021] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T19:08:34.270476] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-22T19:08:34.517704] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-22T19:08:35.321302] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-22T19:08:35.494661] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T19:08:36.117678] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-22T19:08:36.534287] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-22T19:08:36.917664] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-22T19:08:37.333713] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T19:08:37.717772] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-22T19:08:38.438329] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-22T19:08:38.517624] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-22T19:08:39.323572] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-22T19:08:39.325163] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T19:08:39.704366] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-10-22T19:08:40.117624] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-22T19:08:40.789019] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-22T19:08:40.841606] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T19:08:40.917636] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-22T19:08:41.050948] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T19:08:41.717626] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-22T19:08:41.834677] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T19:08:42.517759] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-22T19:08:43.317746] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-22T19:08:43.942330] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-22T19:08:44.117637] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-22T19:08:44.228900] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T19:08:44.917734] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-22T19:08:44.996488] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T19:08:45.717667] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-22T19:08:45.960273] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T19:08:45.963272] [INFO ] [REMOTE ] HCI: Full fetch complete (19628 records). [2025-10-22T19:08:45.963352] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-22T19:08:46.344517] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-22T19:08:46.344633] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-22T19:08:46.345190] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-22T19:08:46.345267] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-22T19:08:46.346318] [DEBUG] [LOCAL ] HCI: Trimmed 19628 records to 14079 (keeping 200 days of data) [2025-10-22T19:08:46.464078] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-22T19:08:46.491195] [DEBUG] [LOCAL ] HCI: Primary data saved (14079 records). [2025-10-22T19:08:46.491364] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-22T19:08:46.491488] [INFO ] [MAIN ] Update Progress: 1002/2367 symbols completed. HCI took 28.2s. Estimated remaining: 2h 55m 19s. Rate: 7.8 symbols/min [2025-10-22T19:08:46.528075] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-22T19:08:46.751241] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:46.786483] [DEBUG] [LOCAL ] HEI: Loaded 30723 existing records from primary storage. [2025-10-22T19:08:46.786894] [INFO ] [MAIN ] HEI: Loaded 30723 existing records. [2025-10-22T19:08:47.048757] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:47.049016] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-22T19:08:47.049085] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-22T19:08:47.049352] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-22T19:08:47.049412] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-22T19:08:47.335707] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-22T19:08:47.498504] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:47.619122] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T19:08:48.117709] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-22T19:08:48.809023] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T19:08:48.917685] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-22T19:08:48.956982] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T19:08:49.668431] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T19:08:49.717629] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-22T19:08:50.517721] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-22T19:08:51.330405] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-22T19:08:51.332916] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-22T19:08:51.342566] [INFO ] [REMOTE ] HD: Full fetch complete (77550 records). [2025-10-22T19:08:51.342877] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-22T19:08:51.452166] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T19:08:51.789386] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-22T19:08:51.789517] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-22T19:08:51.790469] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-22T19:08:51.790543] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-22T19:08:51.791986] [DEBUG] [LOCAL ] HD: Trimmed 77550 records to 53467 (keeping 200 days of data) [2025-10-22T19:08:51.917519] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T19:08:52.120865] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-22T19:08:52.171396] [DEBUG] [LOCAL ] HD: Primary data saved (53467 records). [2025-10-22T19:08:52.171573] [INFO ] [MAIN ] HD: Full history saved. [2025-10-22T19:08:52.171704] [INFO ] [MAIN ] Update Progress: 1003/2367 symbols completed. HD took 33.9s. Estimated remaining: 2h 55m 9s. Rate: 7.8 symbols/min [2025-10-22T19:08:52.343812] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:52.352574] [DEBUG] [LOCAL ] HEQ: Loaded 6795 existing records from primary storage. [2025-10-22T19:08:52.352804] [INFO ] [MAIN ] HEQ: Loaded 6795 existing records. [2025-10-22T19:08:52.542323] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:52.542630] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-22T19:08:52.542719] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-22T19:08:52.542863] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-22T19:08:52.542903] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-22T19:08:52.910692] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:52.922740] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-22T19:08:52.935025] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T19:08:53.555248] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T19:08:53.717674] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-22T19:08:53.817635] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:08:53.826309] [INFO ] [REMOTE ] HDB: Full fetch complete (75653 records). [2025-10-22T19:08:53.826437] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-22T19:08:54.215447] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-22T19:08:54.215556] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-22T19:08:54.216724] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-22T19:08:54.216786] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-22T19:08:54.218309] [DEBUG] [LOCAL ] HDB: Trimmed 75653 records to 51909 (keeping 200 days of data) [2025-10-22T19:08:54.520360] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-22T19:08:54.536359] [DEBUG] [LOCAL ] HDB: Primary data saved (51909 records). [2025-10-22T19:08:54.536499] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-22T19:08:54.536583] [INFO ] [MAIN ] Update Progress: 1004/2367 symbols completed. HDB took 36.2s. Estimated remaining: 2h 54m 54s. Rate: 7.8 symbols/min [2025-10-22T19:08:54.701800] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:54.743782] [DEBUG] [LOCAL ] HESM: Loaded 48621 existing records from primary storage. [2025-10-22T19:08:54.744077] [INFO ] [MAIN ] HESM: Loaded 48621 existing records. [2025-10-22T19:08:54.923329] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:54.923601] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-22T19:08:54.923839] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-22T19:08:54.924060] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-22T19:08:54.924166] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-22T19:08:55.120353] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T19:08:55.223682] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:08:55.320951] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-22T19:08:55.348861] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:55.929590] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T19:08:56.117669] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-22T19:08:56.917718] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-22T19:08:57.650817] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T19:08:57.717728] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-22T19:08:57.956262] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T19:08:57.964305] [INFO ] [REMOTE ] HE: Full fetch complete (72101 records). [2025-10-22T19:08:57.964431] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-22T19:08:58.359973] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-22T19:08:58.360051] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-22T19:08:58.360973] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-22T19:08:58.361036] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-22T19:08:58.362338] [DEBUG] [LOCAL ] HE: Trimmed 72101 records to 48806 (keeping 200 days of data) [2025-10-22T19:08:58.525378] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-22T19:08:58.644335] [DEBUG] [LOCAL ] HE: Primary data saved (48806 records). [2025-10-22T19:08:58.644461] [INFO ] [MAIN ] HE: Full history saved. [2025-10-22T19:08:58.645003] [INFO ] [MAIN ] Update Progress: 1005/2367 symbols completed. HE took 32.3s. Estimated remaining: 2h 54m 41s. Rate: 7.8 symbols/min [2025-10-22T19:08:58.824197] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:58.824370] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-22T19:08:58.824513] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-22T19:08:58.824730] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-22T19:08:58.824879] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-22T19:08:58.824954] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-22T19:08:58.825130] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-22T19:08:59.147676] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T19:08:59.233991] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:59.317634] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-22T19:08:59.652268] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-22T19:09:00.065573] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T19:09:00.117610] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-22T19:09:00.917679] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-22T19:09:01.717779] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-22T19:09:02.368041] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-22T19:09:02.517745] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-22T19:09:03.317725] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-22T19:09:03.578528] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-22T19:09:03.648601] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-22T19:09:03.663781] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T19:09:04.117683] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-22T19:09:04.703243] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T19:09:04.917719] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-22T19:09:05.205860] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-22T19:09:05.632139] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T19:09:05.717716] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-22T19:09:06.517723] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-22T19:09:07.098259] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T19:09:07.128583] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T19:09:07.317618] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-22T19:09:08.117736] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-22T19:09:08.357842] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-22T19:09:08.800534] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T19:09:08.917677] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-22T19:09:09.658531] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T19:09:09.717617] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-22T19:09:10.517686] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-22T19:09:10.571559] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T19:09:10.573564] [INFO ] [REMOTE ] HEQ: Full fetch complete (9548 records). [2025-10-22T19:09:10.573633] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-22T19:09:10.921159] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-22T19:09:10.921235] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-22T19:09:10.921456] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-22T19:09:10.921495] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-22T19:09:10.921920] [DEBUG] [LOCAL ] HEQ: Trimmed 9548 records to 6756 (keeping 200 days of data) [2025-10-22T19:09:10.960558] [DEBUG] [LOCAL ] HEQ: Primary data saved (6756 records). [2025-10-22T19:09:10.960697] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-22T19:09:10.960787] [INFO ] [MAIN ] Update Progress: 1006/2367 symbols completed. HEQ took 18.8s. Estimated remaining: 2h 54m 40s. Rate: 7.8 symbols/min [2025-10-22T19:09:11.129830] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:11.130006] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-22T19:09:11.130062] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-22T19:09:11.130174] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-22T19:09:11.130220] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-22T19:09:11.130269] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-22T19:09:11.130307] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-22T19:09:11.326340] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-22T19:09:11.484225] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:11.821143] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T19:09:12.117688] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-22T19:09:12.358770] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-22T19:09:12.917733] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-22T19:09:13.163031] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T19:09:13.267685] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-22T19:09:13.717669] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-22T19:09:14.517718] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-22T19:09:14.936581] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-22T19:09:15.178448] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T19:09:15.317620] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-22T19:09:16.117724] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-22T19:09:16.862146] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T19:09:16.917624] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-22T19:09:17.611320] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T19:09:17.632897] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T19:09:17.717779] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-22T19:09:17.964104] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-22T19:09:18.517725] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-22T19:09:18.930497] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-22T19:09:19.317769] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-22T19:09:20.117681] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-22T19:09:20.578674] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T19:09:20.917723] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-22T19:09:21.621227] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:09:21.717790] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-22T19:09:22.291438] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T19:09:22.295434] [INFO ] [REMOTE ] HEI: Full fetch complete (47348 records). [2025-10-22T19:09:22.295522] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-22T19:09:22.523004] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-22T19:09:22.666343] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-22T19:09:22.666428] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-22T19:09:22.667197] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-22T19:09:22.667260] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-22T19:09:22.668241] [DEBUG] [LOCAL ] HEI: Trimmed 47348 records to 30521 (keeping 200 days of data) [2025-10-22T19:09:22.850059] [DEBUG] [LOCAL ] HEI: Primary data saved (30521 records). [2025-10-22T19:09:22.850190] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-22T19:09:22.850267] [INFO ] [MAIN ] Update Progress: 1007/2367 symbols completed. HEI took 36.4s. Estimated remaining: 2h 54m 38s. Rate: 7.8 symbols/min [2025-10-22T19:09:23.018827] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:23.021170] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-22T19:09:23.037530] [DEBUG] [LOCAL ] HFRO: Loaded 16466 existing records from primary storage. [2025-10-22T19:09:23.037798] [INFO ] [MAIN ] HFRO: Loaded 16466 existing records. [2025-10-22T19:09:23.211872] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:23.212081] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-22T19:09:23.212135] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-22T19:09:23.212294] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-22T19:09:23.212332] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-22T19:09:23.319816] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-22T19:09:23.577593] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:23.623441] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T19:09:23.639300] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-22T19:09:24.117673] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-22T19:09:24.462117] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-22T19:09:24.917717] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-22T19:09:25.717729] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-22T19:09:26.053862] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-22T19:09:26.259531] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T19:09:26.520118] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-22T19:09:27.317774] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-22T19:09:27.650493] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:09:28.117736] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-22T19:09:28.359603] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-22T19:09:28.917766] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-22T19:09:29.042529] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T19:09:29.139072] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-22T19:09:29.717728] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-22T19:09:30.079551] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-22T19:09:30.080213] [INFO ] [REMOTE ] HF: Full fetch complete (420 records). [2025-10-22T19:09:30.080280] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-22T19:09:30.255290] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-22T19:09:30.255506] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:09:30.255574] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:09:30.255665] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-22T19:09:30.255743] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-22T19:09:30.255781] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-22T19:09:30.255820] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-22T19:09:30.255874] [INFO ] [MAIN ] Update Progress: 1008/2367 symbols completed. HF took 31.6s. Estimated remaining: 2h 54m 30s. Rate: 7.8 symbols/min [2025-10-22T19:09:30.424345] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:30.440948] [DEBUG] [LOCAL ] HGER: Loaded 15479 existing records from primary storage. [2025-10-22T19:09:30.441170] [INFO ] [MAIN ] HGER: Loaded 15479 existing records. [2025-10-22T19:09:30.522837] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-22T19:09:30.617057] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:30.617267] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-22T19:09:30.617313] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-22T19:09:30.617498] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-22T19:09:30.617553] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-22T19:09:30.972074] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:31.317689] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-22T19:09:32.104531] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T19:09:32.117623] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-22T19:09:32.338394] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T19:09:32.544988] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T19:09:32.917731] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-22T19:09:33.717769] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-22T19:09:33.960338] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T19:09:34.153316] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T19:09:34.517633] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-22T19:09:35.317721] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-22T19:09:35.637793] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T19:09:35.745326] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-22T19:09:36.117677] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-22T19:09:36.770779] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T19:09:36.917725] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-22T19:09:37.717745] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-22T19:09:38.485762] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T19:09:38.517675] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-22T19:09:38.862999] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T19:09:38.874912] [INFO ] [REMOTE ] HESM: Full fetch complete (69880 records). [2025-10-22T19:09:38.875212] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-22T19:09:38.999180] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-22T19:09:39.030808] [INFO ] [REMOTE ] HFND: Full fetch complete (1771 records). [2025-10-22T19:09:39.046727] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-22T19:09:39.317724] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-22T19:09:39.541590] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-22T19:09:39.558193] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:09:39.579210] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:09:39.579368] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-22T19:09:39.590253] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-22T19:09:39.600695] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-22T19:09:39.618042] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-22T19:09:39.628014] [INFO ] [MAIN ] Update Progress: 1009/2367 symbols completed. HFND took 28.7s. Estimated remaining: 2h 54m 24s. Rate: 7.8 symbols/min [2025-10-22T19:09:39.720483] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-22T19:09:39.753977] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-22T19:09:39.766099] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-22T19:09:39.766181] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-22T19:09:39.803576] [DEBUG] [LOCAL ] HESM: Trimmed 69880 records to 48607 (keeping 200 days of data) [2025-10-22T19:09:39.949215] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:39.964139] [DEBUG] [LOCAL ] HGLB: Loaded 9704 existing records from primary storage. [2025-10-22T19:09:39.968524] [INFO ] [MAIN ] HGLB: Loaded 9704 existing records. [2025-10-22T19:09:40.119508] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-22T19:09:40.256543] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:40.257362] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-22T19:09:40.257688] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-22T19:09:40.258628] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-22T19:09:40.258790] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-22T19:09:40.359529] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T19:09:40.614034] [DEBUG] [LOCAL ] HESM: Primary data saved (48607 records). [2025-10-22T19:09:40.632505] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-22T19:09:40.634872] [INFO ] [MAIN ] Update Progress: 1010/2367 symbols completed. HESM took 46.1s. Estimated remaining: 2h 54m 8s. Rate: 7.8 symbols/min [2025-10-22T19:09:40.812294] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:40.878093] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:40.892431] [DEBUG] [LOCAL ] HGTY: Loaded 13379 existing records from primary storage. [2025-10-22T19:09:40.892633] [INFO ] [MAIN ] HGTY: Loaded 13379 existing records. [2025-10-22T19:09:40.922764] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-22T19:09:41.072889] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:41.073084] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-22T19:09:41.073138] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-22T19:09:41.073286] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-22T19:09:41.073322] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-22T19:09:41.192717] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T19:09:41.431407] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:41.717752] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-22T19:09:41.779873] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T19:09:42.517743] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-22T19:09:42.737217] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T19:09:43.317771] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-22T19:09:43.335280] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T19:09:44.092868] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T19:09:44.117607] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-22T19:09:44.736240] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T19:09:44.917639] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-22T19:09:45.717740] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-22T19:09:45.885468] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T19:09:46.517666] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-22T19:09:46.677805] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-22T19:09:47.166871] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T19:09:47.317720] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-22T19:09:48.117895] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-22T19:09:48.262266] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T19:09:48.917683] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-22T19:09:49.142310] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:09:49.717718] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-22T19:09:49.939801] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:09:50.517672] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-22T19:09:50.877156] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T19:09:50.882702] [INFO ] [REMOTE ] HGER: Full fetch complete (19019 records). [2025-10-22T19:09:50.882835] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-22T19:09:51.247859] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-22T19:09:51.247948] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-22T19:09:51.248310] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-22T19:09:51.248355] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-22T19:09:51.248921] [DEBUG] [LOCAL ] HGER: Trimmed 19019 records to 15543 (keeping 200 days of data) [2025-10-22T19:09:51.318690] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-22T19:09:51.340536] [DEBUG] [LOCAL ] HGER: Primary data saved (15543 records). [2025-10-22T19:09:51.340741] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-22T19:09:51.340835] [INFO ] [MAIN ] Update Progress: 1011/2367 symbols completed. HGER took 21.1s. Estimated remaining: 2h 54m 4s. Rate: 7.8 symbols/min [2025-10-22T19:09:51.506631] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:51.515573] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T19:09:51.518332] [INFO ] [REMOTE ] HFRO: Full fetch complete (26874 records). [2025-10-22T19:09:51.518417] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-22T19:09:51.809573] [DEBUG] [LOCAL ] HGV: Loaded 46110 existing records from primary storage. [2025-10-22T19:09:51.844835] [INFO ] [MAIN ] HGV: Loaded 46110 existing records. [2025-10-22T19:09:52.083031] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T19:09:52.099032] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-22T19:09:52.125805] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-22T19:09:52.125951] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-22T19:09:52.162596] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-22T19:09:52.157121] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:52.162881] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-22T19:09:52.163045] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-22T19:09:52.163269] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-22T19:09:52.163584] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-22T19:09:52.163763] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-22T19:09:52.185734] [DEBUG] [LOCAL ] HFRO: Trimmed 26874 records to 16376 (keeping 200 days of data) [2025-10-22T19:09:52.388110] [DEBUG] [LOCAL ] HFRO: Primary data saved (16376 records). [2025-10-22T19:09:52.429688] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-22T19:09:52.436513] [INFO ] [MAIN ] Update Progress: 1012/2367 symbols completed. HFRO took 29.6s. Estimated remaining: 2h 53m 47s. Rate: 7.8 symbols/min [2025-10-22T19:09:52.751723] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:52.799907] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:52.830741] [DEBUG] [LOCAL ] HHH: Loaded 33152 existing records from primary storage. [2025-10-22T19:09:52.831029] [INFO ] [MAIN ] HHH: Loaded 33152 existing records. [2025-10-22T19:09:52.922745] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-22T19:09:52.975966] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T19:09:53.033777] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:53.033979] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-22T19:09:53.034026] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-22T19:09:53.034230] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-22T19:09:53.034267] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-22T19:09:53.375927] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:53.717723] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-22T19:09:54.313392] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T19:09:54.517615] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-22T19:09:54.931258] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T19:09:55.317748] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-22T19:09:55.999523] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T19:09:56.117719] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-22T19:09:56.534150] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T19:09:56.917714] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-22T19:09:57.694626] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T19:09:57.717639] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-22T19:09:57.761844] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-22T19:09:58.517816] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-22T19:09:59.317675] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-22T19:09:59.414637] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:09:59.469135] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T19:10:00.066411] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T19:10:00.117674] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-22T19:10:00.917727] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-22T19:10:00.962425] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T19:10:01.641479] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T19:10:01.717748] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-22T19:10:02.517681] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-22T19:10:03.061668] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T19:10:03.303536] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T19:10:03.317610] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-22T19:10:04.117682] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-22T19:10:04.448391] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T19:10:04.917683] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-22T19:10:05.651211] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:10:05.717711] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-22T19:10:06.517719] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-22T19:10:06.636529] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:10:06.945095] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T19:10:07.290314] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T19:10:07.317679] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-22T19:10:08.117709] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-22T19:10:08.139785] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T19:10:08.917679] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-22T19:10:09.717731] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-22T19:10:09.747564] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:10:09.938676] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:10:10.517757] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-22T19:10:11.317738] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-22T19:10:11.575375] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T19:10:11.578157] [INFO ] [REMOTE ] HGTY: Full fetch complete (17589 records). [2025-10-22T19:10:11.578235] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-22T19:10:11.740020] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T19:10:11.992757] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-22T19:10:11.992913] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-22T19:10:11.993312] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-22T19:10:11.993372] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-22T19:10:11.993951] [DEBUG] [LOCAL ] HGTY: Trimmed 17589 records to 13361 (keeping 200 days of data) [2025-10-22T19:10:12.068303] [DEBUG] [LOCAL ] HGTY: Primary data saved (13361 records). [2025-10-22T19:10:12.068426] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-22T19:10:12.068501] [INFO ] [MAIN ] Update Progress: 1013/2367 symbols completed. HGTY took 31.4s. Estimated remaining: 2h 53m 56s. Rate: 7.8 symbols/min [2025-10-22T19:10:12.130931] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-22T19:10:12.236606] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:12.267949] [DEBUG] [LOCAL ] HI: Loaded 36113 existing records from primary storage. [2025-10-22T19:10:12.268208] [INFO ] [MAIN ] HI: Loaded 36113 existing records. [2025-10-22T19:10:12.440784] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:12.440984] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-22T19:10:12.441030] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-22T19:10:12.441427] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-22T19:10:12.441481] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-22T19:10:12.797204] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:12.861853] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:10:12.884372] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T19:10:12.917723] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-22T19:10:13.717661] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-22T19:10:14.405449] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T19:10:14.517676] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-22T19:10:15.120140] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T19:10:15.317749] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-22T19:10:16.066139] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T19:10:16.094208] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T19:10:16.117673] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-22T19:10:16.743019] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-22T19:10:16.917749] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-22T19:10:17.717722] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-22T19:10:18.525298] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-22T19:10:18.527672] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T19:10:18.535257] [INFO ] [REMOTE ] HGV: Full fetch complete (65933 records). [2025-10-22T19:10:18.535356] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-22T19:10:18.929401] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-22T19:10:18.929486] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-22T19:10:18.930350] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-22T19:10:18.930421] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-22T19:10:18.931807] [DEBUG] [LOCAL ] HGV: Trimmed 65933 records to 46058 (keeping 200 days of data) [2025-10-22T19:10:19.169697] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T19:10:19.228170] [DEBUG] [LOCAL ] HGV: Primary data saved (46058 records). [2025-10-22T19:10:19.228301] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-22T19:10:19.228814] [INFO ] [MAIN ] Update Progress: 1014/2367 symbols completed. HGV took 27.9s. Estimated remaining: 2h 53m 47s. Rate: 7.8 symbols/min [2025-10-22T19:10:19.324173] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-22T19:10:19.398326] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:19.449285] [DEBUG] [LOCAL ] HIG: Loaded 51173 existing records from primary storage. [2025-10-22T19:10:19.449577] [INFO ] [MAIN ] HIG: Loaded 51173 existing records. [2025-10-22T19:10:19.631771] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:19.632036] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-22T19:10:19.632173] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-22T19:10:19.632485] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-22T19:10:19.632574] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-22T19:10:19.830733] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T19:10:20.022176] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:20.117673] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-22T19:10:20.476560] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T19:10:20.917684] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-22T19:10:21.717669] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-22T19:10:21.802238] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:10:22.380288] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T19:10:22.510592] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T19:10:22.517605] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-22T19:10:23.317628] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-22T19:10:23.410865] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:10:24.117751] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-22T19:10:24.804793] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T19:10:24.917666] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-22T19:10:25.020353] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-22T19:10:25.022702] [INFO ] [REMOTE ] HGLB: Full fetch complete (14399 records). [2025-10-22T19:10:25.022773] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-22T19:10:25.391859] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-22T19:10:25.391942] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-22T19:10:25.392375] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-22T19:10:25.392415] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-22T19:10:25.392920] [DEBUG] [LOCAL ] HGLB: Trimmed 14399 records to 9621 (keeping 200 days of data) [2025-10-22T19:10:25.453355] [DEBUG] [LOCAL ] HGLB: Primary data saved (9621 records). [2025-10-22T19:10:25.453522] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-22T19:10:25.453639] [INFO ] [MAIN ] Update Progress: 1015/2367 symbols completed. HGLB took 45.8s. Estimated remaining: 2h 53m 37s. Rate: 7.8 symbols/min [2025-10-22T19:10:25.619607] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:25.649822] [DEBUG] [LOCAL ] HII: Loaded 33494 existing records from primary storage. [2025-10-22T19:10:25.650106] [INFO ] [MAIN ] HII: Loaded 33494 existing records. [2025-10-22T19:10:25.722920] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-22T19:10:25.831319] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:25.831522] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-22T19:10:25.831590] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-22T19:10:25.831925] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-22T19:10:25.831994] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-22T19:10:26.187419] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:26.415905] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T19:10:26.517684] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-22T19:10:27.317666] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-22T19:10:27.408382] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T19:10:27.881984] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T19:10:28.117684] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-22T19:10:28.803901] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:10:28.808947] [INFO ] [REMOTE ] HHH: Full fetch complete (46157 records). [2025-10-22T19:10:28.809029] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-22T19:10:28.922720] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-22T19:10:29.195719] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-22T19:10:29.195939] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-22T19:10:29.196704] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-22T19:10:29.196778] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-22T19:10:29.197891] [DEBUG] [LOCAL ] HHH: Trimmed 46157 records to 33047 (keeping 200 days of data) [2025-10-22T19:10:29.322839] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:10:29.417598] [DEBUG] [LOCAL ] HHH: Primary data saved (33047 records). [2025-10-22T19:10:29.417765] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-22T19:10:29.417854] [INFO ] [MAIN ] Update Progress: 1016/2367 symbols completed. HHH took 37.0s. Estimated remaining: 2h 53m 25s. Rate: 7.8 symbols/min [2025-10-22T19:10:29.609825] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:29.658769] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-22T19:10:29.659087] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-22T19:10:29.727629] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-22T19:10:29.860442] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:29.860694] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-22T19:10:29.860757] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-22T19:10:29.860998] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-22T19:10:29.861054] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-22T19:10:30.219599] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:30.517638] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-22T19:10:30.798205] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T19:10:31.278772] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T19:10:31.317676] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-22T19:10:32.117756] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-22T19:10:32.922266] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-22T19:10:32.927338] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-22T19:10:33.221855] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T19:10:33.692732] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:10:33.717612] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-22T19:10:34.249681] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T19:10:34.517668] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-22T19:10:35.003536] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T19:10:35.317713] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-22T19:10:36.117675] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-22T19:10:36.917670] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-22T19:10:37.004544] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T19:10:37.013346] [INFO ] [REMOTE ] HI: Full fetch complete (51262 records). [2025-10-22T19:10:37.030285] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-22T19:10:37.047909] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-22T19:10:37.434166] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-22T19:10:37.434245] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-22T19:10:37.434954] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-22T19:10:37.435015] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-22T19:10:37.436049] [DEBUG] [LOCAL ] HI: Trimmed 51262 records to 36110 (keeping 200 days of data) [2025-10-22T19:10:37.656876] [DEBUG] [LOCAL ] HI: Primary data saved (36110 records). [2025-10-22T19:10:37.657052] [INFO ] [MAIN ] HI: Full history saved. [2025-10-22T19:10:37.657158] [INFO ] [MAIN ] Update Progress: 1017/2367 symbols completed. HI took 25.6s. Estimated remaining: 2h 53m 18s. Rate: 7.8 symbols/min [2025-10-22T19:10:37.721464] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-22T19:10:37.831263] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:37.853636] [DEBUG] [LOCAL ] HIO: Loaded 24124 existing records from primary storage. [2025-10-22T19:10:37.853909] [INFO ] [MAIN ] HIO: Loaded 24124 existing records. [2025-10-22T19:10:38.034574] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:38.035005] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-22T19:10:38.049637] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-22T19:10:38.061889] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-22T19:10:38.062415] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-22T19:10:38.063785] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T19:10:38.430038] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:38.517677] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-22T19:10:38.614612] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T19:10:39.317716] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-22T19:10:40.117634] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-22T19:10:40.375548] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T19:10:40.716291] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.99 seconds). [2025-10-22T19:10:40.917620] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-22T19:10:41.339172] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T19:10:41.717747] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-22T19:10:41.901821] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T19:10:42.517632] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-22T19:10:42.921521] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T19:10:43.317672] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-22T19:10:43.642770] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T19:10:43.671324] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T19:10:44.117750] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-22T19:10:44.917936] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-22T19:10:45.717682] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-22T19:10:45.807675] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T19:10:46.259072] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-22T19:10:46.517797] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-22T19:10:46.640669] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T19:10:46.691256] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T19:10:47.317690] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-22T19:10:48.117639] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-22T19:10:48.502012] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T19:10:48.917625] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-22T19:10:49.279151] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-10-22T19:10:49.592454] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T19:10:49.717676] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-22T19:10:50.256488] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T19:10:50.517719] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-22T19:10:51.295024] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T19:10:51.317623] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-22T19:10:51.561852] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T19:10:52.117764] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-22T19:10:52.690472] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T19:10:52.917738] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-22T19:10:53.030545] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T19:10:53.717781] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-22T19:10:54.517753] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-22T19:10:55.216915] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-22T19:10:55.222273] [INFO ] [REMOTE ] HII: Full fetch complete (52326 records). [2025-10-22T19:10:55.222383] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-22T19:10:55.322494] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-22T19:10:55.617919] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-22T19:10:55.618038] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-22T19:10:55.619069] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-22T19:10:55.619181] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-22T19:10:55.620470] [DEBUG] [LOCAL ] HII: Trimmed 52326 records to 33319 (keeping 200 days of data) [2025-10-22T19:10:55.748273] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-10-22T19:10:55.873702] [DEBUG] [LOCAL ] HII: Primary data saved (33319 records). [2025-10-22T19:10:55.873967] [INFO ] [MAIN ] HII: Full history saved. [2025-10-22T19:10:55.874072] [INFO ] [MAIN ] Update Progress: 1018/2367 symbols completed. HII took 30.4s. Estimated remaining: 2h 53m 24s. Rate: 7.8 symbols/min [2025-10-22T19:10:56.046542] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:56.066499] [DEBUG] [LOCAL ] HIPO: Loaded 21512 existing records from primary storage. [2025-10-22T19:10:56.066794] [INFO ] [MAIN ] HIPO: Loaded 21512 existing records. [2025-10-22T19:10:56.133660] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-22T19:10:56.246718] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:56.247279] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-22T19:10:56.247547] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-22T19:10:56.248240] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-22T19:10:56.248430] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-22T19:10:56.395151] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T19:10:56.403540] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T19:10:56.664030] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:56.917677] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-22T19:10:57.717747] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-22T19:10:57.743826] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:10:58.517690] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-22T19:10:59.045799] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-22T19:10:59.317640] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-22T19:10:59.487813] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T19:10:59.495901] [INFO ] [REMOTE ] HIG: Full fetch complete (73718 records). [2025-10-22T19:10:59.496016] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-22T19:10:59.684900] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:10:59.900289] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-22T19:10:59.900363] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-22T19:10:59.901223] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-22T19:10:59.901285] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-22T19:10:59.902662] [DEBUG] [LOCAL ] HIG: Trimmed 73718 records to 51135 (keeping 200 days of data) [2025-10-22T19:11:00.117733] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-22T19:11:00.220482] [DEBUG] [LOCAL ] HIG: Primary data saved (51135 records). [2025-10-22T19:11:00.220615] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-22T19:11:00.221102] [INFO ] [MAIN ] Update Progress: 1019/2367 symbols completed. HIG took 41.0s. Estimated remaining: 2h 53m 12s. Rate: 7.8 symbols/min [2025-10-22T19:11:00.399515] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:00.439939] [DEBUG] [LOCAL ] HIW: Loaded 44457 existing records from primary storage. [2025-10-22T19:11:00.440224] [INFO ] [MAIN ] HIW: Loaded 44457 existing records. [2025-10-22T19:11:00.619886] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:00.620109] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-22T19:11:00.620184] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-22T19:11:00.620404] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-22T19:11:00.620460] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-22T19:11:00.922832] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-22T19:11:00.984747] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:01.451630] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T19:11:01.717667] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-22T19:11:02.095535] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-10-22T19:11:02.137769] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T19:11:02.517748] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-22T19:11:03.165712] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T19:11:03.317676] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-22T19:11:03.724961] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T19:11:04.117735] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-22T19:11:04.662580] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T19:11:04.917667] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-22T19:11:05.717755] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-22T19:11:06.260788] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T19:11:06.267597] [INFO ] [REMOTE ] HIO: Full fetch complete (38100 records). [2025-10-22T19:11:06.267793] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-22T19:11:06.528773] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-22T19:11:06.646874] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-22T19:11:06.647129] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-22T19:11:06.648033] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-22T19:11:06.648294] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-22T19:11:06.649509] [DEBUG] [LOCAL ] HIO: Trimmed 38100 records to 23941 (keeping 200 days of data) [2025-10-22T19:11:06.785005] [DEBUG] [LOCAL ] HIO: Primary data saved (23941 records). [2025-10-22T19:11:06.785183] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-22T19:11:06.785343] [INFO ] [MAIN ] Update Progress: 1020/2367 symbols completed. HIO took 29.1s. Estimated remaining: 2h 53m 3s. Rate: 7.8 symbols/min [2025-10-22T19:11:06.931031] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T19:11:07.018470] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:07.024736] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-22T19:11:07.053759] [DEBUG] [LOCAL ] HIX: Loaded 20379 existing records from primary storage. [2025-10-22T19:11:07.054020] [INFO ] [MAIN ] HIX: Loaded 20379 existing records. [2025-10-22T19:11:07.260431] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:07.260689] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-22T19:11:07.260747] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-22T19:11:07.260929] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-22T19:11:07.260967] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-22T19:11:07.324066] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-22T19:11:07.640415] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:07.990266] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T19:11:08.117695] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-22T19:11:08.917774] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-22T19:11:09.214612] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T19:11:09.717731] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-22T19:11:09.749091] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T19:11:10.271490] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.95 seconds). [2025-10-22T19:11:10.280529] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-22T19:11:10.280716] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-22T19:11:10.522820] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-22T19:11:10.690306] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-22T19:11:10.690383] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-22T19:11:10.691299] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-22T19:11:10.691360] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-22T19:11:10.692762] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-22T19:11:10.796005] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T19:11:11.023350] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-22T19:11:11.023473] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-22T19:11:11.023549] [INFO ] [MAIN ] Update Progress: 1021/2367 symbols completed. HIMS took 41.6s. Estimated remaining: 2h 52m 50s. Rate: 7.8 symbols/min [2025-10-22T19:11:11.204451] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:11.222195] [DEBUG] [LOCAL ] HKD: Loaded 18717 existing records from primary storage. [2025-10-22T19:11:11.222429] [INFO ] [MAIN ] HKD: Loaded 18717 existing records. [2025-10-22T19:11:11.322780] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-22T19:11:11.403918] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:11.404115] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-22T19:11:11.404161] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-22T19:11:11.404341] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-22T19:11:11.404395] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-22T19:11:11.773621] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:11.788506] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T19:11:12.117669] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-22T19:11:12.439254] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T19:11:12.917727] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-22T19:11:13.561059] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T19:11:13.717757] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-22T19:11:14.026871] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T19:11:14.517751] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-22T19:11:15.092704] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T19:11:15.317748] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-22T19:11:15.935993] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T19:11:16.117693] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-22T19:11:16.475295] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T19:11:16.917635] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-22T19:11:17.210766] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T19:11:17.717834] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-22T19:11:18.417192] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:11:18.517614] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-22T19:11:18.845099] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T19:11:19.317631] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-22T19:11:20.122782] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-22T19:11:20.134723] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:11:20.408284] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T19:11:20.917694] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-22T19:11:21.103630] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T19:11:21.717634] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-22T19:11:21.939852] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T19:11:22.517670] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-22T19:11:22.804155] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T19:11:23.317618] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-22T19:11:23.540005] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:11:24.117751] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-22T19:11:24.173103] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T19:11:24.917626] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-22T19:11:25.233502] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T19:11:25.236561] [INFO ] [REMOTE ] HIPO: Full fetch complete (31040 records). [2025-10-22T19:11:25.236670] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-22T19:11:25.602379] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-22T19:11:25.602453] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-22T19:11:25.603035] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-22T19:11:25.603096] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-22T19:11:25.603826] [DEBUG] [LOCAL ] HIPO: Trimmed 31040 records to 21379 (keeping 200 days of data) [2025-10-22T19:11:25.723994] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-22T19:11:25.723909] [DEBUG] [LOCAL ] HIPO: Primary data saved (21379 records). [2025-10-22T19:11:25.725064] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-22T19:11:25.725172] [INFO ] [MAIN ] Update Progress: 1022/2367 symbols completed. HIPO took 29.9s. Estimated remaining: 2h 52m 52s. Rate: 7.8 symbols/min [2025-10-22T19:11:25.904954] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:25.909687] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T19:11:25.964372] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-22T19:11:25.964817] [INFO ] [MAIN ] HL: Loaded 53676 existing records. [2025-10-22T19:11:26.173219] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:26.173487] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-22T19:11:26.173541] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-22T19:11:26.173755] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-22T19:11:26.173810] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-22T19:11:26.528070] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-22T19:11:26.547182] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:27.163383] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T19:11:27.205165] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T19:11:27.317612] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-22T19:11:28.117737] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-22T19:11:28.551894] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T19:11:28.917746] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-22T19:11:29.289993] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T19:11:29.717693] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-22T19:11:30.161928] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T19:11:30.165587] [INFO ] [REMOTE ] HKD: Full fetch complete (27871 records). [2025-10-22T19:11:30.165721] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-22T19:11:30.523436] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-22T19:11:30.524150] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-22T19:11:30.524225] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-22T19:11:30.525452] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-22T19:11:30.525515] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-22T19:11:30.526314] [DEBUG] [LOCAL ] HKD: Trimmed 27871 records to 18679 (keeping 200 days of data) [2025-10-22T19:11:30.627749] [DEBUG] [LOCAL ] HKD: Primary data saved (18679 records). [2025-10-22T19:11:30.627866] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-22T19:11:30.627943] [INFO ] [MAIN ] Update Progress: 1023/2367 symbols completed. HKD took 19.6s. Estimated remaining: 2h 52m 40s. Rate: 7.8 symbols/min [2025-10-22T19:11:30.793985] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:30.815396] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:11:30.850409] [DEBUG] [LOCAL ] HLF: Loaded 48506 existing records from primary storage. [2025-10-22T19:11:30.850708] [INFO ] [MAIN ] HLF: Loaded 48506 existing records. [2025-10-22T19:11:31.025678] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:31.025856] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-22T19:11:31.025902] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-22T19:11:31.026094] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-22T19:11:31.026147] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-22T19:11:31.331281] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-22T19:11:31.370179] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:32.117634] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-22T19:11:32.413334] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T19:11:32.550173] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T19:11:32.917724] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-22T19:11:33.701502] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T19:11:33.717600] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-22T19:11:34.517733] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-22T19:11:34.732115] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T19:11:35.317631] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-22T19:11:35.351890] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T19:11:36.079431] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T19:11:36.117624] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-22T19:11:36.917693] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-22T19:11:37.280164] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T19:11:37.330740] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T19:11:37.337932] [INFO ] [REMOTE ] HIW: Full fetch complete (64882 records). [2025-10-22T19:11:37.338038] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-22T19:11:37.724947] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-22T19:11:37.725952] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-22T19:11:37.726274] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-22T19:11:37.727892] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-22T19:11:37.728066] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-22T19:11:37.729460] [DEBUG] [LOCAL ] HIW: Trimmed 64882 records to 44400 (keeping 200 days of data) [2025-10-22T19:11:37.991261] [DEBUG] [LOCAL ] HIW: Primary data saved (44400 records). [2025-10-22T19:11:37.991404] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-22T19:11:37.992039] [INFO ] [MAIN ] Update Progress: 1024/2367 symbols completed. HIW took 37.8s. Estimated remaining: 2h 52m 32s. Rate: 7.8 symbols/min [2025-10-22T19:11:38.161068] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:38.198438] [DEBUG] [LOCAL ] HLI: Loaded 30693 existing records from primary storage. [2025-10-22T19:11:38.198753] [INFO ] [MAIN ] HLI: Loaded 30693 existing records. [2025-10-22T19:11:38.476435] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:38.476828] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-22T19:11:38.476899] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-22T19:11:38.477216] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-22T19:11:38.477271] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-22T19:11:38.522931] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-22T19:11:38.922268] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T19:11:39.025332] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T19:11:39.074171] [INFO ] [REMOTE ] HIX: Full fetch complete (30029 records). [2025-10-22T19:11:39.092500] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-22T19:11:39.129051] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:39.322854] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-22T19:11:39.658030] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-22T19:11:39.658138] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-22T19:11:39.658728] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-22T19:11:39.658790] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-22T19:11:39.659487] [DEBUG] [LOCAL ] HIX: Trimmed 30029 records to 20442 (keeping 200 days of data) [2025-10-22T19:11:39.773121] [DEBUG] [LOCAL ] HIX: Primary data saved (20442 records). [2025-10-22T19:11:39.773239] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-22T19:11:39.773313] [INFO ] [MAIN ] Update Progress: 1025/2367 symbols completed. HIX took 33.0s. Estimated remaining: 2h 52m 17s. Rate: 7.8 symbols/min [2025-10-22T19:11:39.939336] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:39.966673] [DEBUG] [LOCAL ] HLIO: Loaded 28169 existing records from primary storage. [2025-10-22T19:11:39.966937] [INFO ] [MAIN ] HLIO: Loaded 28169 existing records. [2025-10-22T19:11:40.119101] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-22T19:11:40.151747] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:40.152944] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-22T19:11:40.153113] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-22T19:11:40.153389] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-22T19:11:40.153460] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-22T19:11:40.525032] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:40.539770] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T19:11:40.917633] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-22T19:11:40.987774] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:11:41.717681] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-22T19:11:41.864423] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T19:11:42.088399] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T19:11:42.517723] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-22T19:11:42.960046] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T19:11:43.317687] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-22T19:11:44.117623] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-22T19:11:44.364212] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T19:11:44.537682] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-22T19:11:44.917670] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-22T19:11:45.717680] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-22T19:11:45.872330] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T19:11:46.517754] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-22T19:11:46.551713] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:11:46.744344] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T19:11:47.317637] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-22T19:11:47.848919] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T19:11:48.117680] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-22T19:11:48.917631] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-22T19:11:49.333884] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T19:11:49.708456] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T19:11:49.718588] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-22T19:11:50.397746] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:11:50.517636] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-22T19:11:51.043076] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T19:11:51.317671] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-22T19:11:51.867965] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T19:11:52.117632] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-22T19:11:52.917740] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-22T19:11:53.040924] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T19:11:53.391669] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T19:11:53.717686] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-22T19:11:54.517795] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-22T19:11:54.988321] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T19:11:55.088613] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T19:11:55.317754] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-22T19:11:56.122780] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-22T19:11:56.144131] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T19:11:56.602830] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-22T19:11:56.917746] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-22T19:11:57.537995] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:11:57.717733] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-22T19:11:58.517787] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-22T19:11:59.128440] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T19:11:59.274019] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T19:11:59.317615] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-22T19:11:59.348723] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T19:12:00.117722] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-22T19:12:00.917620] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-22T19:12:01.107062] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T19:12:01.115626] [INFO ] [REMOTE ] HLF: Full fetch complete (70867 records). [2025-10-22T19:12:01.115912] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-22T19:12:01.562178] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-22T19:12:01.562364] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-22T19:12:01.563614] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-22T19:12:01.563761] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-22T19:12:01.565957] [DEBUG] [LOCAL ] HLF: Trimmed 70867 records to 48453 (keeping 200 days of data) [2025-10-22T19:12:01.698816] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T19:12:01.718461] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-22T19:12:01.906841] [DEBUG] [LOCAL ] HLF: Primary data saved (48453 records). [2025-10-22T19:12:01.907034] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-22T19:12:01.907141] [INFO ] [MAIN ] Update Progress: 1026/2367 symbols completed. HLF took 31.3s. Estimated remaining: 2h 52m 28s. Rate: 7.8 symbols/min [2025-10-22T19:12:02.083946] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:02.118394] [DEBUG] [LOCAL ] HLLY: Loaded 33260 existing records from primary storage. [2025-10-22T19:12:02.118811] [INFO ] [MAIN ] HLLY: Loaded 33260 existing records. [2025-10-22T19:12:02.309277] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:02.309613] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-22T19:12:02.309899] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-22T19:12:02.310195] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-22T19:12:02.310239] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-22T19:12:02.517678] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T19:12:02.525715] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-22T19:12:02.571879] [INFO ] [REMOTE ] HLI: Full fetch complete (45374 records). [2025-10-22T19:12:02.603765] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-22T19:12:02.816108] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:03.134452] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T19:12:03.160818] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-22T19:12:03.160958] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-22T19:12:03.162358] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-22T19:12:03.162428] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-22T19:12:03.163945] [DEBUG] [LOCAL ] HLI: Trimmed 45374 records to 30581 (keeping 200 days of data) [2025-10-22T19:12:03.327946] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-22T19:12:03.375884] [DEBUG] [LOCAL ] HLI: Primary data saved (30581 records). [2025-10-22T19:12:03.376091] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-22T19:12:03.376221] [INFO ] [MAIN ] Update Progress: 1027/2367 symbols completed. HLI took 25.4s. Estimated remaining: 2h 52m 12s. Rate: 7.8 symbols/min [2025-10-22T19:12:03.558154] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:03.613931] [DEBUG] [LOCAL ] HLN: Loaded 53131 existing records from primary storage. [2025-10-22T19:12:03.614354] [INFO ] [MAIN ] HLN: Loaded 53131 existing records. [2025-10-22T19:12:03.795750] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:03.796139] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-22T19:12:03.796230] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-22T19:12:03.796718] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-22T19:12:03.796777] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-22T19:12:04.123501] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-22T19:12:04.167853] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:04.755696] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T19:12:04.917769] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-22T19:12:05.082706] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-22T19:12:05.091472] [INFO ] [REMOTE ] HL: Full fetch complete (77826 records). [2025-10-22T19:12:05.091601] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-22T19:12:05.478494] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-22T19:12:05.478616] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-22T19:12:05.479668] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-22T19:12:05.479752] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-22T19:12:05.481331] [DEBUG] [LOCAL ] HL: Trimmed 77826 records to 53676 (keeping 200 days of data) [2025-10-22T19:12:05.584179] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T19:12:05.635878] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T19:12:05.721419] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-22T19:12:05.834875] [DEBUG] [LOCAL ] HL: Primary data saved (53676 records). [2025-10-22T19:12:05.835002] [INFO ] [MAIN ] HL: Full history saved. [2025-10-22T19:12:05.835079] [INFO ] [MAIN ] Update Progress: 1028/2367 symbols completed. HL took 40.1s. Estimated remaining: 2h 51m 58s. Rate: 7.8 symbols/min [2025-10-22T19:12:06.003283] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:06.046607] [DEBUG] [LOCAL ] HLT: Loaded 50463 existing records from primary storage. [2025-10-22T19:12:06.046934] [INFO ] [MAIN ] HLT: Loaded 50463 existing records. [2025-10-22T19:12:06.218824] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:06.219029] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-22T19:12:06.219075] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-22T19:12:06.219296] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-22T19:12:06.219356] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-22T19:12:06.522714] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-22T19:12:06.573195] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:06.926172] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T19:12:07.317684] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-22T19:12:08.117631] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-22T19:12:08.321234] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:12:08.365319] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:12:08.917673] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-22T19:12:09.471808] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T19:12:09.717683] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-22T19:12:10.084133] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T19:12:10.088769] [INFO ] [REMOTE ] HLIO: Full fetch complete (37208 records). [2025-10-22T19:12:10.088864] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-22T19:12:10.453593] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-22T19:12:10.453699] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-22T19:12:10.454355] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-22T19:12:10.454403] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-22T19:12:10.455272] [DEBUG] [LOCAL ] HLIO: Trimmed 37208 records to 28093 (keeping 200 days of data) [2025-10-22T19:12:10.543093] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-22T19:12:10.628842] [DEBUG] [LOCAL ] HLIO: Primary data saved (28093 records). [2025-10-22T19:12:10.628982] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-22T19:12:10.629063] [INFO ] [MAIN ] Update Progress: 1029/2367 symbols completed. HLIO took 30.9s. Estimated remaining: 2h 51m 46s. Rate: 7.8 symbols/min [2025-10-22T19:12:10.805326] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:10.845250] [DEBUG] [LOCAL ] HLX: Loaded 47394 existing records from primary storage. [2025-10-22T19:12:10.845560] [INFO ] [MAIN ] HLX: Loaded 47394 existing records. [2025-10-22T19:12:11.028608] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T19:12:11.048787] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:11.055774] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-22T19:12:11.055970] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-22T19:12:11.056870] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-22T19:12:11.056930] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-22T19:12:11.324099] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-22T19:12:11.413184] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:12.117763] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-22T19:12:12.206976] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:12:12.917669] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-22T19:12:13.181607] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T19:12:13.358770] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T19:12:13.717758] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-22T19:12:14.517751] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-22T19:12:14.661071] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T19:12:15.317761] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-22T19:12:15.702523] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T19:12:16.117772] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-22T19:12:16.697539] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-22T19:12:16.917726] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-22T19:12:17.703197] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-22T19:12:17.717610] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-22T19:12:18.517806] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-22T19:12:18.675239] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-22T19:12:19.317742] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-22T19:12:19.546675] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-22T19:12:19.610204] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T19:12:20.117699] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-22T19:12:20.592031] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-10-22T19:12:20.925605] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-22T19:12:20.932854] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T19:12:21.717632] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-22T19:12:21.928246] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:12:22.091891] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T19:12:22.517676] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-22T19:12:23.317631] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-22T19:12:23.592507] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T19:12:24.117736] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-22T19:12:24.268679] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T19:12:24.846469] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:12:24.917682] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-22T19:12:25.314473] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T19:12:25.717688] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-22T19:12:26.517630] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-22T19:12:26.698990] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T19:12:27.169542] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:12:27.317736] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-22T19:12:28.117680] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-22T19:12:28.307134] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:12:28.765289] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T19:12:28.771056] [INFO ] [REMOTE ] HLLY: Full fetch complete (46031 records). [2025-10-22T19:12:28.771201] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-22T19:12:28.920975] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-22T19:12:29.167245] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-22T19:12:29.167363] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-22T19:12:29.168340] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-22T19:12:29.168407] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-22T19:12:29.169514] [DEBUG] [LOCAL ] HLLY: Trimmed 46031 records to 33310 (keeping 200 days of data) [2025-10-22T19:12:29.356551] [DEBUG] [LOCAL ] HLLY: Primary data saved (33310 records). [2025-10-22T19:12:29.356715] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-22T19:12:29.356806] [INFO ] [MAIN ] Update Progress: 1030/2367 symbols completed. HLLY took 27.4s. Estimated remaining: 2h 51m 53s. Rate: 7.8 symbols/min [2025-10-22T19:12:29.536440] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:29.577250] [DEBUG] [LOCAL ] HMC: Loaded 46311 existing records from primary storage. [2025-10-22T19:12:29.577566] [INFO ] [MAIN ] HMC: Loaded 46311 existing records. [2025-10-22T19:12:29.720043] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-22T19:12:29.764243] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:29.764973] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-22T19:12:29.765055] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-22T19:12:29.765324] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-22T19:12:29.765365] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-22T19:12:30.209953] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:30.213010] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T19:12:30.259734] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T19:12:30.517752] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-22T19:12:31.282151] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T19:12:31.317740] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-22T19:12:32.117689] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-22T19:12:32.459012] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T19:12:32.866989] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T19:12:32.917634] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-22T19:12:33.717678] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-22T19:12:33.908866] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:12:34.517746] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-22T19:12:34.548340] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T19:12:35.317671] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-22T19:12:35.532220] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T19:12:35.541010] [INFO ] [REMOTE ] HLN: Full fetch complete (77041 records). [2025-10-22T19:12:35.541154] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-22T19:12:35.962368] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-22T19:12:35.962536] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-22T19:12:35.963477] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-22T19:12:35.963541] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-22T19:12:35.964947] [DEBUG] [LOCAL ] HLN: Trimmed 77041 records to 53128 (keeping 200 days of data) [2025-10-22T19:12:36.136294] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-22T19:12:36.305092] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T19:12:36.323021] [DEBUG] [LOCAL ] HLN: Primary data saved (53128 records). [2025-10-22T19:12:36.323493] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-22T19:12:36.324059] [INFO ] [MAIN ] Update Progress: 1031/2367 symbols completed. HLN took 32.9s. Estimated remaining: 2h 51m 44s. Rate: 7.8 symbols/min [2025-10-22T19:12:36.493941] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:36.515346] [DEBUG] [LOCAL ] HMN: Loaded 23409 existing records from primary storage. [2025-10-22T19:12:36.515584] [INFO ] [MAIN ] HMN: Loaded 23409 existing records. [2025-10-22T19:12:36.691608] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:36.691800] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-22T19:12:36.691847] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-22T19:12:36.692083] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-22T19:12:36.692139] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-22T19:12:36.923221] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-22T19:12:37.049359] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:37.121719] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T19:12:37.717728] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-22T19:12:38.265591] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-22T19:12:38.517735] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-22T19:12:38.996415] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T19:12:39.026327] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-22T19:12:39.317696] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-22T19:12:40.117669] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-22T19:12:40.369310] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T19:12:40.390756] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T19:12:40.917730] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-22T19:12:41.443568] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T19:12:41.717838] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-22T19:12:42.264067] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T19:12:42.517745] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-22T19:12:43.317626] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-22T19:12:43.419808] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:12:43.427138] [INFO ] [REMOTE ] HLX: Full fetch complete (69010 records). [2025-10-22T19:12:43.427265] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-22T19:12:43.730931] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T19:12:43.830424] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-22T19:12:43.830544] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-22T19:12:43.831442] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-22T19:12:43.831507] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-22T19:12:43.832815] [DEBUG] [LOCAL ] HLX: Trimmed 69010 records to 47326 (keeping 200 days of data) [2025-10-22T19:12:44.087326] [DEBUG] [LOCAL ] HLX: Primary data saved (47326 records). [2025-10-22T19:12:44.087447] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-22T19:12:44.087522] [INFO ] [MAIN ] Update Progress: 1032/2367 symbols completed. HLX took 33.5s. Estimated remaining: 2h 51m 36s. Rate: 7.8 symbols/min [2025-10-22T19:12:44.122918] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-22T19:12:44.257048] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:44.304347] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-22T19:12:44.304670] [INFO ] [MAIN ] HMY: Loaded 53166 existing records. [2025-10-22T19:12:44.480054] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:44.480278] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-22T19:12:44.480329] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-22T19:12:44.480716] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-22T19:12:44.480772] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-22T19:12:44.836792] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:44.860020] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T19:12:44.923308] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-22T19:12:44.926910] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T19:12:45.717767] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-22T19:12:46.517617] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-22T19:12:46.790796] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T19:12:46.974863] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T19:12:47.317690] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-22T19:12:48.117620] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-22T19:12:48.511462] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T19:12:48.519868] [INFO ] [REMOTE ] HLT: Full fetch complete (73660 records). [2025-10-22T19:12:48.520001] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-22T19:12:48.934385] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-22T19:12:48.930744] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-22T19:12:48.934544] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-22T19:12:48.935538] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-22T19:12:48.936684] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-22T19:12:48.938442] [DEBUG] [LOCAL ] HLT: Trimmed 73660 records to 50461 (keeping 200 days of data) [2025-10-22T19:12:49.067223] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:12:49.296458] [DEBUG] [LOCAL ] HLT: Primary data saved (50461 records). [2025-10-22T19:12:49.296587] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-22T19:12:49.296686] [INFO ] [MAIN ] Update Progress: 1033/2367 symbols completed. HLT took 43.5s. Estimated remaining: 2h 51m 25s. Rate: 7.8 symbols/min [2025-10-22T19:12:49.476247] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:49.476440] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-22T19:12:49.476548] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-22T19:12:49.476839] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-22T19:12:49.476909] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-22T19:12:49.477015] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-22T19:12:49.477083] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-22T19:12:49.754203] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-22T19:12:49.794991] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:12:49.875408] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:50.309090] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T19:12:50.520944] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-22T19:12:51.317693] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-22T19:12:51.545556] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:12:51.545882] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-22T19:12:51.545991] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:12:51.546077] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-22T19:12:51.546160] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:12:51.546253] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-22T19:12:51.546335] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-22T19:12:51.546373] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-22T19:12:51.546413] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-22T19:12:51.546458] [INFO ] [MAIN ] Update Progress: 1034/2367 symbols completed. HNGE took 2.2s. Estimated remaining: 2h 51m 11s. Rate: 7.8 symbols/min [2025-10-22T19:12:51.717619] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:51.744053] [DEBUG] [LOCAL ] HNI: Loaded 29744 existing records from primary storage. [2025-10-22T19:12:51.744342] [INFO ] [MAIN ] HNI: Loaded 29744 existing records. [2025-10-22T19:12:51.926692] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:51.926912] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-22T19:12:51.926963] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-22T19:12:51.927267] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-22T19:12:51.927322] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-22T19:12:52.130303] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-22T19:12:52.276045] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:52.641831] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-10-22T19:12:52.917735] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-22T19:12:53.348745] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-22T19:12:53.717758] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-22T19:12:53.803985] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T19:12:53.861382] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T19:12:54.517775] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-22T19:12:54.822722] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:12:55.317685] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-22T19:12:56.117759] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-22T19:12:56.425388] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T19:12:56.433815] [INFO ] [REMOTE ] HMC: Full fetch complete (68686 records). [2025-10-22T19:12:56.434213] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-22T19:12:56.633871] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T19:12:56.851724] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-22T19:12:56.851804] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-22T19:12:56.852687] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-22T19:12:56.852749] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-22T19:12:56.853987] [DEBUG] [LOCAL ] HMC: Trimmed 68686 records to 46285 (keeping 200 days of data) [2025-10-22T19:12:56.937418] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-22T19:12:57.125318] [DEBUG] [LOCAL ] HMC: Primary data saved (46285 records). [2025-10-22T19:12:57.125500] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-22T19:12:57.125670] [INFO ] [MAIN ] Update Progress: 1035/2367 symbols completed. HMC took 27.8s. Estimated remaining: 2h 51m 0s. Rate: 7.8 symbols/min [2025-10-22T19:12:57.307114] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T19:12:57.306563] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:57.357876] [DEBUG] [LOCAL ] HOG: Loaded 50674 existing records from primary storage. [2025-10-22T19:12:57.358187] [INFO ] [MAIN ] HOG: Loaded 50674 existing records. [2025-10-22T19:12:57.532539] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:57.532750] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-22T19:12:57.532805] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-22T19:12:57.533015] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-22T19:12:57.533070] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-22T19:12:57.726719] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-22T19:12:57.886902] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:58.517755] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-22T19:12:58.892426] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T19:12:58.896456] [INFO ] [REMOTE ] HMN: Full fetch complete (31603 records). [2025-10-22T19:12:58.896606] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-22T19:12:59.159034] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-22T19:12:59.322856] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-22T19:12:59.382851] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-22T19:12:59.383036] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-22T19:12:59.383854] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-22T19:12:59.383969] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-22T19:12:59.384856] [DEBUG] [LOCAL ] HMN: Trimmed 31603 records to 23255 (keeping 200 days of data) [2025-10-22T19:12:59.527305] [DEBUG] [LOCAL ] HMN: Primary data saved (23255 records). [2025-10-22T19:12:59.527443] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-22T19:12:59.527523] [INFO ] [MAIN ] Update Progress: 1036/2367 symbols completed. HMN took 23.2s. Estimated remaining: 2h 50m 46s. Rate: 7.8 symbols/min [2025-10-22T19:12:59.671348] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T19:12:59.728769] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:59.773033] [DEBUG] [LOCAL ] HOMB: Loaded 43717 existing records from primary storage. [2025-10-22T19:12:59.773457] [INFO ] [MAIN ] HOMB: Loaded 43717 existing records. [2025-10-22T19:12:59.945505] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:59.945740] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-22T19:12:59.945791] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-22T19:12:59.945971] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-22T19:12:59.946008] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-22T19:13:00.122391] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-22T19:13:00.299293] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:00.917771] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-22T19:13:01.156921] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T19:13:01.474121] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T19:13:01.717799] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-22T19:13:02.258776] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T19:13:02.517733] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-22T19:13:02.917194] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T19:13:03.317734] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-22T19:13:04.117632] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-22T19:13:04.397377] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T19:13:04.748338] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-22T19:13:04.917629] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-22T19:13:05.684569] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T19:13:05.717630] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-22T19:13:06.517737] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-22T19:13:06.789359] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T19:13:07.072269] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T19:13:07.317675] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-22T19:13:08.116086] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T19:13:08.125508] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-22T19:13:08.917665] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-22T19:13:09.440352] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T19:13:09.683886] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T19:13:09.717625] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-22T19:13:10.526619] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-22T19:13:10.546187] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:13:11.286446] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T19:13:11.317615] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-22T19:13:12.021862] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T19:13:12.117680] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-22T19:13:12.478471] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T19:13:12.917742] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-22T19:13:13.717695] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-22T19:13:14.073986] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T19:13:14.364742] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T19:13:14.517624] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-22T19:13:15.096491] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T19:13:15.102165] [INFO ] [REMOTE ] HNI: Full fetch complete (42195 records). [2025-10-22T19:13:15.102303] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-22T19:13:15.328941] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-22T19:13:15.492150] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-22T19:13:15.492230] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-22T19:13:15.492893] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-22T19:13:15.492957] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-22T19:13:15.493904] [DEBUG] [LOCAL ] HNI: Trimmed 42195 records to 29772 (keeping 200 days of data) [2025-10-22T19:13:15.673296] [DEBUG] [LOCAL ] HNI: Primary data saved (29772 records). [2025-10-22T19:13:15.673407] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-22T19:13:15.673483] [INFO ] [MAIN ] Update Progress: 1037/2367 symbols completed. HNI took 24.1s. Estimated remaining: 2h 50m 49s. Rate: 7.8 symbols/min [2025-10-22T19:13:16.117778] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-22T19:13:16.164217] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T19:13:16.917680] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-22T19:13:17.278775] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T19:13:17.717683] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-22T19:13:17.929194] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:13:18.151919] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T19:13:18.517771] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-22T19:13:19.311939] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T19:13:19.322274] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-22T19:13:20.117672] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-22T19:13:21.059405] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-22T19:13:21.070186] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-22T19:13:21.957152] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-22T19:13:21.966733] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-22T19:13:22.219777] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-22T19:13:22.517753] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-22T19:13:22.791494] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T19:13:23.317770] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-22T19:13:23.723539] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T19:13:23.732731] [INFO ] [REMOTE ] HOMB: Full fetch complete (64511 records). [2025-10-22T19:13:23.732913] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-22T19:13:24.190333] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-22T19:13:24.190414] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-22T19:13:24.191280] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-22T19:13:24.191344] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-22T19:13:24.192590] [DEBUG] [LOCAL ] HOMB: Trimmed 64511 records to 43676 (keeping 200 days of data) [2025-10-22T19:13:24.481108] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:13:24.501619] [DEBUG] [LOCAL ] HOMB: Primary data saved (43676 records). [2025-10-22T19:13:24.501977] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-22T19:13:24.502104] [INFO ] [MAIN ] Update Progress: 1038/2367 symbols completed. HOMB took 25.0s. Estimated remaining: 2h 50m 43s. Rate: 7.8 symbols/min [2025-10-22T19:13:24.503037] [INFO ] [REMOTE ] HMY: Full fetch complete (77131 records). [2025-10-22T19:13:24.503186] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-22T19:13:24.920005] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-22T19:13:24.920097] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-22T19:13:24.921063] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-22T19:13:24.921129] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-22T19:13:24.922631] [DEBUG] [LOCAL ] HMY: Trimmed 77131 records to 53166 (keeping 200 days of data) [2025-10-22T19:13:25.256803] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:13:25.287050] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-22T19:13:25.289058] [DEBUG] [LOCAL ] HMY: Primary data saved (53166 records). [2025-10-22T19:13:25.290131] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-22T19:13:25.290235] [INFO ] [MAIN ] Update Progress: 1039/2367 symbols completed. HMY took 41.2s. Estimated remaining: 2h 50m 26s. Rate: 7.8 symbols/min [2025-10-22T19:13:26.896636] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T19:13:26.907442] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-22T19:13:28.643526] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T19:13:28.655691] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-22T19:13:30.246018] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T19:13:30.254762] [INFO ] [REMOTE ] HOG: Full fetch complete (74290 records). [2025-10-22T19:13:30.254940] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-22T19:13:30.650563] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-22T19:13:30.650688] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-22T19:13:30.651606] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-22T19:13:30.651689] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-22T19:13:30.653213] [DEBUG] [LOCAL ] HOG: Trimmed 74290 records to 50639 (keeping 200 days of data) [2025-10-22T19:13:30.955205] [DEBUG] [LOCAL ] HOG: Primary data saved (50639 records). [2025-10-22T19:13:30.955345] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-22T19:13:30.955422] [INFO ] [MAIN ] Update Progress: 1040/2367 symbols completed. HOG took 33.8s. Estimated remaining: 2h 50m 16s. Rate: 7.8 symbols/min [2025-10-22T19:13:31.640624] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:13:31.704091] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:13:31.779441] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:13:31.777358] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:13:31.792323] [DEBUG] [LOCAL ] HOV: Loaded 13930 existing records from primary storage. [2025-10-22T19:13:31.792744] [INFO ] [MAIN ] HOV: Loaded 13930 existing records. [2025-10-22T19:13:32.021295] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:13:32.061353] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-22T19:13:32.077979] [DEBUG] [LOCAL ] HOUS: Loaded 45708 existing records from primary storage. [2025-10-22T19:13:32.079875] [INFO ] [MAIN ] HOUS: Loaded 45708 existing records. [2025-10-22T19:13:32.079672] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-22T19:13:32.080995] [DEBUG] [LOCAL ] HP: Loaded 51425 existing records from primary storage. [2025-10-22T19:13:32.093434] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-22T19:13:32.119434] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-22T19:13:32.104586] [INFO ] [MAIN ] HP: Loaded 51425 existing records. [2025-10-22T19:13:32.461682] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-22T19:13:32.582752] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-22T19:13:32.644604] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:13:32.714062] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-22T19:13:32.748876] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-22T19:13:32.856618] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-22T19:13:32.865269] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-22T19:13:32.899879] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:13:32.956970] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-22T19:13:32.988946] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-22T19:13:33.101697] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-22T19:13:33.176795] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-22T19:13:33.277593] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:13:33.308346] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:33.355555] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-22T19:13:33.350150] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-22T19:13:33.371183] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-22T19:13:33.420030] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-22T19:13:33.430538] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-22T19:13:34.067829] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:34.078627] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-22T19:13:34.273018] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:34.278747] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-22T19:13:34.377672] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:34.378122] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-22T19:13:34.429886] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T19:13:34.432850] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-22T19:13:35.167574] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T19:13:35.170959] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-22T19:13:35.483035] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T19:13:35.492182] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-22T19:13:35.519019] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T19:13:35.529153] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-22T19:13:35.969131] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T19:13:35.972061] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-22T19:13:36.220825] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:13:36.231301] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-22T19:13:36.635696] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T19:13:36.639037] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-22T19:13:36.927103] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T19:13:36.935116] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-22T19:13:37.075988] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T19:13:37.085807] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-22T19:13:37.510538] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T19:13:37.513286] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-22T19:13:38.044543] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T19:13:38.055219] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-22T19:13:38.114844] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T19:13:38.183788] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-22T19:13:38.517753] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-22T19:13:38.757299] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T19:13:39.317636] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-22T19:13:39.449036] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T19:13:40.108313] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T19:13:40.118820] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-22T19:13:40.917699] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-22T19:13:41.005727] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:13:41.060443] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T19:13:41.717671] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-22T19:13:42.519973] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-22T19:13:42.533500] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T19:13:42.575000] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T19:13:43.317742] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-22T19:13:44.117669] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-22T19:13:44.152459] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T19:13:44.851365] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:13:44.917686] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-22T19:13:45.114538] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T19:13:45.116784] [INFO ] [REMOTE ] HOV: Full fetch complete (18957 records). [2025-10-22T19:13:45.116852] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-22T19:13:45.489209] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-22T19:13:45.489284] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-22T19:13:45.489731] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-22T19:13:45.489796] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-22T19:13:45.490404] [DEBUG] [LOCAL ] HOV: Trimmed 18957 records to 13798 (keeping 200 days of data) [2025-10-22T19:13:45.572196] [DEBUG] [LOCAL ] HOV: Primary data saved (13798 records). [2025-10-22T19:13:45.572323] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-22T19:13:45.572563] [INFO ] [MAIN ] Update Progress: 1041/2367 symbols completed. HOV took 14.6s. Estimated remaining: 2h 50m 17s. Rate: 7.8 symbols/min [2025-10-22T19:13:45.739469] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-22T19:13:45.742789] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:13:45.754179] [DEBUG] [LOCAL ] HPF: Loaded 7532 existing records from primary storage. [2025-10-22T19:13:45.754447] [INFO ] [MAIN ] HPF: Loaded 7532 existing records. [2025-10-22T19:13:45.929785] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:13:45.930008] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-22T19:13:45.930055] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-22T19:13:45.930193] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-22T19:13:45.930229] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-22T19:13:46.285058] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:46.517626] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-22T19:13:47.282349] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-22T19:13:47.280506] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T19:13:47.317612] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-22T19:13:47.800850] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T19:13:48.117768] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-22T19:13:48.738441] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T19:13:48.917685] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-22T19:13:49.195538] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T19:13:49.717840] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-22T19:13:50.517695] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-22T19:13:50.895688] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T19:13:51.176124] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T19:13:51.317697] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-22T19:13:51.498993] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T19:13:52.117686] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-22T19:13:52.820491] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:13:52.917633] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-22T19:13:53.717808] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-22T19:13:53.769683] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T19:13:53.995453] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T19:13:54.517679] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-22T19:13:55.256305] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T19:13:55.317630] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-22T19:13:55.485322] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T19:13:56.042851] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T19:13:56.117624] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-22T19:13:56.917737] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-22T19:13:56.926213] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T19:13:57.717754] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-22T19:13:58.428588] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-22T19:13:58.517637] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-22T19:13:58.903713] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:13:59.317740] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-22T19:14:00.117664] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-22T19:14:00.434510] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T19:14:00.442526] [INFO ] [REMOTE ] HP: Full fetch complete (74108 records). [2025-10-22T19:14:00.442635] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-22T19:14:00.829321] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-22T19:14:00.829411] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-22T19:14:00.830312] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-22T19:14:00.830375] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-22T19:14:00.831753] [DEBUG] [LOCAL ] HP: Trimmed 74108 records to 51399 (keeping 200 days of data) [2025-10-22T19:14:00.919995] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-22T19:14:00.961085] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T19:14:01.148599] [DEBUG] [LOCAL ] HP: Primary data saved (51399 records). [2025-10-22T19:14:01.148754] [INFO ] [MAIN ] HP: Full history saved. [2025-10-22T19:14:01.148840] [INFO ] [MAIN ] Update Progress: 1042/2367 symbols completed. HP took 30.1s. Estimated remaining: 2h 50m 19s. Rate: 7.8 symbols/min [2025-10-22T19:14:01.360012] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:01.402529] [DEBUG] [LOCAL ] HPI: Loaded 10779 existing records from primary storage. [2025-10-22T19:14:01.402860] [INFO ] [MAIN ] HPI: Loaded 10779 existing records. [2025-10-22T19:14:01.410241] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T19:14:01.610081] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:01.610331] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-22T19:14:01.610382] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-22T19:14:01.610693] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-22T19:14:01.610753] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-22T19:14:01.720068] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-22T19:14:01.987879] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:02.517056] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T19:14:02.525565] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-22T19:14:02.550032] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T19:14:02.551776] [INFO ] [REMOTE ] HPF: Full fetch complete (10512 records). [2025-10-22T19:14:02.551880] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-22T19:14:02.928455] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-22T19:14:02.928540] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-22T19:14:02.928838] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-22T19:14:02.928921] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-22T19:14:02.929389] [DEBUG] [LOCAL ] HPF: Trimmed 10512 records to 7482 (keeping 200 days of data) [2025-10-22T19:14:02.975472] [DEBUG] [LOCAL ] HPF: Primary data saved (7482 records). [2025-10-22T19:14:02.975604] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-22T19:14:02.975705] [INFO ] [MAIN ] Update Progress: 1043/2367 symbols completed. HPF took 17.4s. Estimated remaining: 2h 50m 4s. Rate: 7.8 symbols/min [2025-10-22T19:14:03.153099] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:03.205143] [DEBUG] [LOCAL ] HPP: Loaded 51238 existing records from primary storage. [2025-10-22T19:14:03.205494] [INFO ] [MAIN ] HPP: Loaded 51238 existing records. [2025-10-22T19:14:03.322801] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-22T19:14:03.390457] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:03.390731] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-22T19:14:03.390792] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-22T19:14:03.391107] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-22T19:14:03.391163] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-22T19:14:03.753520] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:04.117749] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-22T19:14:04.917674] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-22T19:14:05.181068] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-22T19:14:05.717752] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-22T19:14:05.745740] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:14:05.779758] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-22T19:14:06.342110] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T19:14:06.517630] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-22T19:14:07.128428] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T19:14:07.317733] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-22T19:14:07.559114] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T19:14:07.568086] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-22T19:14:07.568249] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-22T19:14:07.957506] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-22T19:14:07.957619] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-22T19:14:07.958573] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-22T19:14:07.958639] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-22T19:14:07.960043] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 53697 (keeping 200 days of data) [2025-10-22T19:14:08.133616] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-22T19:14:08.286190] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-22T19:14:08.286316] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-22T19:14:08.286394] [INFO ] [MAIN ] Update Progress: 1044/2367 symbols completed. HPE took 37.3s. Estimated remaining: 2h 49m 53s. Rate: 7.8 symbols/min [2025-10-22T19:14:08.458786] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:08.505904] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-22T19:14:08.506230] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-22T19:14:08.681076] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:08.681268] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-22T19:14:08.681314] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-22T19:14:08.681497] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-22T19:14:08.681536] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-22T19:14:08.923481] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-22T19:14:08.971950] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-22T19:14:09.053837] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:09.080155] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T19:14:09.717739] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-22T19:14:10.517636] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-22T19:14:10.652347] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:14:11.042422] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T19:14:11.317634] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-22T19:14:11.627626] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T19:14:12.117770] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-22T19:14:12.716508] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T19:14:12.917626] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-22T19:14:13.717761] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-22T19:14:13.862749] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T19:14:14.517698] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-22T19:14:14.836132] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T19:14:14.845042] [INFO ] [REMOTE ] HOUS: Full fetch complete (64693 records). [2025-10-22T19:14:14.845171] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-22T19:14:15.133760] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T19:14:15.281400] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:14:15.279774] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-22T19:14:15.291608] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-22T19:14:15.292580] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-22T19:14:15.292706] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-22T19:14:15.293944] [DEBUG] [LOCAL ] HOUS: Trimmed 64693 records to 45734 (keeping 200 days of data) [2025-10-22T19:14:15.338764] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-22T19:14:15.553605] [DEBUG] [LOCAL ] HOUS: Primary data saved (45734 records). [2025-10-22T19:14:15.553771] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-22T19:14:15.553899] [INFO ] [MAIN ] Update Progress: 1045/2367 symbols completed. HOUS took 44.6s. Estimated remaining: 2h 49m 45s. Rate: 7.8 symbols/min [2025-10-22T19:14:15.717083] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:15.728541] [DEBUG] [LOCAL ] HPS: Loaded 10360 existing records from primary storage. [2025-10-22T19:14:15.728908] [INFO ] [MAIN ] HPS: Loaded 10360 existing records. [2025-10-22T19:14:15.899003] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:15.899239] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-22T19:14:15.899286] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-22T19:14:15.899463] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-22T19:14:15.899518] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-22T19:14:16.125820] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-22T19:14:16.247794] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:16.917626] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-22T19:14:17.041703] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T19:14:17.703414] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T19:14:17.717618] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-22T19:14:18.176327] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T19:14:18.274699] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T19:14:18.517620] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-22T19:14:19.033972] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-22T19:14:19.317676] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-22T19:14:20.117683] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-22T19:14:20.134142] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T19:14:20.917693] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-22T19:14:21.714617] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T19:14:21.717000] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T19:14:21.719777] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-22T19:14:22.512803] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T19:14:22.517605] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-22T19:14:23.317682] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-22T19:14:23.456801] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T19:14:24.064888] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T19:14:24.117758] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-22T19:14:24.917799] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-22T19:14:25.176696] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T19:14:25.717746] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-22T19:14:26.517672] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-22T19:14:26.609706] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T19:14:27.317691] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-22T19:14:27.653405] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T19:14:28.117691] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-22T19:14:28.755916] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-10-22T19:14:28.917619] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-22T19:14:28.960629] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T19:14:29.174777] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T19:14:29.717745] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-22T19:14:30.517761] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-22T19:14:30.726137] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T19:14:30.729542] [INFO ] [REMOTE ] HPI: Full fetch complete (13864 records). [2025-10-22T19:14:30.729748] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-22T19:14:31.217253] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-22T19:14:31.217429] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-22T19:14:31.217933] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-22T19:14:31.218110] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-22T19:14:31.218975] [DEBUG] [LOCAL ] HPI: Trimmed 13864 records to 10731 (keeping 200 days of data) [2025-10-22T19:14:31.288220] [DEBUG] [LOCAL ] HPI: Primary data saved (10731 records). [2025-10-22T19:14:31.310343] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-22T19:14:31.335449] [INFO ] [MAIN ] Update Progress: 1046/2367 symbols completed. HPI took 30.2s. Estimated remaining: 2h 49m 47s. Rate: 7.8 symbols/min [2025-10-22T19:14:31.331020] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-22T19:14:31.387441] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-22T19:14:31.544043] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:31.574116] [DEBUG] [LOCAL ] HQH: Loaded 25808 existing records from primary storage. [2025-10-22T19:14:31.574374] [INFO ] [MAIN ] HQH: Loaded 25808 existing records. [2025-10-22T19:14:31.761492] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:31.761746] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-22T19:14:31.761801] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-22T19:14:31.761997] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-22T19:14:31.762052] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-22T19:14:32.140979] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-22T19:14:32.144565] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:32.153683] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T19:14:32.366934] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T19:14:32.917694] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-22T19:14:33.717681] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-22T19:14:34.126424] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-22T19:14:34.201360] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T19:14:34.209678] [INFO ] [REMOTE ] HPP: Full fetch complete (73360 records). [2025-10-22T19:14:34.209803] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-22T19:14:34.522415] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-22T19:14:34.557219] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T19:14:34.619075] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-22T19:14:34.619155] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-22T19:14:34.620123] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-22T19:14:34.620186] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-22T19:14:34.621564] [DEBUG] [LOCAL ] HPP: Trimmed 73360 records to 51224 (keeping 200 days of data) [2025-10-22T19:14:34.897320] [DEBUG] [LOCAL ] HPP: Primary data saved (51224 records). [2025-10-22T19:14:34.897466] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-22T19:14:34.898050] [INFO ] [MAIN ] Update Progress: 1047/2367 symbols completed. HPP took 31.9s. Estimated remaining: 2h 49m 35s. Rate: 7.8 symbols/min [2025-10-22T19:14:35.064109] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:35.082411] [DEBUG] [LOCAL ] HQL: Loaded 16952 existing records from primary storage. [2025-10-22T19:14:35.082667] [INFO ] [MAIN ] HQL: Loaded 16952 existing records. [2025-10-22T19:14:35.257161] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:35.257414] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-22T19:14:35.257466] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-22T19:14:35.257682] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-22T19:14:35.257864] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-22T19:14:35.322963] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-22T19:14:35.603681] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:36.117622] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-22T19:14:36.203975] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:14:36.590229] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T19:14:36.592371] [INFO ] [REMOTE ] HPS: Full fetch complete (15108 records). [2025-10-22T19:14:36.592439] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-22T19:14:36.919158] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-22T19:14:36.957378] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-22T19:14:36.957497] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-22T19:14:36.957924] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-22T19:14:36.957985] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-22T19:14:36.958462] [DEBUG] [LOCAL ] HPS: Trimmed 15108 records to 10322 (keeping 200 days of data) [2025-10-22T19:14:37.021178] [DEBUG] [LOCAL ] HPS: Primary data saved (10322 records). [2025-10-22T19:14:37.021300] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-22T19:14:37.021376] [INFO ] [MAIN ] Update Progress: 1048/2367 symbols completed. HPS took 21.5s. Estimated remaining: 2h 49m 20s. Rate: 7.8 symbols/min [2025-10-22T19:14:37.186316] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:37.233418] [DEBUG] [LOCAL ] HR: Loaded 52114 existing records from primary storage. [2025-10-22T19:14:37.233763] [INFO ] [MAIN ] HR: Loaded 52114 existing records. [2025-10-22T19:14:37.410722] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:37.411000] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-22T19:14:37.411057] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-22T19:14:37.411265] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-22T19:14:37.411320] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-22T19:14:37.722916] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-22T19:14:37.789611] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:38.394315] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T19:14:38.517695] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-22T19:14:38.735961] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-22T19:14:38.849361] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:14:39.317744] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-22T19:14:40.122729] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-22T19:14:40.140450] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:14:40.449278] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T19:14:40.917633] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-22T19:14:41.306862] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:14:41.717748] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-22T19:14:42.024615] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T19:14:42.517668] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-22T19:14:42.927016] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T19:14:43.317678] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-22T19:14:44.117668] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-22T19:14:44.216748] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:14:44.612336] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T19:14:44.917706] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-22T19:14:44.936566] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T19:14:45.717639] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-22T19:14:46.519867] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-22T19:14:46.522820] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T19:14:47.317757] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-22T19:14:47.434293] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T19:14:47.655080] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:14:48.117680] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-22T19:14:48.249928] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T19:14:48.258860] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-22T19:14:48.259000] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-22T19:14:48.651447] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-22T19:14:48.651526] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-22T19:14:48.652536] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-22T19:14:48.652600] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-22T19:14:48.654121] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 53669 (keeping 200 days of data) [2025-10-22T19:14:48.932047] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-22T19:14:48.980153] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-22T19:14:48.980264] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-22T19:14:48.980341] [INFO ] [MAIN ] Update Progress: 1049/2367 symbols completed. HPQ took 40.7s. Estimated remaining: 2h 49m 17s. Rate: 7.8 symbols/min [2025-10-22T19:14:49.148403] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:49.188102] [DEBUG] [LOCAL ] HRB: Loaded 48267 existing records from primary storage. [2025-10-22T19:14:49.188421] [INFO ] [MAIN ] HRB: Loaded 48267 existing records. [2025-10-22T19:14:49.369727] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:49.370003] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-22T19:14:49.370062] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-22T19:14:49.370494] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-22T19:14:49.370550] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-22T19:14:49.736064] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-22T19:14:49.735941] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:49.988870] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:14:50.133026] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T19:14:50.517675] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-22T19:14:50.778674] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T19:14:51.317704] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-22T19:14:51.701673] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T19:14:52.117688] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-22T19:14:52.917629] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-22T19:14:53.105806] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:14:53.147777] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T19:14:53.717745] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-22T19:14:54.517674] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-22T19:14:54.689705] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T19:14:54.762514] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T19:14:55.317769] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-22T19:14:56.117637] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-22T19:14:56.283354] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T19:14:56.440140] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T19:14:56.917700] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-22T19:14:57.281081] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T19:14:57.717750] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-22T19:14:58.517738] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-22T19:14:58.585508] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T19:14:58.795199] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T19:14:59.317692] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-22T19:15:00.082153] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:15:00.117666] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-22T19:15:00.659436] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T19:15:00.663749] [INFO ] [REMOTE ] HQL: Full fetch complete (25304 records). [2025-10-22T19:15:00.663842] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-22T19:15:00.922801] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-22T19:15:01.034703] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-22T19:15:01.034797] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-22T19:15:01.035331] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-22T19:15:01.035372] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-22T19:15:01.036170] [DEBUG] [LOCAL ] HQL: Trimmed 25304 records to 16898 (keeping 200 days of data) [2025-10-22T19:15:01.139065] [DEBUG] [LOCAL ] HQL: Primary data saved (16898 records). [2025-10-22T19:15:01.139227] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-22T19:15:01.139310] [INFO ] [MAIN ] Update Progress: 1050/2367 symbols completed. HQL took 26.2s. Estimated remaining: 2h 49m 15s. Rate: 7.8 symbols/min [2025-10-22T19:15:01.312704] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:01.349551] [DEBUG] [LOCAL ] HRI: Loaded 32283 existing records from primary storage. [2025-10-22T19:15:01.349980] [INFO ] [MAIN ] HRI: Loaded 32283 existing records. [2025-10-22T19:15:01.623829] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:01.624234] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-22T19:15:01.624306] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-22T19:15:01.624689] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-22T19:15:01.624760] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-22T19:15:01.718688] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-22T19:15:02.042772] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:02.075140] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T19:15:02.517702] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-22T19:15:03.015464] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-22T19:15:03.163936] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T19:15:03.168912] [INFO ] [REMOTE ] HQH: Full fetch complete (36985 records). [2025-10-22T19:15:03.169016] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-22T19:15:03.343511] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-22T19:15:03.545961] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-22T19:15:03.546064] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-22T19:15:03.546765] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-22T19:15:03.546828] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-22T19:15:03.547638] [DEBUG] [LOCAL ] HQH: Trimmed 36985 records to 25772 (keeping 200 days of data) [2025-10-22T19:15:03.699562] [DEBUG] [LOCAL ] HQH: Primary data saved (25772 records). [2025-10-22T19:15:03.699717] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-22T19:15:03.699840] [INFO ] [MAIN ] Update Progress: 1051/2367 symbols completed. HQH took 32.4s. Estimated remaining: 2h 49m 1s. Rate: 7.8 symbols/min [2025-10-22T19:15:03.871535] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:03.886962] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T19:15:03.935625] [DEBUG] [LOCAL ] HRL: Loaded 53126 existing records from primary storage. [2025-10-22T19:15:03.935988] [INFO ] [MAIN ] HRL: Loaded 53126 existing records. [2025-10-22T19:15:04.111672] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:04.111911] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-22T19:15:04.111963] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-22T19:15:04.112304] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-22T19:15:04.112360] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-22T19:15:04.123407] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-22T19:15:04.461610] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:04.917633] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-22T19:15:05.196858] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T19:15:05.717690] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-22T19:15:06.046399] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T19:15:06.517774] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-22T19:15:06.754593] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:15:07.288554] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T19:15:07.317635] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-22T19:15:08.109684] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T19:15:08.120048] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-22T19:15:08.917665] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-22T19:15:09.000080] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T19:15:09.669175] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T19:15:09.717639] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-22T19:15:10.517750] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-22T19:15:11.317758] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-22T19:15:11.612869] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-22T19:15:11.622355] [INFO ] [REMOTE ] HR: Full fetch complete (75073 records). [2025-10-22T19:15:11.622510] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-22T19:15:12.043927] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-22T19:15:12.044196] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-22T19:15:12.045214] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-22T19:15:12.045297] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-22T19:15:12.068451] [DEBUG] [LOCAL ] HR: Trimmed 75073 records to 52108 (keeping 200 days of data) [2025-10-22T19:15:12.069956] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-22T19:15:12.139043] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-22T19:15:12.386628] [DEBUG] [LOCAL ] HR: Primary data saved (52108 records). [2025-10-22T19:15:12.386790] [INFO ] [MAIN ] HR: Full history saved. [2025-10-22T19:15:12.386867] [INFO ] [MAIN ] Update Progress: 1052/2367 symbols completed. HR took 35.4s. Estimated remaining: 2h 48m 55s. Rate: 7.8 symbols/min [2025-10-22T19:15:12.554283] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:12.586246] [DEBUG] [LOCAL ] HRTG: Loaded 34543 existing records from primary storage. [2025-10-22T19:15:12.586519] [INFO ] [MAIN ] HRTG: Loaded 34543 existing records. [2025-10-22T19:15:12.762685] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:12.763041] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-22T19:15:12.763226] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-22T19:15:12.763431] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-22T19:15:12.763471] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-22T19:15:13.133673] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:13.134284] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-22T19:15:13.196532] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-22T19:15:13.208701] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T19:15:13.717742] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-22T19:15:13.843110] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:15:14.326850] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-22T19:15:14.517695] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-22T19:15:15.317759] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-22T19:15:15.658210] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T19:15:15.702053] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:15:16.117685] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-22T19:15:16.917735] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-22T19:15:17.392249] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T19:15:17.717753] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-22T19:15:18.072162] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T19:15:18.297125] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T19:15:18.517664] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-22T19:15:18.772228] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T19:15:19.317705] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-22T19:15:20.124591] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-22T19:15:20.129770] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T19:15:20.917735] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-22T19:15:21.313614] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T19:15:21.685891] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:15:21.717614] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-22T19:15:22.517740] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-22T19:15:22.795809] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T19:15:23.108163] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T19:15:23.317776] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-22T19:15:24.117692] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-22T19:15:24.255418] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:15:24.263379] [INFO ] [REMOTE ] HRB: Full fetch complete (69974 records). [2025-10-22T19:15:24.263547] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-22T19:15:24.671536] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-22T19:15:24.671671] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-22T19:15:24.672619] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-22T19:15:24.672729] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-22T19:15:24.674341] [DEBUG] [LOCAL ] HRB: Trimmed 69974 records to 48219 (keeping 200 days of data) [2025-10-22T19:15:24.783837] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T19:15:24.917903] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-22T19:15:24.996350] [DEBUG] [LOCAL ] HRB: Primary data saved (48219 records). [2025-10-22T19:15:24.996476] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-22T19:15:24.996553] [INFO ] [MAIN ] Update Progress: 1053/2367 symbols completed. HRB took 36.0s. Estimated remaining: 2h 48m 53s. Rate: 7.8 symbols/min [2025-10-22T19:15:25.161075] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:25.205756] [DEBUG] [LOCAL ] HSBC: Loaded 50992 existing records from primary storage. [2025-10-22T19:15:25.206042] [INFO ] [MAIN ] HSBC: Loaded 50992 existing records. [2025-10-22T19:15:25.392146] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:25.392518] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-22T19:15:25.392631] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-22T19:15:25.392974] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-22T19:15:25.393110] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-22T19:15:25.530173] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T19:15:25.722767] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-22T19:15:25.778675] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:26.517769] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-22T19:15:27.034400] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-22T19:15:27.317746] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-22T19:15:27.430547] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T19:15:27.511070] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T19:15:28.117676] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-22T19:15:28.917757] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-22T19:15:29.240169] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T19:15:29.644407] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T19:15:29.717681] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-22T19:15:30.517637] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-22T19:15:30.868591] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T19:15:30.901796] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T19:15:31.317740] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-22T19:15:32.068431] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T19:15:32.117620] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-22T19:15:32.883674] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T19:15:32.889549] [INFO ] [REMOTE ] HRTG: Full fetch complete (44429 records). [2025-10-22T19:15:32.889667] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-22T19:15:32.922833] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-22T19:15:33.269916] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-22T19:15:33.269989] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-22T19:15:33.270627] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-22T19:15:33.270704] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-22T19:15:33.271628] [DEBUG] [LOCAL ] HRTG: Trimmed 44429 records to 34520 (keeping 200 days of data) [2025-10-22T19:15:33.464740] [DEBUG] [LOCAL ] HRTG: Primary data saved (34520 records). [2025-10-22T19:15:33.464858] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-22T19:15:33.464934] [INFO ] [MAIN ] Update Progress: 1054/2367 symbols completed. HRTG took 21.1s. Estimated remaining: 2h 48m 46s. Rate: 7.8 symbols/min [2025-10-22T19:15:33.633116] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:33.647415] [DEBUG] [LOCAL ] HSHP: Loaded 14708 existing records from primary storage. [2025-10-22T19:15:33.647609] [INFO ] [MAIN ] HSHP: Loaded 14708 existing records. [2025-10-22T19:15:33.722011] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-22T19:15:33.824277] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:33.824590] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-22T19:15:33.824673] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-22T19:15:33.824842] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-22T19:15:33.824882] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-22T19:15:34.208089] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:34.210011] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-22T19:15:34.517626] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-22T19:15:34.898772] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T19:15:34.924704] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T19:15:34.929703] [INFO ] [REMOTE ] HRI: Full fetch complete (46713 records). [2025-10-22T19:15:34.929798] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-22T19:15:35.308220] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-22T19:15:35.308298] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-22T19:15:35.309008] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-22T19:15:35.309069] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-22T19:15:35.310041] [DEBUG] [LOCAL ] HRI: Trimmed 46713 records to 32142 (keeping 200 days of data) [2025-10-22T19:15:35.367601] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-22T19:15:35.512088] [DEBUG] [LOCAL ] HRI: Primary data saved (32142 records). [2025-10-22T19:15:35.512251] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-22T19:15:35.512365] [INFO ] [MAIN ] Update Progress: 1055/2367 symbols completed. HRI took 34.4s. Estimated remaining: 2h 48m 32s. Rate: 7.8 symbols/min [2025-10-22T19:15:35.683335] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:35.693361] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T19:15:35.740436] [DEBUG] [LOCAL ] HSY: Loaded 50427 existing records from primary storage. [2025-10-22T19:15:35.740764] [INFO ] [MAIN ] HSY: Loaded 50427 existing records. [2025-10-22T19:15:35.915947] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:35.916146] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-22T19:15:35.916191] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-22T19:15:35.916468] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-22T19:15:35.916505] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-22T19:15:36.128625] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-22T19:15:36.314239] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:36.917674] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-22T19:15:37.593073] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-22T19:15:37.717702] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-22T19:15:37.891400] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T19:15:38.393493] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-22T19:15:38.517621] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-22T19:15:39.317741] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-22T19:15:39.941464] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-22T19:15:39.950431] [INFO ] [REMOTE ] HRL: Full fetch complete (77035 records). [2025-10-22T19:15:39.950583] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-22T19:15:40.139046] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-22T19:15:40.246371] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T19:15:40.380830] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-22T19:15:40.380921] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-22T19:15:40.381848] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-22T19:15:40.381911] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-22T19:15:40.383386] [DEBUG] [LOCAL ] HRL: Trimmed 77035 records to 53125 (keeping 200 days of data) [2025-10-22T19:15:40.705208] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T19:15:40.766951] [DEBUG] [LOCAL ] HRL: Primary data saved (53125 records). [2025-10-22T19:15:40.767130] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-22T19:15:40.767219] [INFO ] [MAIN ] Update Progress: 1056/2367 symbols completed. HRL took 37.1s. Estimated remaining: 2h 48m 21s. Rate: 7.8 symbols/min [2025-10-22T19:15:40.920793] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-22T19:15:40.940206] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:40.941332] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-22T19:15:40.941391] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-22T19:15:40.941758] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-22T19:15:40.941822] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-22T19:15:40.941882] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-22T19:15:40.941918] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-22T19:15:41.290241] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:41.717628] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-22T19:15:42.039599] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T19:15:42.086553] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T19:15:42.517749] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-22T19:15:42.723768] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:15:42.724075] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-22T19:15:42.724180] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:15:42.724270] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-22T19:15:42.724354] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:15:42.724450] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-22T19:15:42.724532] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-22T19:15:42.724570] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-22T19:15:42.724610] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-22T19:15:42.724683] [INFO ] [MAIN ] Update Progress: 1057/2367 symbols completed. HTB took 2.0s. Estimated remaining: 2h 48m 6s. Rate: 7.8 symbols/min [2025-10-22T19:15:42.906940] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:42.928308] [DEBUG] [LOCAL ] HTD: Loaded 14308 existing records from primary storage. [2025-10-22T19:15:42.928669] [INFO ] [MAIN ] HTD: Loaded 14308 existing records. [2025-10-22T19:15:43.134985] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:43.135219] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-22T19:15:43.135267] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-22T19:15:43.135497] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-22T19:15:43.135552] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-22T19:15:43.319873] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-22T19:15:43.505159] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:43.596316] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T19:15:44.117702] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-22T19:15:44.180131] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T19:15:44.917738] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-22T19:15:44.990895] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-22T19:15:45.717750] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-22T19:15:46.517667] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-22T19:15:46.959281] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-22T19:15:47.285725] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T19:15:47.317703] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-22T19:15:47.704425] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-22T19:15:48.117701] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-22T19:15:48.218571] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T19:15:48.917675] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-22T19:15:49.717757] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-22T19:15:49.745874] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T19:15:49.947385] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T19:15:50.517639] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-22T19:15:50.713041] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T19:15:51.317752] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-22T19:15:52.117615] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-22T19:15:52.310940] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:15:52.917842] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-22T19:15:53.024473] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T19:15:53.233639] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T19:15:53.717681] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-22T19:15:53.890622] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T19:15:54.517630] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-22T19:15:54.607669] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T19:15:55.317620] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-22T19:15:55.333679] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T19:15:56.117756] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-22T19:15:56.917636] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-22T19:15:57.080747] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-22T19:15:57.120426] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T19:15:57.717673] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-22T19:15:58.517627] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-22T19:15:58.733064] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:15:58.866502] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T19:15:59.317742] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-22T19:16:00.117628] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-22T19:16:00.511374] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T19:16:00.917621] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-22T19:16:01.202875] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T19:16:01.205634] [INFO ] [REMOTE ] HSHP: Full fetch complete (23143 records). [2025-10-22T19:16:01.205740] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-22T19:16:01.592626] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-22T19:16:01.592835] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-22T19:16:01.593435] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-22T19:16:01.593483] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-22T19:16:01.594267] [DEBUG] [LOCAL ] HSHP: Trimmed 23143 records to 14457 (keeping 200 days of data) [2025-10-22T19:16:01.694623] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-22T19:16:01.720831] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-22T19:16:01.731805] [DEBUG] [LOCAL ] HSHP: Primary data saved (14457 records). [2025-10-22T19:16:01.731949] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-22T19:16:01.732050] [INFO ] [MAIN ] Update Progress: 1058/2367 symbols completed. HSHP took 28.3s. Estimated remaining: 2h 48m 12s. Rate: 7.8 symbols/min [2025-10-22T19:16:01.928122] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:01.928288] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-22T19:16:01.928324] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-22T19:16:01.928439] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-22T19:16:01.928480] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-22T19:16:01.928521] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-22T19:16:01.928552] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-22T19:16:02.274557] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:02.507626] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T19:16:02.517607] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-22T19:16:02.744071] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T19:16:02.752507] [INFO ] [REMOTE ] HSBC: Full fetch complete (74209 records). [2025-10-22T19:16:02.752630] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-22T19:16:03.145663] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-22T19:16:03.145814] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-22T19:16:03.146775] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-22T19:16:03.146846] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-22T19:16:03.148230] [DEBUG] [LOCAL ] HSBC: Trimmed 74209 records to 50990 (keeping 200 days of data) [2025-10-22T19:16:03.329742] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-22T19:16:03.461066] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T19:16:03.480567] [DEBUG] [LOCAL ] HSBC: Primary data saved (50990 records). [2025-10-22T19:16:03.480729] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-22T19:16:03.480823] [INFO ] [MAIN ] Update Progress: 1059/2367 symbols completed. HSBC took 38.5s. Estimated remaining: 2h 47m 57s. Rate: 7.8 symbols/min [2025-10-22T19:16:03.649492] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:03.692248] [DEBUG] [LOCAL ] HTGC: Loaded 47716 existing records from primary storage. [2025-10-22T19:16:03.692529] [INFO ] [MAIN ] HTGC: Loaded 47716 existing records. [2025-10-22T19:16:03.870037] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:03.870281] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-22T19:16:03.870336] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-22T19:16:03.870587] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-22T19:16:03.870670] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-22T19:16:04.122759] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-22T19:16:04.225728] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:04.917708] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-22T19:16:05.190564] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T19:16:05.193830] [INFO ] [REMOTE ] HTD: Full fetch complete (19643 records). [2025-10-22T19:16:05.193909] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-22T19:16:05.372728] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-22T19:16:05.592137] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-22T19:16:05.630469] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-22T19:16:05.630890] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-22T19:16:05.631440] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-22T19:16:05.631694] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-22T19:16:05.632723] [DEBUG] [LOCAL ] HTD: Trimmed 19643 records to 14245 (keeping 200 days of data) [2025-10-22T19:16:05.719142] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-22T19:16:05.719316] [DEBUG] [LOCAL ] HTD: Primary data saved (14245 records). [2025-10-22T19:16:05.719610] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-22T19:16:05.719755] [INFO ] [MAIN ] Update Progress: 1060/2367 symbols completed. HTD took 23.0s. Estimated remaining: 2h 47m 43s. Rate: 7.8 symbols/min [2025-10-22T19:16:05.901718] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:05.931837] [DEBUG] [LOCAL ] HTH: Loaded 32547 existing records from primary storage. [2025-10-22T19:16:05.932095] [INFO ] [MAIN ] HTH: Loaded 32547 existing records. [2025-10-22T19:16:06.112615] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:06.112896] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-22T19:16:06.112957] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-22T19:16:06.113164] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-22T19:16:06.113230] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-22T19:16:06.461011] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:06.517621] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-22T19:16:07.317630] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-22T19:16:07.584403] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T19:16:07.649839] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T19:16:08.117759] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-22T19:16:08.917703] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-22T19:16:08.991896] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T19:16:09.299562] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-22T19:16:09.620910] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:16:09.717631] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-22T19:16:10.517676] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-22T19:16:10.993921] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T19:16:11.317665] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-22T19:16:12.033313] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T19:16:12.117674] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-22T19:16:12.868478] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T19:16:12.917665] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-22T19:16:13.007969] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T19:16:13.016040] [INFO ] [REMOTE ] HSY: Full fetch complete (73637 records). [2025-10-22T19:16:13.016162] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-22T19:16:13.397836] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-22T19:16:13.397927] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-22T19:16:13.398826] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-22T19:16:13.398889] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-22T19:16:13.400321] [DEBUG] [LOCAL ] HSY: Trimmed 73637 records to 50376 (keeping 200 days of data) [2025-10-22T19:16:13.706477] [DEBUG] [LOCAL ] HSY: Primary data saved (50376 records). [2025-10-22T19:16:13.706629] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-22T19:16:13.707154] [INFO ] [MAIN ] Update Progress: 1061/2367 symbols completed. HSY took 38.2s. Estimated remaining: 2h 47m 35s. Rate: 7.8 symbols/min [2025-10-22T19:16:13.727739] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-22T19:16:13.877148] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:13.911686] [DEBUG] [LOCAL ] HUBB: Loaded 36142 existing records from primary storage. [2025-10-22T19:16:13.911971] [INFO ] [MAIN ] HUBB: Loaded 36142 existing records. [2025-10-22T19:16:14.088195] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:14.088466] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-22T19:16:14.088520] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-22T19:16:14.088909] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-22T19:16:14.088964] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-22T19:16:14.442630] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T19:16:14.478050] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:14.517615] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-22T19:16:15.323782] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-22T19:16:15.345811] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T19:16:15.723938] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T19:16:16.001798] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T19:16:16.117622] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-22T19:16:16.917737] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-22T19:16:17.717758] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-22T19:16:17.847079] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:16:18.387430] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T19:16:18.517702] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-22T19:16:18.972050] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T19:16:19.317634] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-22T19:16:20.117631] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-22T19:16:20.312740] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T19:16:20.917621] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-22T19:16:21.022358] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:16:21.354272] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T19:16:21.401696] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-22T19:16:21.717702] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-22T19:16:22.517667] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-22T19:16:22.854439] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-22T19:16:22.882692] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T19:16:23.317638] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-22T19:16:24.117685] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-22T19:16:24.690293] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T19:16:24.917681] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-22T19:16:25.235797] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-22T19:16:25.637276] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T19:16:25.717627] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-22T19:16:26.517829] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-22T19:16:27.303107] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T19:16:27.317617] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-22T19:16:27.616247] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T19:16:28.117672] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-22T19:16:28.358567] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-22T19:16:28.917666] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-22T19:16:29.143740] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T19:16:29.717680] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-22T19:16:30.135542] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T19:16:30.140773] [INFO ] [REMOTE ] HTH: Full fetch complete (46858 records). [2025-10-22T19:16:30.140878] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-22T19:16:30.511341] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-22T19:16:30.511420] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-22T19:16:30.512133] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-22T19:16:30.512195] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-22T19:16:30.513296] [DEBUG] [LOCAL ] HTH: Trimmed 46858 records to 32437 (keeping 200 days of data) [2025-10-22T19:16:30.564609] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-22T19:16:30.704323] [DEBUG] [LOCAL ] HTH: Primary data saved (32437 records). [2025-10-22T19:16:30.704441] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-22T19:16:30.704515] [INFO ] [MAIN ] Update Progress: 1062/2367 symbols completed. HTH took 25.0s. Estimated remaining: 2h 47m 39s. Rate: 7.8 symbols/min [2025-10-22T19:16:30.874220] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:30.908470] [DEBUG] [LOCAL ] HUBS: Loaded 40052 existing records from primary storage. [2025-10-22T19:16:30.908915] [INFO ] [MAIN ] HUBS: Loaded 40052 existing records. [2025-10-22T19:16:31.082831] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:31.083144] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-22T19:16:31.083235] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-22T19:16:31.083749] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-22T19:16:31.083807] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-22T19:16:31.243153] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T19:16:31.320719] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-22T19:16:31.476410] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:32.117668] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-22T19:16:32.339444] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:16:32.352238] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-22T19:16:32.832924] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T19:16:32.917697] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-22T19:16:33.717738] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-22T19:16:34.065443] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-22T19:16:34.387387] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T19:16:34.517697] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-22T19:16:35.015383] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-22T19:16:35.016117] [INFO ] [REMOTE ] HTFC: Full fetch complete (823 records). [2025-10-22T19:16:35.016186] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-22T19:16:35.196335] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-22T19:16:35.196565] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:16:35.196674] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:16:35.196772] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-22T19:16:35.196854] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-22T19:16:35.196895] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-22T19:16:35.196936] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-22T19:16:35.196992] [INFO ] [MAIN ] Update Progress: 1063/2367 symbols completed. HTFC took 33.5s. Estimated remaining: 2h 47m 28s. Rate: 7.8 symbols/min [2025-10-22T19:16:35.322752] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-22T19:16:35.368839] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:35.412747] [DEBUG] [LOCAL ] HUM: Loaded 49322 existing records from primary storage. [2025-10-22T19:16:35.413069] [INFO ] [MAIN ] HUM: Loaded 49322 existing records. [2025-10-22T19:16:35.595826] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:35.596038] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-22T19:16:35.596085] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-22T19:16:35.596272] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-22T19:16:35.596310] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-22T19:16:35.945604] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:36.117684] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-22T19:16:36.917627] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-22T19:16:37.076336] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:16:37.478764] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T19:16:37.717638] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-22T19:16:37.975561] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T19:16:38.517682] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-22T19:16:39.317699] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-22T19:16:39.517622] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T19:16:40.110173] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T19:16:40.119171] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-22T19:16:40.739714] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T19:16:40.917675] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-22T19:16:41.717670] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-22T19:16:41.825227] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:16:42.517694] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-22T19:16:42.875076] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:16:42.883533] [INFO ] [REMOTE ] HTGC: Full fetch complete (68900 records). [2025-10-22T19:16:42.883713] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-22T19:16:43.277701] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T19:16:43.317917] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-22T19:16:43.322771] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-22T19:16:43.323123] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-22T19:16:43.324108] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-22T19:16:43.324278] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-22T19:16:43.325533] [DEBUG] [LOCAL ] HTGC: Trimmed 68900 records to 47694 (keeping 200 days of data) [2025-10-22T19:16:43.611732] [DEBUG] [LOCAL ] HTGC: Primary data saved (47694 records). [2025-10-22T19:16:43.611865] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-22T19:16:43.611953] [INFO ] [MAIN ] Update Progress: 1064/2367 symbols completed. HTGC took 40.1s. Estimated remaining: 2h 47m 21s. Rate: 7.8 symbols/min [2025-10-22T19:16:43.793519] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:43.845844] [DEBUG] [LOCAL ] HUN: Loaded 53211 existing records from primary storage. [2025-10-22T19:16:43.846177] [INFO ] [MAIN ] HUN: Loaded 53211 existing records. [2025-10-22T19:16:44.044085] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:44.044433] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-22T19:16:44.044553] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-22T19:16:44.044948] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-22T19:16:44.045010] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-22T19:16:44.131708] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-22T19:16:44.452680] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:44.456043] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T19:16:44.811328] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:16:44.817201] [INFO ] [REMOTE ] HUBB: Full fetch complete (54320 records). [2025-10-22T19:16:44.817322] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-22T19:16:44.920888] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-22T19:16:45.220978] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-22T19:16:45.221054] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-22T19:16:45.221813] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-22T19:16:45.221877] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-22T19:16:45.222984] [DEBUG] [LOCAL ] HUBB: Trimmed 54320 records to 36083 (keeping 200 days of data) [2025-10-22T19:16:45.448974] [DEBUG] [LOCAL ] HUBB: Primary data saved (36083 records). [2025-10-22T19:16:45.449114] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-22T19:16:45.449615] [INFO ] [MAIN ] Update Progress: 1065/2367 symbols completed. HUBB took 31.7s. Estimated remaining: 2h 47m 6s. Rate: 7.8 symbols/min [2025-10-22T19:16:45.618467] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:45.658747] [DEBUG] [LOCAL ] HUYA: Loaded 43629 existing records from primary storage. [2025-10-22T19:16:45.659041] [INFO ] [MAIN ] HUYA: Loaded 43629 existing records. [2025-10-22T19:16:45.723710] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-22T19:16:45.843987] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:45.844477] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-22T19:16:45.844560] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-22T19:16:45.844922] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-22T19:16:45.844988] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-22T19:16:46.173587] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T19:16:46.275971] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:46.517637] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-22T19:16:46.873713] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T19:16:47.317699] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-22T19:16:47.535872] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T19:16:48.050542] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:16:48.117677] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-22T19:16:48.917630] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-22T19:16:49.106103] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:16:49.480802] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T19:16:49.717695] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-22T19:16:50.222143] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T19:16:50.517700] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-22T19:16:51.182209] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T19:16:51.317674] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-22T19:16:51.674146] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T19:16:52.117689] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-22T19:16:52.728560] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:16:52.917703] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-22T19:16:53.727690] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-22T19:16:53.730143] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T19:16:54.200520] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T19:16:54.517768] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-22T19:16:55.317695] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-22T19:16:55.478545] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T19:16:55.958484] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:16:55.966494] [INFO ] [REMOTE ] HUBS: Full fetch complete (57063 records). [2025-10-22T19:16:55.966727] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-22T19:16:56.124000] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-22T19:16:56.390745] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-22T19:16:56.390893] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-22T19:16:56.392104] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-22T19:16:56.392202] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-22T19:16:56.394115] [DEBUG] [LOCAL ] HUBS: Trimmed 57063 records to 39936 (keeping 200 days of data) [2025-10-22T19:16:56.659514] [DEBUG] [LOCAL ] HUBS: Primary data saved (39936 records). [2025-10-22T19:16:56.659777] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-22T19:16:56.659895] [INFO ] [MAIN ] Update Progress: 1066/2367 symbols completed. HUBS took 26.0s. Estimated remaining: 2h 47m 2s. Rate: 7.8 symbols/min [2025-10-22T19:16:56.843786] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:56.863874] [DEBUG] [LOCAL ] HVT: Loaded 14899 existing records from primary storage. [2025-10-22T19:16:56.864260] [INFO ] [MAIN ] HVT: Loaded 14899 existing records. [2025-10-22T19:16:56.935366] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-22T19:16:57.061510] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:57.062019] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-22T19:16:57.062145] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-22T19:16:57.062439] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-22T19:16:57.062502] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-22T19:16:57.399889] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-22T19:16:57.492348] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:57.717708] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-22T19:16:57.871489] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T19:16:58.383852] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T19:16:58.517700] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-22T19:16:59.317666] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-22T19:16:59.469701] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T19:17:00.128474] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-22T19:17:00.134897] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T19:17:00.732226] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T19:17:00.917678] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-22T19:17:01.178733] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T19:17:01.717785] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-22T19:17:02.517755] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-22T19:17:02.641896] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T19:17:02.679880] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T19:17:03.317771] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-22T19:17:04.117688] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-22T19:17:04.424748] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T19:17:04.809957] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T19:17:04.917636] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-22T19:17:05.190825] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T19:17:05.717685] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-22T19:17:06.278285] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T19:17:06.517698] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-22T19:17:06.778957] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T19:17:07.318391] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-22T19:17:08.097100] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T19:17:08.117612] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-22T19:17:08.917690] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-22T19:17:09.073625] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:17:09.717749] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-22T19:17:09.932998] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T19:17:09.955146] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T19:17:10.517699] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-22T19:17:11.324156] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-22T19:17:11.345837] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T19:17:12.122912] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-22T19:17:12.137473] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:17:12.917628] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-22T19:17:13.028304] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T19:17:13.178039] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T19:17:13.186460] [INFO ] [REMOTE ] HUM: Full fetch complete (71165 records). [2025-10-22T19:17:13.186622] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-22T19:17:13.576245] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-22T19:17:13.576342] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-22T19:17:13.577345] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-22T19:17:13.577414] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-22T19:17:13.579075] [DEBUG] [LOCAL ] HUM: Trimmed 71165 records to 49274 (keeping 200 days of data) [2025-10-22T19:17:13.756134] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-22T19:17:13.886284] [DEBUG] [LOCAL ] HUM: Primary data saved (49274 records). [2025-10-22T19:17:13.886445] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-22T19:17:13.886557] [INFO ] [MAIN ] Update Progress: 1067/2367 symbols completed. HUM took 38.7s. Estimated remaining: 2h 47m 6s. Rate: 7.8 symbols/min [2025-10-22T19:17:14.056830] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:14.106497] [DEBUG] [LOCAL ] HWM: Loaded 52705 existing records from primary storage. [2025-10-22T19:17:14.106848] [INFO ] [MAIN ] HWM: Loaded 52705 existing records. [2025-10-22T19:17:14.281886] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:17:14.282082] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-22T19:17:14.282127] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-22T19:17:14.282313] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-22T19:17:14.282350] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-22T19:17:14.525394] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-22T19:17:14.673884] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:17:14.679231] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:15.317692] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-22T19:17:15.553915] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T19:17:15.572463] [INFO ] [REMOTE ] HUN: Full fetch complete (76999 records). [2025-10-22T19:17:15.573692] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-22T19:17:15.573251] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-22T19:17:15.964305] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-22T19:17:15.964383] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-22T19:17:15.965307] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-22T19:17:15.965368] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-22T19:17:15.966790] [DEBUG] [LOCAL ] HUN: Trimmed 76999 records to 53210 (keeping 200 days of data) [2025-10-22T19:17:16.136789] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-22T19:17:16.284556] [DEBUG] [LOCAL ] HUN: Primary data saved (53210 records). [2025-10-22T19:17:16.284728] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-22T19:17:16.284836] [INFO ] [MAIN ] Update Progress: 1068/2367 symbols completed. HUN took 32.7s. Estimated remaining: 2h 46m 52s. Rate: 7.8 symbols/min [2025-10-22T19:17:16.458417] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:16.499719] [DEBUG] [LOCAL ] HXL: Loaded 45797 existing records from primary storage. [2025-10-22T19:17:16.500008] [INFO ] [MAIN ] HXL: Loaded 45797 existing records. [2025-10-22T19:17:16.681113] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:17:16.681534] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-22T19:17:16.681749] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-22T19:17:16.681991] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-22T19:17:16.682041] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-22T19:17:16.931234] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-22T19:17:17.053745] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T19:17:17.092877] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:17.717631] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-22T19:17:17.910107] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T19:17:17.928854] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T19:17:18.517676] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-22T19:17:19.047056] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T19:17:19.317674] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-22T19:17:20.117621] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-22T19:17:20.525107] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-22T19:17:20.917636] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-22T19:17:20.984629] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T19:17:20.992124] [INFO ] [REMOTE ] HUYA: Full fetch complete (63992 records). [2025-10-22T19:17:20.992254] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-22T19:17:21.381292] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-22T19:17:21.381375] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-22T19:17:21.382288] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-22T19:17:21.382353] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-22T19:17:21.383628] [DEBUG] [LOCAL ] HUYA: Trimmed 63992 records to 43617 (keeping 200 days of data) [2025-10-22T19:17:21.614734] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:17:21.659951] [DEBUG] [LOCAL ] HUYA: Primary data saved (43617 records). [2025-10-22T19:17:21.660074] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-22T19:17:21.660559] [INFO ] [MAIN ] Update Progress: 1069/2367 symbols completed. HUYA took 36.2s. Estimated remaining: 2h 46m 42s. Rate: 7.8 symbols/min [2025-10-22T19:17:21.725573] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-22T19:17:21.840712] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:21.852397] [DEBUG] [LOCAL ] HY: Loaded 9945 existing records from primary storage. [2025-10-22T19:17:21.852630] [INFO ] [MAIN ] HY: Loaded 9945 existing records. [2025-10-22T19:17:21.962826] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T19:17:22.042678] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:17:22.042902] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-22T19:17:22.042951] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-22T19:17:22.043096] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-22T19:17:22.043135] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-22T19:17:22.392368] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:22.517665] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-22T19:17:23.290044] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T19:17:23.317637] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-22T19:17:23.468132] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T19:17:24.117665] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-22T19:17:24.139138] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:17:24.917743] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-22T19:17:25.717769] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-22T19:17:25.826264] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T19:17:26.029757] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T19:17:26.517665] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-22T19:17:26.773399] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T19:17:26.776105] [INFO ] [REMOTE ] HVT: Full fetch complete (23031 records). [2025-10-22T19:17:26.776180] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-22T19:17:27.149299] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-22T19:17:27.149454] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-22T19:17:27.150002] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-22T19:17:27.150064] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-22T19:17:27.150705] [DEBUG] [LOCAL ] HVT: Trimmed 23031 records to 14734 (keeping 200 days of data) [2025-10-22T19:17:27.237063] [DEBUG] [LOCAL ] HVT: Primary data saved (14734 records). [2025-10-22T19:17:27.237190] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-22T19:17:27.237269] [INFO ] [MAIN ] Update Progress: 1070/2367 symbols completed. HVT took 30.6s. Estimated remaining: 2h 46m 31s. Rate: 7.8 symbols/min [2025-10-22T19:17:27.322869] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-22T19:17:27.409322] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:27.409470] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-22T19:17:27.409509] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-22T19:17:27.409639] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-22T19:17:27.409718] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-22T19:17:27.409769] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-22T19:17:27.409804] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-22T19:17:27.762691] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:28.117670] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-22T19:17:28.200928] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T19:17:28.384038] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T19:17:28.917683] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-22T19:17:29.717663] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-22T19:17:29.822243] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:17:30.074406] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-22T19:17:30.517672] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-22T19:17:30.824214] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T19:17:31.024591] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-22T19:17:31.317686] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-22T19:17:32.117681] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-22T19:17:32.491520] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-22T19:17:32.917677] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-22T19:17:33.231495] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T19:17:33.636061] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T19:17:33.717696] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-22T19:17:34.517684] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-22T19:17:35.225688] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T19:17:35.317694] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-22T19:17:35.483683] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:17:36.117675] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-22T19:17:36.917636] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-22T19:17:36.963094] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T19:17:36.994905] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T19:17:37.717780] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-22T19:17:37.952894] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-22T19:17:38.517630] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-22T19:17:38.579432] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T19:17:38.833733] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-22T19:17:39.317696] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-22T19:17:39.639078] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-22T19:17:40.117713] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-22T19:17:40.917638] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-22T19:17:41.689808] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T19:17:41.717626] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-22T19:17:41.950921] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T19:17:42.517633] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-22T19:17:42.589793] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T19:17:42.591863] [INFO ] [REMOTE ] HY: Full fetch complete (14896 records). [2025-10-22T19:17:42.591938] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-22T19:17:42.962397] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-22T19:17:42.962474] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-22T19:17:42.962821] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-22T19:17:42.962882] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-22T19:17:42.963363] [DEBUG] [LOCAL ] HY: Trimmed 14896 records to 9852 (keeping 200 days of data) [2025-10-22T19:17:43.026689] [DEBUG] [LOCAL ] HY: Primary data saved (9852 records). [2025-10-22T19:17:43.027088] [INFO ] [MAIN ] HY: Full history saved. [2025-10-22T19:17:43.027177] [INFO ] [MAIN ] Update Progress: 1071/2367 symbols completed. HY took 21.4s. Estimated remaining: 2h 46m 33s. Rate: 7.8 symbols/min [2025-10-22T19:17:43.194602] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:43.194790] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-22T19:17:43.194934] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-22T19:17:43.195017] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-22T19:17:43.195056] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-22T19:17:43.195100] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-22T19:17:43.195133] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-22T19:17:43.332406] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-22T19:17:43.545056] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:44.086567] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:17:44.117621] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-22T19:17:44.917750] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-22T19:17:45.214466] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T19:17:45.225271] [INFO ] [REMOTE ] HWM: Full fetch complete (76634 records). [2025-10-22T19:17:45.225393] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-22T19:17:45.225718] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-22T19:17:45.625124] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-22T19:17:45.625228] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-22T19:17:45.626285] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-22T19:17:45.626367] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-22T19:17:45.651379] [DEBUG] [LOCAL ] HWM: Trimmed 76634 records to 52700 (keeping 200 days of data) [2025-10-22T19:17:45.656168] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T19:17:45.719801] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-22T19:17:45.989968] [DEBUG] [LOCAL ] HWM: Primary data saved (52700 records). [2025-10-22T19:17:45.990098] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-22T19:17:45.990175] [INFO ] [MAIN ] Update Progress: 1072/2367 symbols completed. HWM took 32.1s. Estimated remaining: 2h 46m 20s. Rate: 7.8 symbols/min [2025-10-22T19:17:46.096399] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-22T19:17:46.166178] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:46.177802] [DEBUG] [LOCAL ] HYI: Loaded 9697 existing records from primary storage. [2025-10-22T19:17:46.178022] [INFO ] [MAIN ] HYI: Loaded 9697 existing records. [2025-10-22T19:17:46.351168] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:17:46.351377] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-22T19:17:46.351423] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-22T19:17:46.351670] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-22T19:17:46.351729] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-22T19:17:46.523727] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-22T19:17:46.706204] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:47.317693] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-22T19:17:47.835162] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-22T19:17:48.117668] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-22T19:17:48.301595] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T19:17:48.350593] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-22T19:17:48.917764] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-22T19:17:49.717694] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-22T19:17:50.451533] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T19:17:50.484056] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T19:17:50.517669] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-22T19:17:51.317780] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-22T19:17:52.056974] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T19:17:52.064230] [INFO ] [REMOTE ] HXL: Full fetch complete (66707 records). [2025-10-22T19:17:52.064329] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-22T19:17:52.125702] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-22T19:17:52.174720] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T19:17:52.459963] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-22T19:17:52.460037] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-22T19:17:52.460888] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-22T19:17:52.460951] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-22T19:17:52.462107] [DEBUG] [LOCAL ] HXL: Trimmed 66707 records to 45788 (keeping 200 days of data) [2025-10-22T19:17:52.551921] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T19:17:52.734402] [DEBUG] [LOCAL ] HXL: Primary data saved (45788 records). [2025-10-22T19:17:52.734526] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-22T19:17:52.734601] [INFO ] [MAIN ] Update Progress: 1073/2367 symbols completed. HXL took 36.4s. Estimated remaining: 2h 46m 11s. Rate: 7.8 symbols/min [2025-10-22T19:17:52.902537] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:52.918218] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-22T19:17:52.932719] [DEBUG] [LOCAL ] HYT: Loaded 33741 existing records from primary storage. [2025-10-22T19:17:52.932983] [INFO ] [MAIN ] HYT: Loaded 33741 existing records. [2025-10-22T19:17:53.105537] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:17:53.105722] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-22T19:17:53.105773] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-22T19:17:53.106044] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-22T19:17:53.106098] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-22T19:17:53.351206] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-22T19:17:53.452039] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:53.717708] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-22T19:17:54.027612] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-22T19:17:54.517756] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-22T19:17:55.294194] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T19:17:55.317617] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-22T19:17:56.096459] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T19:17:56.117621] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-22T19:17:56.803406] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T19:17:56.917700] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-22T19:17:57.672437] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T19:17:57.717613] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-22T19:17:58.452894] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T19:17:58.517671] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-22T19:17:59.317635] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-22T19:17:59.349562] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T19:17:59.640884] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-22T19:18:00.117635] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-22T19:18:00.446523] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-22T19:18:00.917634] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-22T19:18:01.717747] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-22T19:18:02.517751] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-22T19:18:02.551759] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:18:02.790666] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T19:18:02.793332] [INFO ] [REMOTE ] HYI: Full fetch complete (13992 records). [2025-10-22T19:18:02.793436] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-22T19:18:03.000723] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T19:18:03.200712] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-22T19:18:03.200793] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-22T19:18:03.201095] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-22T19:18:03.201132] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-22T19:18:03.201593] [DEBUG] [LOCAL ] HYI: Trimmed 13992 records to 9586 (keeping 200 days of data) [2025-10-22T19:18:03.258456] [DEBUG] [LOCAL ] HYI: Primary data saved (9586 records). [2025-10-22T19:18:03.258588] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-22T19:18:03.258687] [INFO ] [MAIN ] Update Progress: 1074/2367 symbols completed. HYI took 17.3s. Estimated remaining: 2h 46m 7s. Rate: 7.8 symbols/min [2025-10-22T19:18:03.322853] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-22T19:18:03.427692] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:03.431747] [DEBUG] [LOCAL ] HYTR: Loaded 3074 existing records from primary storage. [2025-10-22T19:18:03.431887] [INFO ] [MAIN ] HYTR: Loaded 3074 existing records. [2025-10-22T19:18:03.607539] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:03.607834] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-22T19:18:03.607892] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-22T19:18:03.608062] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-22T19:18:03.608118] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-22T19:18:03.699885] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-22T19:18:03.959550] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:04.117702] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-22T19:18:04.917688] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-22T19:18:05.346522] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T19:18:05.396101] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-22T19:18:05.717686] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-22T19:18:06.517699] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-22T19:18:07.124272] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T19:18:07.143749] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T19:18:07.317763] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-22T19:18:07.855036] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-22T19:18:08.117637] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-22T19:18:08.357361] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-22T19:18:08.917790] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-22T19:18:09.717690] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-22T19:18:09.989871] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-22T19:18:10.471045] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T19:18:10.517626] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-22T19:18:11.317638] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-22T19:18:11.937012] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:18:12.023285] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T19:18:12.024128] [INFO ] [REMOTE ] HYAC: Full fetch complete (921 records). [2025-10-22T19:18:12.024195] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-22T19:18:12.122747] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-22T19:18:12.206488] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-22T19:18:12.206696] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:18:12.206766] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:18:12.206842] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-22T19:18:12.206911] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-22T19:18:12.206948] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-22T19:18:12.206987] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-22T19:18:12.207052] [INFO ] [MAIN ] Update Progress: 1075/2367 symbols completed. HYAC took 45.0s. Estimated remaining: 2h 46m 1s. Rate: 7.8 symbols/min [2025-10-22T19:18:12.388964] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:12.389184] [DEBUG] [LOCAL ] HZO: No existing data file found in primary storage. [2025-10-22T19:18:12.389227] [WARN ] [MAIN ] HZO: No existing data found, performing full refresh instead. [2025-10-22T19:18:12.389341] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-22T19:18:12.389382] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-22T19:18:12.389422] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-22T19:18:12.389453] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-22T19:18:12.762970] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:12.917631] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-22T19:18:13.573100] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T19:18:13.717714] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-22T19:18:14.004144] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T19:18:14.067039] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-22T19:18:14.067764] [INFO ] [REMOTE ] HYBX: Full fetch complete (698 records). [2025-10-22T19:18:14.067834] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-22T19:18:14.243161] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-22T19:18:14.243352] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:18:14.243422] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:18:14.243493] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-22T19:18:14.243573] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-22T19:18:14.243609] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-22T19:18:14.243677] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-22T19:18:14.243751] [INFO ] [MAIN ] Update Progress: 1076/2367 symbols completed. HYBX took 31.2s. Estimated remaining: 2h 45m 46s. Rate: 7.8 symbols/min [2025-10-22T19:18:14.425113] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:14.433368] [DEBUG] [LOCAL ] IAE: Loaded 6338 existing records from primary storage. [2025-10-22T19:18:14.433566] [INFO ] [MAIN ] IAE: Loaded 6338 existing records. [2025-10-22T19:18:14.522724] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-22T19:18:14.611868] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:14.612069] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-22T19:18:14.612132] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-22T19:18:14.612290] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-22T19:18:14.612346] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-22T19:18:14.968574] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:15.317663] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-22T19:18:15.574085] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T19:18:15.911536] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-22T19:18:16.117711] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-22T19:18:16.917758] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-22T19:18:17.369339] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T19:18:17.717701] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-22T19:18:18.343441] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T19:18:18.363771] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T19:18:18.517626] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-22T19:18:19.317695] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-22T19:18:19.892398] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-22T19:18:19.934409] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T19:18:20.117637] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-22T19:18:20.680369] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T19:18:20.917675] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-22T19:18:21.387032] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T19:18:21.717666] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-22T19:18:22.272209] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T19:18:22.517676] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-22T19:18:23.012217] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T19:18:23.317638] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-22T19:18:24.117704] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-22T19:18:24.684353] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T19:18:24.917675] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-22T19:18:25.551012] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T19:18:25.717698] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-22T19:18:25.814805] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:18:26.039861] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-22T19:18:26.517692] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-22T19:18:27.154471] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T19:18:27.155620] [INFO ] [REMOTE ] HYTR: Full fetch complete (4707 records). [2025-10-22T19:18:27.155712] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-22T19:18:27.324216] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-22T19:18:27.516431] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-22T19:18:27.516508] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-22T19:18:27.516721] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-22T19:18:27.516787] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-22T19:18:27.517147] [DEBUG] [LOCAL ] HYTR: Trimmed 4707 records to 3093 (keeping 200 days of data) [2025-10-22T19:18:27.536675] [DEBUG] [LOCAL ] HYTR: Primary data saved (3093 records). [2025-10-22T19:18:27.536787] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-22T19:18:27.536870] [INFO ] [MAIN ] Update Progress: 1077/2367 symbols completed. HYTR took 24.3s. Estimated remaining: 2h 45m 45s. Rate: 7.8 symbols/min [2025-10-22T19:18:28.038600] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T19:18:28.117675] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-22T19:18:28.917699] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-22T19:18:29.522920] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T19:18:29.569147] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T19:18:29.717676] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-22T19:18:30.517628] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-22T19:18:30.875387] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T19:18:31.211974] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T19:18:31.317696] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-22T19:18:32.117691] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-22T19:18:32.632957] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T19:18:32.747808] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-22T19:18:32.917676] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-22T19:18:33.717687] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-22T19:18:34.051922] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T19:18:34.353876] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T19:18:34.517664] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-22T19:18:35.114861] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T19:18:35.317639] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-22T19:18:36.014626] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T19:18:36.117637] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-22T19:18:36.917697] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-22T19:18:37.410069] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T19:18:37.717621] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-22T19:18:38.328194] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T19:18:38.333923] [INFO ] [REMOTE ] HYT: Full fetch complete (47826 records). [2025-10-22T19:18:38.334009] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-22T19:18:38.522729] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-22T19:18:38.681163] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T19:18:38.711478] [INFO ] [REMOTE ] IAE: Full fetch complete (9033 records). [2025-10-22T19:18:38.713980] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-22T19:18:38.714054] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-22T19:18:38.714145] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-22T19:18:38.714882] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-22T19:18:38.714961] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-22T19:18:38.818532] [DEBUG] [LOCAL ] HYT: Trimmed 47826 records to 33567 (keeping 200 days of data) [2025-10-22T19:18:39.206221] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-22T19:18:39.206303] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-22T19:18:39.206551] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-22T19:18:39.206633] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-22T19:18:39.246888] [DEBUG] [LOCAL ] IAE: Trimmed 9033 records to 6307 (keeping 200 days of data) [2025-10-22T19:18:39.316558] [DEBUG] [LOCAL ] IAE: Primary data saved (6307 records). [2025-10-22T19:18:39.324433] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-22T19:18:39.327219] [INFO ] [MAIN ] Update Progress: 1078/2367 symbols completed. IAE took 25.1s. Estimated remaining: 2h 45m 42s. Rate: 7.8 symbols/min [2025-10-22T19:18:39.327014] [DEBUG] [LOCAL ] HYT: Primary data saved (33567 records). [2025-10-22T19:18:39.327470] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-22T19:18:39.327683] [INFO ] [MAIN ] Update Progress: 1079/2367 symbols completed. HYT took 46.6s. Estimated remaining: 2h 45m 25s. Rate: 7.8 symbols/min [2025-10-22T19:18:39.965047] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:18:39.969582] [INFO ] [REMOTE ] HZO: Full fetch complete (41256 records). [2025-10-22T19:18:39.969722] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-22T19:18:40.342230] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-22T19:18:40.342320] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-22T19:18:40.342983] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-22T19:18:40.343045] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-22T19:18:40.343966] [DEBUG] [LOCAL ] HZO: Trimmed 41256 records to 28526 (keeping 200 days of data) [2025-10-22T19:18:40.501119] [DEBUG] [LOCAL ] HZO: Primary data saved (28526 records). [2025-10-22T19:18:40.501238] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-22T19:18:40.501305] [INFO ] [MAIN ] Update Progress: 1080/2367 symbols completed. HZO took 28.3s. Estimated remaining: 2h 45m 10s. Rate: 7.8 symbols/min [2025-10-22T19:18:41.136246] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:41.214554] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:41.246876] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:41.268297] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:41.342430] [DEBUG] [LOCAL ] IBP: Loaded 28797 existing records from primary storage. [2025-10-22T19:18:41.358350] [INFO ] [MAIN ] IBP: Loaded 28797 existing records. [2025-10-22T19:18:41.500845] [DEBUG] [LOCAL ] IBN: Loaded 52838 existing records from primary storage. [2025-10-22T19:18:41.501604] [INFO ] [MAIN ] IBN: Loaded 52838 existing records. [2025-10-22T19:18:41.529154] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-22T19:18:41.598911] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-22T19:18:41.630227] [INFO ] [MAIN ] IAG: Loaded 53492 existing records. [2025-10-22T19:18:41.592194] [INFO ] [MAIN ] IBM: Loaded 53628 existing records. [2025-10-22T19:18:41.792741] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:41.922098] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-22T19:18:41.971013] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:41.942093] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-22T19:18:41.999894] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-22T19:18:42.000061] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-22T19:18:41.999982] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-22T19:18:42.000368] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-22T19:18:42.016284] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-22T19:18:42.027291] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-22T19:18:42.316422] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:42.351539] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-22T19:18:42.365890] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:42.437443] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-22T19:18:42.455687] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-22T19:18:42.456012] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-22T19:18:42.456923] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-22T19:18:42.477741] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-22T19:18:42.480701] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-22T19:18:42.480807] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-22T19:18:43.194305] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:43.263437] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-22T19:18:43.568821] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:43.574343] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-22T19:18:43.683177] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:43.700247] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-22T19:18:43.724635] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:43.725710] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-22T19:18:44.652443] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T19:18:44.658136] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-22T19:18:45.435972] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T19:18:45.447446] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-22T19:18:45.480680] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T19:18:45.492065] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-22T19:18:45.582910] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T19:18:45.593722] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-22T19:18:45.906798] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T19:18:45.915308] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-22T19:18:47.007415] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:18:47.018470] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-22T19:18:47.058691] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T19:18:47.091940] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T19:18:47.317635] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-22T19:18:47.417082] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T19:18:48.117768] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-22T19:18:48.693508] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T19:18:48.800044] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T19:18:48.917693] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-22T19:18:49.717688] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-22T19:18:50.234465] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T19:18:50.277473] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-22T19:18:50.517706] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-22T19:18:51.317695] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-22T19:18:51.590498] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T19:18:51.632705] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T19:18:52.117718] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-22T19:18:52.917624] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-22T19:18:52.998251] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T19:18:53.541028] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T19:18:53.717762] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-22T19:18:54.517742] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-22T19:18:55.115704] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-22T19:18:55.243390] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:18:55.317613] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-22T19:18:56.108305] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T19:18:56.118784] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-22T19:18:56.917700] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-22T19:18:57.125492] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-22T19:18:57.717669] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-22T19:18:58.231680] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T19:18:58.353042] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-22T19:18:58.517624] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-22T19:18:59.317744] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-22T19:18:59.611604] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T19:19:00.117669] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-22T19:19:00.543734] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T19:19:00.734412] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T19:19:00.917708] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-22T19:19:01.717712] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-22T19:19:01.929947] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T19:19:02.517638] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-22T19:19:02.980079] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T19:19:02.984913] [INFO ] [REMOTE ] IBP: Full fetch complete (41134 records). [2025-10-22T19:19:02.985167] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-22T19:19:03.326107] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-22T19:19:03.388299] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-22T19:19:03.388582] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-22T19:19:03.389336] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-22T19:19:03.389539] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-22T19:19:03.391093] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-22T19:19:03.403825] [DEBUG] [LOCAL ] IBP: Trimmed 41134 records to 28663 (keeping 200 days of data) [2025-10-22T19:19:03.575327] [DEBUG] [LOCAL ] IBP: Primary data saved (28663 records). [2025-10-22T19:19:03.575450] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-22T19:19:03.575524] [INFO ] [MAIN ] Update Progress: 1081/2367 symbols completed. IBP took 23.1s. Estimated remaining: 2h 45m 20s. Rate: 7.8 symbols/min [2025-10-22T19:19:03.741105] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:03.773522] [DEBUG] [LOCAL ] IBTA: Loaded 36220 existing records from primary storage. [2025-10-22T19:19:03.773807] [INFO ] [MAIN ] IBTA: Loaded 36220 existing records. [2025-10-22T19:19:03.950637] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:03.950964] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-22T19:19:03.951162] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-22T19:19:03.951405] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-22T19:19:03.951462] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-22T19:19:04.131934] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-22T19:19:04.223986] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T19:19:04.363084] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:04.917626] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-22T19:19:05.173611] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T19:19:05.717765] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-22T19:19:06.428937] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-22T19:19:06.517614] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-22T19:19:06.641147] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T19:19:07.317753] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-22T19:19:07.755350] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T19:19:07.764117] [INFO ] [REMOTE ] IAG: Full fetch complete (77507 records). [2025-10-22T19:19:07.764233] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-22T19:19:08.122176] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-22T19:19:08.144171] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-22T19:19:08.145409] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-22T19:19:08.146417] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-22T19:19:08.146560] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-22T19:19:08.148117] [DEBUG] [LOCAL ] IAG: Trimmed 77507 records to 53492 (keeping 200 days of data) [2025-10-22T19:19:08.466063] [DEBUG] [LOCAL ] IAG: Primary data saved (53492 records). [2025-10-22T19:19:08.466199] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-22T19:19:08.466280] [INFO ] [MAIN ] Update Progress: 1082/2367 symbols completed. IAG took 28.0s. Estimated remaining: 2h 45m 9s. Rate: 7.8 symbols/min [2025-10-22T19:19:08.728962] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:08.792984] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T19:19:08.869284] [DEBUG] [LOCAL ] ICE: Loaded 53011 existing records from primary storage. [2025-10-22T19:19:08.869776] [INFO ] [MAIN ] ICE: Loaded 53011 existing records. [2025-10-22T19:19:08.926435] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-22T19:19:09.148233] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:09.149216] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-22T19:19:09.149384] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-22T19:19:09.150450] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-22T19:19:09.150528] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-22T19:19:09.536006] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-22T19:19:09.561921] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T19:19:09.634933] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:09.717619] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-22T19:19:10.517693] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-22T19:19:11.289878] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:19:11.317611] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-22T19:19:11.703104] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T19:19:11.782622] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-22T19:19:11.791718] [INFO ] [REMOTE ] IBM: Full fetch complete (77742 records). [2025-10-22T19:19:11.791868] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-22T19:19:12.122884] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-22T19:19:12.201375] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-22T19:19:12.201468] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-22T19:19:12.202427] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-22T19:19:12.202520] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-22T19:19:12.204931] [DEBUG] [LOCAL ] IBM: Trimmed 77742 records to 53628 (keeping 200 days of data) [2025-10-22T19:19:12.533575] [DEBUG] [LOCAL ] IBM: Primary data saved (53628 records). [2025-10-22T19:19:12.533738] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-22T19:19:12.534192] [INFO ] [MAIN ] Update Progress: 1083/2367 symbols completed. IBM took 32.0s. Estimated remaining: 2h 44m 57s. Rate: 7.8 symbols/min [2025-10-22T19:19:12.718776] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:12.755059] [DEBUG] [LOCAL ] ICL: Loaded 38256 existing records from primary storage. [2025-10-22T19:19:12.755434] [INFO ] [MAIN ] ICL: Loaded 38256 existing records. [2025-10-22T19:19:12.927420] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-22T19:19:12.950895] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:12.952111] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-22T19:19:12.952191] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-22T19:19:12.952449] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-22T19:19:12.952523] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-22T19:19:13.336489] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:13.365329] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-22T19:19:13.609482] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T19:19:13.717630] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-22T19:19:14.064205] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T19:19:14.517624] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-22T19:19:15.082304] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T19:19:15.317694] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-22T19:19:16.117698] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-22T19:19:16.207176] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:19:16.917806] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-22T19:19:17.180669] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T19:19:17.189856] [INFO ] [REMOTE ] IBN: Full fetch complete (76644 records). [2025-10-22T19:19:17.189967] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-22T19:19:17.395505] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T19:19:17.628828] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-22T19:19:17.628917] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-22T19:19:17.630042] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-22T19:19:17.630109] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-22T19:19:17.631688] [DEBUG] [LOCAL ] IBN: Trimmed 76644 records to 52834 (keeping 200 days of data) [2025-10-22T19:19:17.723284] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-22T19:19:17.959553] [DEBUG] [LOCAL ] IBN: Primary data saved (52834 records). [2025-10-22T19:19:17.959731] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-22T19:19:17.959823] [INFO ] [MAIN ] Update Progress: 1084/2367 symbols completed. IBN took 37.5s. Estimated remaining: 2h 44m 47s. Rate: 7.8 symbols/min [2025-10-22T19:19:18.126910] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:18.157947] [DEBUG] [LOCAL ] IDA: Loaded 32767 existing records from primary storage. [2025-10-22T19:19:18.158212] [INFO ] [MAIN ] IDA: Loaded 32767 existing records. [2025-10-22T19:19:18.336025] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:18.336242] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-22T19:19:18.336289] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-22T19:19:18.336525] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-22T19:19:18.336562] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-22T19:19:18.531324] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-22T19:19:18.693328] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:18.785577] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:19:18.847607] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T19:19:19.317752] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-22T19:19:19.918556] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T19:19:20.117631] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-22T19:19:20.661498] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T19:19:20.917700] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-22T19:19:21.450862] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T19:19:21.717698] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-22T19:19:22.442773] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T19:19:22.517686] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-22T19:19:23.317681] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-22T19:19:23.439613] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T19:19:23.693569] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T19:19:24.117616] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-22T19:19:24.588271] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T19:19:24.917717] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-22T19:19:25.717620] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-22T19:19:26.022221] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T19:19:26.277704] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T19:19:26.517749] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-22T19:19:26.966504] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T19:19:27.317716] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-22T19:19:28.117682] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-22T19:19:28.338752] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T19:19:28.761975] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T19:19:28.917663] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-22T19:19:29.495326] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T19:19:29.717620] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-22T19:19:30.156505] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T19:19:30.517686] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-22T19:19:31.279633] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:19:31.317632] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-22T19:19:31.518106] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:19:32.117674] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-22T19:19:32.539192] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T19:19:32.917680] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-22T19:19:33.530104] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T19:19:33.535882] [INFO ] [REMOTE ] IBTA: Full fetch complete (51189 records). [2025-10-22T19:19:33.536000] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-22T19:19:33.723661] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-22T19:19:33.915776] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-22T19:19:33.915852] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-22T19:19:33.916562] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-22T19:19:33.916602] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-22T19:19:33.917617] [DEBUG] [LOCAL ] IBTA: Trimmed 51189 records to 36072 (keeping 200 days of data) [2025-10-22T19:19:34.120403] [DEBUG] [LOCAL ] IBTA: Primary data saved (36072 records). [2025-10-22T19:19:34.120526] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-22T19:19:34.120599] [INFO ] [MAIN ] Update Progress: 1085/2367 symbols completed. IBTA took 30.5s. Estimated remaining: 2h 44m 49s. Rate: 7.8 symbols/min [2025-10-22T19:19:34.290982] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:34.301636] [DEBUG] [LOCAL ] IDE: Loaded 9047 existing records from primary storage. [2025-10-22T19:19:34.301844] [INFO ] [MAIN ] IDE: Loaded 9047 existing records. [2025-10-22T19:19:34.481111] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:34.481553] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-22T19:19:34.488973] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-22T19:19:34.499690] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-22T19:19:34.502031] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-22T19:19:34.525997] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-22T19:19:34.562660] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T19:19:34.882323] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:35.317692] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-22T19:19:35.672413] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T19:19:35.705256] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T19:19:36.045139] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T19:19:36.117681] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-22T19:19:36.917695] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-22T19:19:37.555348] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T19:19:37.622181] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-22T19:19:37.717675] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-22T19:19:38.517700] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-22T19:19:39.048388] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T19:19:39.125201] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T19:19:39.317701] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-22T19:19:40.117669] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-22T19:19:40.137473] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T19:19:40.917748] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-22T19:19:41.437515] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T19:19:41.469358] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T19:19:41.717674] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-22T19:19:42.517706] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-22T19:19:43.103880] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T19:19:43.109667] [INFO ] [REMOTE ] IDA: Full fetch complete (45398 records). [2025-10-22T19:19:43.109790] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-22T19:19:43.325636] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-22T19:19:43.496822] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-22T19:19:43.496898] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-22T19:19:43.497711] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-22T19:19:43.497786] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-22T19:19:43.498710] [DEBUG] [LOCAL ] IDA: Trimmed 45398 records to 32728 (keeping 200 days of data) [2025-10-22T19:19:43.703060] [DEBUG] [LOCAL ] IDA: Primary data saved (32728 records). [2025-10-22T19:19:43.703479] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-22T19:19:43.703569] [INFO ] [MAIN ] Update Progress: 1086/2367 symbols completed. IDA took 25.7s. Estimated remaining: 2h 44m 44s. Rate: 7.8 symbols/min [2025-10-22T19:19:43.885097] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:43.902451] [DEBUG] [LOCAL ] IDT: Loaded 18558 existing records from primary storage. [2025-10-22T19:19:43.902717] [INFO ] [MAIN ] IDT: Loaded 18558 existing records. [2025-10-22T19:19:44.076928] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:44.077154] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-22T19:19:44.077201] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-22T19:19:44.077816] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-22T19:19:44.077872] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-22T19:19:44.120302] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-22T19:19:44.440712] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:44.469478] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T19:19:44.857163] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T19:19:44.915556] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T19:19:44.917864] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-22T19:19:45.717713] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-22T19:19:45.728500] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T19:19:46.517711] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-22T19:19:47.117577] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T19:19:47.317706] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-22T19:19:48.117685] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-22T19:19:48.293178] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T19:19:48.584546] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-22T19:19:48.756952] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:19:48.763093] [INFO ] [REMOTE ] ICL: Full fetch complete (55973 records). [2025-10-22T19:19:48.763189] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-22T19:19:48.920443] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-22T19:19:49.144566] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-22T19:19:49.144659] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-22T19:19:49.145429] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-22T19:19:49.145472] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-22T19:19:49.146515] [DEBUG] [LOCAL ] ICL: Trimmed 55973 records to 38132 (keeping 200 days of data) [2025-10-22T19:19:49.355686] [DEBUG] [LOCAL ] ICL: Primary data saved (38132 records). [2025-10-22T19:19:49.355825] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-22T19:19:49.356498] [INFO ] [MAIN ] Update Progress: 1087/2367 symbols completed. ICL took 36.8s. Estimated remaining: 2h 44m 33s. Rate: 7.8 symbols/min [2025-10-22T19:19:49.527381] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:49.565199] [DEBUG] [LOCAL ] IEX: Loaded 38376 existing records from primary storage. [2025-10-22T19:19:49.565522] [INFO ] [MAIN ] IEX: Loaded 38376 existing records. [2025-10-22T19:19:49.722678] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-22T19:19:49.742110] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:49.743190] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-22T19:19:49.743250] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-22T19:19:49.743416] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-22T19:19:49.743454] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-22T19:19:50.034714] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T19:19:50.115629] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:50.517720] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-22T19:19:51.266815] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T19:19:51.317610] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-22T19:19:51.666636] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T19:19:51.675463] [INFO ] [REMOTE ] ICE: Full fetch complete (77023 records). [2025-10-22T19:19:51.675600] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-22T19:19:52.068694] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-22T19:19:52.068811] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-22T19:19:52.069770] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-22T19:19:52.069832] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-22T19:19:52.071365] [DEBUG] [LOCAL ] ICE: Trimmed 77023 records to 53009 (keeping 200 days of data) [2025-10-22T19:19:52.126951] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-22T19:19:52.409195] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T19:19:52.428172] [DEBUG] [LOCAL ] ICE: Primary data saved (53009 records). [2025-10-22T19:19:52.428365] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-22T19:19:52.428465] [INFO ] [MAIN ] Update Progress: 1088/2367 symbols completed. ICE took 44.0s. Estimated remaining: 2h 44m 20s. Rate: 7.8 symbols/min [2025-10-22T19:19:52.602946] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:52.649177] [DEBUG] [LOCAL ] IFF: Loaded 51226 existing records from primary storage. [2025-10-22T19:19:52.649534] [INFO ] [MAIN ] IFF: Loaded 51226 existing records. [2025-10-22T19:19:52.831253] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:52.831459] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-22T19:19:52.831505] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-22T19:19:52.831735] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-22T19:19:52.831791] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-22T19:19:52.921173] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-22T19:19:52.946627] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T19:19:53.194816] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:53.717626] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-22T19:19:54.408311] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T19:19:54.517627] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-22T19:19:54.821102] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T19:19:54.823620] [INFO ] [REMOTE ] IDE: Full fetch complete (12834 records). [2025-10-22T19:19:54.823727] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-22T19:19:55.184040] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-22T19:19:55.184120] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-22T19:19:55.184496] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-22T19:19:55.184538] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-22T19:19:55.185153] [DEBUG] [LOCAL ] IDE: Trimmed 12834 records to 9050 (keeping 200 days of data) [2025-10-22T19:19:55.241794] [DEBUG] [LOCAL ] IDE: Primary data saved (9050 records). [2025-10-22T19:19:55.241920] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-22T19:19:55.242000] [INFO ] [MAIN ] Update Progress: 1089/2367 symbols completed. IDE took 21.1s. Estimated remaining: 2h 44m 7s. Rate: 7.8 symbols/min [2025-10-22T19:19:55.323003] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-22T19:19:55.449898] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:55.468899] [DEBUG] [LOCAL ] IFN: Loaded 18608 existing records from primary storage. [2025-10-22T19:19:55.469154] [INFO ] [MAIN ] IFN: Loaded 18608 existing records. [2025-10-22T19:19:55.667670] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:55.668050] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-22T19:19:55.668125] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-22T19:19:55.668407] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-22T19:19:55.668466] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-22T19:19:55.764615] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T19:19:56.075725] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T19:19:56.091494] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:56.117613] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-22T19:19:56.917637] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-22T19:19:57.110891] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T19:19:57.717696] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-22T19:19:58.522746] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-22T19:19:58.538280] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:19:58.599312] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T19:19:59.317706] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-22T19:19:59.358742] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T19:20:00.117710] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-22T19:20:00.326724] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:20:00.917817] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-22T19:20:01.066766] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T19:20:01.717682] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-22T19:20:01.951372] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T19:20:02.517760] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-22T19:20:03.238227] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T19:20:03.317812] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-22T19:20:03.654187] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T19:20:04.117633] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-22T19:20:04.345254] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T19:20:04.917746] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-22T19:20:05.717698] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-22T19:20:05.866456] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T19:20:06.210195] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T19:20:06.214408] [INFO ] [REMOTE ] IDT: Full fetch complete (24090 records). [2025-10-22T19:20:06.214481] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-22T19:20:06.523089] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-22T19:20:06.616971] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-22T19:20:06.617590] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-22T19:20:06.617980] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T19:20:06.623123] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-22T19:20:06.623481] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-22T19:20:06.624176] [DEBUG] [LOCAL ] IDT: Trimmed 24090 records to 18550 (keeping 200 days of data) [2025-10-22T19:20:06.735113] [DEBUG] [LOCAL ] IDT: Primary data saved (18550 records). [2025-10-22T19:20:06.735246] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-22T19:20:06.735323] [INFO ] [MAIN ] Update Progress: 1090/2367 symbols completed. IDT took 23.0s. Estimated remaining: 2h 44m 4s. Rate: 7.8 symbols/min [2025-10-22T19:20:06.899837] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:06.920177] [DEBUG] [LOCAL ] IFS: Loaded 22267 existing records from primary storage. [2025-10-22T19:20:06.920410] [INFO ] [MAIN ] IFS: Loaded 22267 existing records. [2025-10-22T19:20:07.092523] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:07.092740] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-22T19:20:07.092794] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-22T19:20:07.092951] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-22T19:20:07.092988] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-22T19:20:07.323806] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-22T19:20:07.449542] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:08.070715] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T19:20:08.117617] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-22T19:20:08.917696] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-22T19:20:09.053600] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:20:09.717766] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-22T19:20:09.876388] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T19:20:09.902780] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-22T19:20:10.517634] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-22T19:20:10.693980] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T19:20:11.317796] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-22T19:20:12.114101] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T19:20:12.124922] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-22T19:20:12.260988] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T19:20:12.917718] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-22T19:20:13.641434] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T19:20:13.717706] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-22T19:20:14.517669] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-22T19:20:14.662084] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T19:20:15.118140] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T19:20:15.305491] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T19:20:15.317599] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-22T19:20:16.117716] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-22T19:20:16.522072] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T19:20:16.917691] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-22T19:20:17.716548] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T19:20:17.724577] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-22T19:20:17.978492] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T19:20:18.517675] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-22T19:20:18.994401] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T19:20:19.317668] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-22T19:20:19.374921] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T19:20:20.117692] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-22T19:20:20.876205] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T19:20:20.917622] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-22T19:20:21.113259] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T19:20:21.717634] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-22T19:20:21.884430] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T19:20:22.517775] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-22T19:20:23.097851] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T19:20:23.317699] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-22T19:20:23.753798] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T19:20:23.757438] [INFO ] [REMOTE ] IFN: Full fetch complete (28367 records). [2025-10-22T19:20:23.757536] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-22T19:20:24.122879] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-22T19:20:24.123898] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-22T19:20:24.124898] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-22T19:20:24.125545] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-22T19:20:24.125695] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-22T19:20:24.126673] [DEBUG] [LOCAL ] IFN: Trimmed 28367 records to 18590 (keeping 200 days of data) [2025-10-22T19:20:24.240141] [DEBUG] [LOCAL ] IFN: Primary data saved (18590 records). [2025-10-22T19:20:24.240429] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-22T19:20:24.240517] [INFO ] [MAIN ] Update Progress: 1091/2367 symbols completed. IFN took 29.0s. Estimated remaining: 2h 44m 7s. Rate: 7.8 symbols/min [2025-10-22T19:20:24.413570] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:24.424502] [DEBUG] [LOCAL ] IGA: Loaded 10213 existing records from primary storage. [2025-10-22T19:20:24.424729] [INFO ] [MAIN ] IGA: Loaded 10213 existing records. [2025-10-22T19:20:24.619212] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:24.620400] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T19:20:24.620753] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-22T19:20:24.620874] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-22T19:20:24.627131] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-22T19:20:24.627205] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-22T19:20:24.922784] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-22T19:20:24.984867] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:25.717688] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-22T19:20:25.880450] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T19:20:26.017087] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:20:26.203217] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-22T19:20:26.517685] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-22T19:20:27.317757] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-22T19:20:28.117767] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-22T19:20:28.185893] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:20:28.349819] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T19:20:28.917680] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-22T19:20:29.584182] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T19:20:29.590038] [INFO ] [REMOTE ] IEX: Full fetch complete (53899 records). [2025-10-22T19:20:29.590167] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-22T19:20:29.722818] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-22T19:20:29.984123] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-22T19:20:29.984196] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-22T19:20:29.985081] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-22T19:20:29.985146] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-22T19:20:29.986328] [DEBUG] [LOCAL ] IEX: Trimmed 53899 records to 38271 (keeping 200 days of data) [2025-10-22T19:20:30.242172] [DEBUG] [LOCAL ] IEX: Primary data saved (38271 records). [2025-10-22T19:20:30.242342] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-22T19:20:30.242973] [INFO ] [MAIN ] Update Progress: 1092/2367 symbols completed. IEX took 40.9s. Estimated remaining: 2h 43m 58s. Rate: 7.8 symbols/min [2025-10-22T19:20:30.423257] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:30.441540] [DEBUG] [LOCAL ] IGD: Loaded 19195 existing records from primary storage. [2025-10-22T19:20:30.441815] [INFO ] [MAIN ] IGD: Loaded 19195 existing records. [2025-10-22T19:20:30.521090] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-22T19:20:30.631847] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:30.632265] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-22T19:20:30.632530] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-22T19:20:30.648073] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-22T19:20:30.658472] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-22T19:20:30.713361] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T19:20:30.797389] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T19:20:31.080284] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:31.294143] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T19:20:31.317617] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-22T19:20:32.117674] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-22T19:20:32.917669] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-22T19:20:32.992535] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T19:20:33.002121] [INFO ] [REMOTE ] IFF: Full fetch complete (73771 records). [2025-10-22T19:20:33.002300] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-22T19:20:33.316015] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T19:20:33.346114] [INFO ] [REMOTE ] IFS: Full fetch complete (32283 records). [2025-10-22T19:20:33.397801] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-22T19:20:33.416129] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-22T19:20:33.416223] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-22T19:20:33.417211] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-22T19:20:33.448947] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-22T19:20:33.521606] [DEBUG] [LOCAL ] IFF: Trimmed 73771 records to 51225 (keeping 200 days of data) [2025-10-22T19:20:33.733483] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-22T19:20:33.753511] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-22T19:20:33.942153] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-22T19:20:33.944998] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-22T19:20:33.949923] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-22T19:20:33.950034] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-22T19:20:34.002561] [DEBUG] [LOCAL ] IFS: Trimmed 32283 records to 22165 (keeping 200 days of data) [2025-10-22T19:20:34.196301] [DEBUG] [LOCAL ] IFS: Primary data saved (22165 records). [2025-10-22T19:20:34.201989] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-22T19:20:34.202092] [INFO ] [MAIN ] Update Progress: 1093/2367 symbols completed. IFS took 27.5s. Estimated remaining: 2h 43m 46s. Rate: 7.8 symbols/min [2025-10-22T19:20:34.444938] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:34.459762] [DEBUG] [LOCAL ] IFF: Primary data saved (51225 records). [2025-10-22T19:20:34.459932] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-22T19:20:34.462815] [INFO ] [MAIN ] Update Progress: 1094/2367 symbols completed. IFF took 42.0s. Estimated remaining: 2h 43m 29s. Rate: 7.8 symbols/min [2025-10-22T19:20:34.462668] [DEBUG] [LOCAL ] IGI: Loaded 4074 existing records from primary storage. [2025-10-22T19:20:34.495554] [INFO ] [MAIN ] IGI: Loaded 4074 existing records. [2025-10-22T19:20:34.528179] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-22T19:20:34.772851] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:34.830326] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:34.830700] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-22T19:20:34.830767] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-22T19:20:34.830913] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-22T19:20:34.830954] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-22T19:20:35.078369] [DEBUG] [LOCAL ] IGR: Loaded 30433 existing records from primary storage. [2025-10-22T19:20:35.111985] [INFO ] [MAIN ] IGR: Loaded 30433 existing records. [2025-10-22T19:20:35.142126] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T19:20:35.322596] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-22T19:20:35.417810] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T19:20:35.477495] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:35.484173] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-22T19:20:35.488804] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-22T19:20:35.488714] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:35.489202] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-22T19:20:35.489272] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-22T19:20:35.844083] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:36.117615] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-22T19:20:36.589775] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T19:20:36.895142] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T19:20:36.917622] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-22T19:20:37.630856] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T19:20:37.717777] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-22T19:20:38.517768] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-22T19:20:38.576282] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T19:20:39.057247] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-22T19:20:39.317769] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-22T19:20:40.041927] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T19:20:40.117688] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-22T19:20:40.628449] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-22T19:20:40.917701] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-22T19:20:41.364586] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T19:20:41.717886] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-22T19:20:42.386938] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T19:20:42.517689] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-22T19:20:43.317767] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-22T19:20:43.430708] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T19:20:43.433451] [INFO ] [REMOTE ] IGA: Full fetch complete (14335 records). [2025-10-22T19:20:43.433529] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-22T19:20:43.794985] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-22T19:20:43.795079] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-22T19:20:43.795402] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-22T19:20:43.795443] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-22T19:20:43.795924] [DEBUG] [LOCAL ] IGA: Trimmed 14335 records to 10128 (keeping 200 days of data) [2025-10-22T19:20:43.853694] [DEBUG] [LOCAL ] IGA: Primary data saved (10128 records). [2025-10-22T19:20:43.853822] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-22T19:20:43.853910] [INFO ] [MAIN ] Update Progress: 1095/2367 symbols completed. IGA took 19.6s. Estimated remaining: 2h 43m 23s. Rate: 7.8 symbols/min [2025-10-22T19:20:44.018075] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:44.022800] [DEBUG] [LOCAL ] IH: Loaded 2764 existing records from primary storage. [2025-10-22T19:20:44.023156] [INFO ] [MAIN ] IH: Loaded 2764 existing records. [2025-10-22T19:20:44.121373] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-22T19:20:44.198577] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:44.198778] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-22T19:20:44.198825] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-22T19:20:44.198965] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-22T19:20:44.199019] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-22T19:20:44.470565] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T19:20:44.570522] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:44.917689] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-22T19:20:45.423911] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-22T19:20:45.473593] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T19:20:45.717633] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-22T19:20:46.321603] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T19:20:46.517691] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-22T19:20:47.317627] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-22T19:20:47.713337] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T19:20:47.799044] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-22T19:20:48.117708] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-22T19:20:48.917682] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-22T19:20:49.516004] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T19:20:49.717760] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-22T19:20:49.726378] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T19:20:50.517694] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-22T19:20:50.764345] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T19:20:51.026730] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-22T19:20:51.317793] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-22T19:20:52.117753] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-22T19:20:52.425058] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T19:20:52.491259] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T19:20:52.917712] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-22T19:20:53.384509] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T19:20:53.717757] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-22T19:20:54.326952] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T19:20:54.517700] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-22T19:20:54.931614] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-22T19:20:55.317711] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-22T19:20:56.117706] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-22T19:20:56.530154] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T19:20:56.713528] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T19:20:56.917671] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-22T19:20:57.717637] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-22T19:20:58.094092] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T19:20:58.517702] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-22T19:20:59.005920] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T19:20:59.066986] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T19:20:59.317686] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-22T19:21:00.117667] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-22T19:21:00.608836] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T19:21:00.917622] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-22T19:21:00.990404] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T19:21:00.992091] [INFO ] [REMOTE ] IGI: Full fetch complete (5503 records). [2025-10-22T19:21:00.992163] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-22T19:21:01.356114] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-22T19:21:01.356194] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-22T19:21:01.356397] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-22T19:21:01.356439] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-22T19:21:01.356848] [DEBUG] [LOCAL ] IGI: Trimmed 5503 records to 4050 (keeping 200 days of data) [2025-10-22T19:21:01.383106] [DEBUG] [LOCAL ] IGI: Primary data saved (4050 records). [2025-10-22T19:21:01.383225] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-22T19:21:01.383323] [INFO ] [MAIN ] Update Progress: 1096/2367 symbols completed. IGI took 27.2s. Estimated remaining: 2h 43m 27s. Rate: 7.8 symbols/min [2025-10-22T19:21:01.575793] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:01.586113] [DEBUG] [LOCAL ] IHD: Loaded 7394 existing records from primary storage. [2025-10-22T19:21:01.586344] [INFO ] [MAIN ] IHD: Loaded 7394 existing records. [2025-10-22T19:21:01.722421] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-22T19:21:01.790338] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:01.790675] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-22T19:21:01.790742] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-22T19:21:01.790892] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-22T19:21:01.790969] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-22T19:21:02.142162] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T19:21:02.233189] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:02.517757] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-22T19:21:02.927321] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T19:21:03.317630] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-22T19:21:03.465702] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T19:21:04.117758] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-22T19:21:04.917637] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-22T19:21:04.968180] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T19:21:04.977925] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T19:21:05.402957] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-22T19:21:05.717798] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-22T19:21:06.463832] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T19:21:06.517698] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-22T19:21:07.135119] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T19:21:07.317709] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-22T19:21:07.943482] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T19:21:08.117673] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-22T19:21:08.614347] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-22T19:21:08.917722] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-22T19:21:09.395834] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T19:21:09.717681] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-22T19:21:10.281706] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-22T19:21:10.282735] [INFO ] [REMOTE ] IH: Full fetch complete (5047 records). [2025-10-22T19:21:10.282813] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-22T19:21:10.524143] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-22T19:21:10.638980] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-22T19:21:10.639060] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-22T19:21:10.639198] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-22T19:21:10.639235] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-22T19:21:10.639565] [DEBUG] [LOCAL ] IH: Trimmed 5047 records to 2722 (keeping 200 days of data) [2025-10-22T19:21:10.654529] [DEBUG] [LOCAL ] IH: Primary data saved (2722 records). [2025-10-22T19:21:10.654587] [INFO ] [MAIN ] IH: Full history saved. [2025-10-22T19:21:10.654671] [INFO ] [MAIN ] Update Progress: 1097/2367 symbols completed. IH took 26.8s. Estimated remaining: 2h 43m 21s. Rate: 7.8 symbols/min [2025-10-22T19:21:10.840160] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:10.862931] [DEBUG] [LOCAL ] IHG: Loaded 24119 existing records from primary storage. [2025-10-22T19:21:10.863191] [INFO ] [MAIN ] IHG: Loaded 24119 existing records. [2025-10-22T19:21:11.039726] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:11.039903] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-22T19:21:11.039948] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-22T19:21:11.040122] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-22T19:21:11.040177] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-22T19:21:11.322827] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-22T19:21:11.386601] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:11.935368] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:21:12.117681] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-22T19:21:12.423865] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T19:21:12.858556] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T19:21:12.917675] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-22T19:21:13.614130] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T19:21:13.717675] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-22T19:21:14.333274] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T19:21:14.517677] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-22T19:21:15.317687] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-22T19:21:15.789487] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T19:21:15.793535] [INFO ] [REMOTE ] IGD: Full fetch complete (30140 records). [2025-10-22T19:21:15.793678] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-22T19:21:16.122719] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-22T19:21:16.184361] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-22T19:21:16.184450] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-22T19:21:16.185093] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-22T19:21:16.185155] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-22T19:21:16.185963] [DEBUG] [LOCAL ] IGD: Trimmed 30140 records to 19135 (keeping 200 days of data) [2025-10-22T19:21:16.300201] [DEBUG] [LOCAL ] IGD: Primary data saved (19135 records). [2025-10-22T19:21:16.300357] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-22T19:21:16.300475] [INFO ] [MAIN ] Update Progress: 1098/2367 symbols completed. IGD took 46.1s. Estimated remaining: 2h 43m 11s. Rate: 7.8 symbols/min [2025-10-22T19:21:16.481166] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:16.514341] [DEBUG] [LOCAL ] IHS: Loaded 37245 existing records from primary storage. [2025-10-22T19:21:16.514606] [INFO ] [MAIN ] IHS: Loaded 37245 existing records. [2025-10-22T19:21:16.703284] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:16.703608] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-22T19:21:16.703784] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-22T19:21:16.709477] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-22T19:21:16.719145] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-22T19:21:16.732097] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T19:21:16.861675] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T19:21:16.922828] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-22T19:21:17.108607] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:17.717702] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-22T19:21:18.101718] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T19:21:18.191728] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-22T19:21:18.517695] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-22T19:21:19.317708] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-22T19:21:19.697221] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:21:20.117673] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-22T19:21:20.188898] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T19:21:20.191004] [INFO ] [REMOTE ] IHD: Full fetch complete (11783 records). [2025-10-22T19:21:20.191078] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-22T19:21:20.572957] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-22T19:21:20.573079] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-22T19:21:20.573425] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-22T19:21:20.573493] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-22T19:21:20.573993] [DEBUG] [LOCAL ] IHD: Trimmed 11783 records to 7364 (keeping 200 days of data) [2025-10-22T19:21:20.619971] [DEBUG] [LOCAL ] IHD: Primary data saved (7364 records). [2025-10-22T19:21:20.620130] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-22T19:21:20.620222] [INFO ] [MAIN ] Update Progress: 1099/2367 symbols completed. IHD took 19.2s. Estimated remaining: 2h 42m 59s. Rate: 7.8 symbols/min [2025-10-22T19:21:20.800613] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:20.807873] [DEBUG] [LOCAL ] IIF: Loaded 5353 existing records from primary storage. [2025-10-22T19:21:20.808104] [INFO ] [MAIN ] IIF: Loaded 5353 existing records. [2025-10-22T19:21:20.922859] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-22T19:21:20.984840] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:20.985130] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-22T19:21:20.985180] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-22T19:21:20.985372] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-22T19:21:20.985428] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-22T19:21:21.335218] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:21.463601] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T19:21:21.468611] [INFO ] [REMOTE ] IGR: Full fetch complete (44644 records). [2025-10-22T19:21:21.468727] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-22T19:21:21.725507] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-22T19:21:21.842546] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-22T19:21:21.842628] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-22T19:21:21.843400] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-22T19:21:21.843451] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-22T19:21:21.844412] [DEBUG] [LOCAL ] IGR: Trimmed 44644 records to 30409 (keeping 200 days of data) [2025-10-22T19:21:22.019237] [DEBUG] [LOCAL ] IGR: Primary data saved (30409 records). [2025-10-22T19:21:22.019389] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-22T19:21:22.019581] [INFO ] [MAIN ] Update Progress: 1100/2367 symbols completed. IGR took 47.6s. Estimated remaining: 2h 42m 44s. Rate: 7.8 symbols/min [2025-10-22T19:21:22.157260] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T19:21:22.212477] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:22.227986] [DEBUG] [LOCAL ] IIIN: Loaded 16300 existing records from primary storage. [2025-10-22T19:21:22.228218] [INFO ] [MAIN ] IIIN: Loaded 16300 existing records. [2025-10-22T19:21:22.405962] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:22.406199] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-22T19:21:22.406247] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-22T19:21:22.406519] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-22T19:21:22.406575] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-22T19:21:22.522923] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-22T19:21:22.774460] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:23.070550] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T19:21:23.317698] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-22T19:21:23.334418] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T19:21:24.117692] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-22T19:21:24.780317] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T19:21:24.782487] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T19:21:24.917698] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-22T19:21:25.717675] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-22T19:21:26.174456] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T19:21:26.517686] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-22T19:21:26.596383] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T19:21:27.317622] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-22T19:21:27.368764] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T19:21:27.909775] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T19:21:28.117674] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-22T19:21:28.766533] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T19:21:28.917670] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-22T19:21:29.717681] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-22T19:21:30.061943] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:21:30.517687] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-22T19:21:31.170354] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T19:21:31.231824] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T19:21:31.317628] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-22T19:21:32.117694] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-22T19:21:32.396316] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T19:21:32.917669] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-22T19:21:33.499922] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T19:21:33.717688] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-22T19:21:33.968567] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T19:21:34.502861] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T19:21:34.517622] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-22T19:21:35.317686] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-22T19:21:36.079355] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T19:21:36.107345] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T19:21:36.117609] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-22T19:21:36.917714] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-22T19:21:37.576091] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:21:37.717620] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-22T19:21:38.110957] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T19:21:38.517685] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-22T19:21:38.783243] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T19:21:39.317692] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-22T19:21:39.683337] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T19:21:40.117626] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-22T19:21:40.269908] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T19:21:40.917681] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-22T19:21:41.363587] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T19:21:41.367495] [INFO ] [REMOTE ] IHG: Full fetch complete (34294 records). [2025-10-22T19:21:41.367575] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-22T19:21:41.560463] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T19:21:41.726213] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-22T19:21:41.769837] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-22T19:21:41.769958] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-22T19:21:41.770743] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-22T19:21:41.770815] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-22T19:21:41.771912] [DEBUG] [LOCAL ] IHG: Trimmed 34294 records to 23951 (keeping 200 days of data) [2025-10-22T19:21:41.924019] [DEBUG] [LOCAL ] IHG: Primary data saved (23951 records). [2025-10-22T19:21:41.924144] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-22T19:21:41.924218] [INFO ] [MAIN ] Update Progress: 1101/2367 symbols completed. IHG took 31.3s. Estimated remaining: 2h 42m 51s. Rate: 7.8 symbols/min [2025-10-22T19:21:42.095447] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:42.112199] [DEBUG] [LOCAL ] IIM: Loaded 15540 existing records from primary storage. [2025-10-22T19:21:42.112464] [INFO ] [MAIN ] IIM: Loaded 15540 existing records. [2025-10-22T19:21:42.285680] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:42.285879] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-22T19:21:42.285925] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-22T19:21:42.286304] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-22T19:21:42.286360] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-22T19:21:42.524385] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-22T19:21:42.653230] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:42.921527] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T19:21:43.317689] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-22T19:21:44.052669] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T19:21:44.117706] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-22T19:21:44.388021] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T19:21:44.917686] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-22T19:21:44.938223] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T19:21:45.717633] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-22T19:21:46.006894] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T19:21:46.516504] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T19:21:46.521829] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-22T19:21:47.241537] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-22T19:21:47.317637] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-22T19:21:48.117680] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-22T19:21:48.374285] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T19:21:48.377493] [INFO ] [REMOTE ] IIIN: Full fetch complete (24936 records). [2025-10-22T19:21:48.377573] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-22T19:21:48.787410] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-22T19:21:48.787491] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-22T19:21:48.788136] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-22T19:21:48.788199] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-22T19:21:48.788965] [DEBUG] [LOCAL ] IIIN: Trimmed 24936 records to 16243 (keeping 200 days of data) [2025-10-22T19:21:48.891496] [DEBUG] [LOCAL ] IIIN: Primary data saved (16243 records). [2025-10-22T19:21:48.891639] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-22T19:21:48.891764] [INFO ] [MAIN ] Update Progress: 1102/2367 symbols completed. IIIN took 26.9s. Estimated remaining: 2h 42m 42s. Rate: 7.8 symbols/min [2025-10-22T19:21:48.923490] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-22T19:21:49.062895] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:49.090500] [DEBUG] [LOCAL ] IIPR: Loaded 28934 existing records from primary storage. [2025-10-22T19:21:49.101929] [INFO ] [MAIN ] IIPR: Loaded 28934 existing records. [2025-10-22T19:21:49.182210] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T19:21:49.290221] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:49.290484] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-22T19:21:49.290533] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-22T19:21:49.290752] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-22T19:21:49.290808] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-22T19:21:49.658055] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:49.717615] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-22T19:21:50.522827] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-22T19:21:50.536671] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T19:21:50.815146] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T19:21:51.317666] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-22T19:21:51.510973] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T19:21:51.914201] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T19:21:52.117637] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-22T19:21:52.917753] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-22T19:21:53.243622] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-22T19:21:53.320112] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T19:21:53.717757] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-22T19:21:54.517638] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-22T19:21:54.602115] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T19:21:55.317618] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-22T19:21:55.790188] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T19:21:56.117669] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-22T19:21:56.761439] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T19:21:56.917717] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-22T19:21:57.434822] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T19:21:57.439858] [INFO ] [REMOTE ] IHS: Full fetch complete (51648 records). [2025-10-22T19:21:57.439962] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-22T19:21:57.722749] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-22T19:21:57.827158] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-22T19:21:57.827231] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-22T19:21:57.827999] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-22T19:21:57.828059] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-22T19:21:57.829045] [DEBUG] [LOCAL ] IHS: Trimmed 51648 records to 37211 (keeping 200 days of data) [2025-10-22T19:21:58.030692] [DEBUG] [LOCAL ] IHS: Primary data saved (37211 records). [2025-10-22T19:21:58.030819] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-22T19:21:58.030894] [INFO ] [MAIN ] Update Progress: 1103/2367 symbols completed. IHS took 41.7s. Estimated remaining: 2h 42m 36s. Rate: 7.8 symbols/min [2025-10-22T19:21:58.198003] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:58.236039] [DEBUG] [LOCAL ] IMAX: Loaded 43469 existing records from primary storage. [2025-10-22T19:21:58.236325] [INFO ] [MAIN ] IMAX: Loaded 43469 existing records. [2025-10-22T19:21:58.419078] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:58.419398] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-22T19:21:58.419457] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-22T19:21:58.419670] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-22T19:21:58.419742] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-22T19:21:58.518097] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-22T19:21:58.708851] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:21:58.799780] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T19:21:58.819039] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:59.101270] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T19:21:59.102300] [INFO ] [REMOTE ] IIF: Full fetch complete (8848 records). [2025-10-22T19:21:59.102367] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-22T19:21:59.322838] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-22T19:21:59.473997] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-22T19:21:59.474105] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-22T19:21:59.474341] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-22T19:21:59.474381] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-22T19:21:59.474799] [DEBUG] [LOCAL ] IIF: Trimmed 8848 records to 5278 (keeping 200 days of data) [2025-10-22T19:21:59.504551] [DEBUG] [LOCAL ] IIF: Primary data saved (5278 records). [2025-10-22T19:21:59.504628] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-22T19:21:59.504732] [INFO ] [MAIN ] Update Progress: 1104/2367 symbols completed. IIF took 38.9s. Estimated remaining: 2h 42m 21s. Rate: 7.8 symbols/min [2025-10-22T19:21:59.670382] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:59.714429] [DEBUG] [LOCAL ] INFA: Loaded 48721 existing records from primary storage. [2025-10-22T19:21:59.714744] [INFO ] [MAIN ] INFA: Loaded 48721 existing records. [2025-10-22T19:21:59.894877] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:59.895083] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-22T19:21:59.895151] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-22T19:21:59.895355] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-22T19:21:59.895397] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-22T19:22:00.129445] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-22T19:22:00.258545] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:00.725964] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T19:22:00.917687] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-22T19:22:01.141333] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:22:01.717780] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-22T19:22:02.302513] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T19:22:02.517712] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-22T19:22:03.074281] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T19:22:03.317685] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-22T19:22:03.764896] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T19:22:04.117702] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-22T19:22:04.828980] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T19:22:04.917821] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-22T19:22:05.610119] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:22:05.717710] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-22T19:22:06.359906] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T19:22:06.425854] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-22T19:22:06.517619] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-22T19:22:07.317707] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-22T19:22:08.028610] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T19:22:08.117666] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-22T19:22:08.917703] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-22T19:22:09.021543] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T19:22:09.717987] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-22T19:22:09.724680] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T19:22:10.290322] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T19:22:10.517700] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-22T19:22:11.101626] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T19:22:11.317949] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-22T19:22:12.117708] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-22T19:22:12.261605] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:22:12.266860] [INFO ] [REMOTE ] IIPR: Full fetch complete (43789 records). [2025-10-22T19:22:12.266960] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-22T19:22:12.685736] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-22T19:22:12.685824] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-22T19:22:12.686521] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-22T19:22:12.686563] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-22T19:22:12.687607] [DEBUG] [LOCAL ] IIPR: Trimmed 43789 records to 28846 (keeping 200 days of data) [2025-10-22T19:22:12.877140] [DEBUG] [LOCAL ] IIPR: Primary data saved (28846 records). [2025-10-22T19:22:12.877267] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-22T19:22:12.877345] [INFO ] [MAIN ] Update Progress: 1105/2367 symbols completed. IIPR took 24.0s. Estimated remaining: 2h 42m 20s. Rate: 7.8 symbols/min [2025-10-22T19:22:12.933876] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-22T19:22:13.070810] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:13.104789] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:22:13.151110] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T19:22:13.175302] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-22T19:22:13.175626] [INFO ] [MAIN ] INFY: Loaded 53596 existing records. [2025-10-22T19:22:13.385199] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:22:13.385419] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-22T19:22:13.385467] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-22T19:22:13.385737] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-22T19:22:13.385795] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-22T19:22:13.722737] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-22T19:22:13.761856] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:14.292799] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T19:22:14.517634] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-22T19:22:14.820268] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T19:22:14.823261] [INFO ] [REMOTE ] IIM: Full fetch complete (24952 records). [2025-10-22T19:22:14.823333] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-22T19:22:15.190493] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-22T19:22:15.190605] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-22T19:22:15.191265] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-22T19:22:15.191329] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-22T19:22:15.192225] [DEBUG] [LOCAL ] IIM: Trimmed 24952 records to 15480 (keeping 200 days of data) [2025-10-22T19:22:15.290329] [DEBUG] [LOCAL ] IIM: Primary data saved (15480 records). [2025-10-22T19:22:15.290467] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-22T19:22:15.290548] [INFO ] [MAIN ] Update Progress: 1106/2367 symbols completed. IIM took 33.4s. Estimated remaining: 2h 42m 6s. Rate: 7.8 symbols/min [2025-10-22T19:22:15.322815] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-22T19:22:15.462517] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:15.462719] [DEBUG] [LOCAL ] ING: No existing data file found in primary storage. [2025-10-22T19:22:15.462768] [WARN ] [MAIN ] ING: No existing data found, performing full refresh instead. [2025-10-22T19:22:15.462879] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-22T19:22:15.462920] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-22T19:22:15.462961] [DEBUG] [LOCAL ] ING: No primary data file found to delete. [2025-10-22T19:22:15.462993] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-22T19:22:15.818826] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:16.117622] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-22T19:22:16.162401] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T19:22:16.917684] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-22T19:22:17.199856] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T19:22:17.622304] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:22:17.717674] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-22T19:22:18.302474] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T19:22:18.517772] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-22T19:22:19.039157] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T19:22:19.317686] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-22T19:22:20.117694] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-22T19:22:20.166286] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T19:22:20.822192] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T19:22:20.917631] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-22T19:22:21.619970] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:22:21.717688] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-22T19:22:22.523588] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-22T19:22:22.545083] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T19:22:23.317846] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-22T19:22:23.444857] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T19:22:24.117691] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-22T19:22:24.189538] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T19:22:24.922021] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-22T19:22:24.927298] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T19:22:24.935408] [INFO ] [REMOTE ] IMAX: Full fetch complete (61116 records). [2025-10-22T19:22:24.935576] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-22T19:22:25.352146] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-22T19:22:25.352254] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-22T19:22:25.353187] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-22T19:22:25.353253] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-22T19:22:25.354497] [DEBUG] [LOCAL ] IMAX: Trimmed 61116 records to 43444 (keeping 200 days of data) [2025-10-22T19:22:25.607066] [DEBUG] [LOCAL ] IMAX: Primary data saved (43444 records). [2025-10-22T19:22:25.607257] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-22T19:22:25.607958] [INFO ] [MAIN ] Update Progress: 1107/2367 symbols completed. IMAX took 27.6s. Estimated remaining: 2h 42m 1s. Rate: 7.8 symbols/min [2025-10-22T19:22:25.719611] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-22T19:22:25.818320] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:25.820997] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:22:25.860298] [DEBUG] [LOCAL ] INGM: Loaded 28216 existing records from primary storage. [2025-10-22T19:22:25.860563] [INFO ] [MAIN ] INGM: Loaded 28216 existing records. [2025-10-22T19:22:26.066997] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:22:26.067226] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-22T19:22:26.067273] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-22T19:22:26.067603] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-22T19:22:26.067687] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-22T19:22:26.421536] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:26.517613] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-22T19:22:26.714634] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:22:27.317694] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-22T19:22:27.401661] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T19:22:27.941582] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T19:22:28.117618] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-22T19:22:28.514886] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:22:28.917688] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-22T19:22:29.717689] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-22T19:22:29.855696] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T19:22:30.517718] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-22T19:22:30.787237] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:22:30.814289] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T19:22:31.317678] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-22T19:22:32.117624] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-22T19:22:32.245390] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T19:22:32.743796] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T19:22:32.917626] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-22T19:22:33.644558] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T19:22:33.651460] [INFO ] [REMOTE ] INFA: Full fetch complete (70746 records). [2025-10-22T19:22:33.651582] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-22T19:22:33.722815] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-22T19:22:34.064489] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-22T19:22:34.064572] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-22T19:22:34.065569] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-22T19:22:34.065635] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-22T19:22:34.067495] [DEBUG] [LOCAL ] INFA: Trimmed 70746 records to 48602 (keeping 200 days of data) [2025-10-22T19:22:34.353689] [DEBUG] [LOCAL ] INFA: Primary data saved (48602 records). [2025-10-22T19:22:34.353849] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-22T19:22:34.353952] [INFO ] [MAIN ] Update Progress: 1108/2367 symbols completed. INFA took 34.8s. Estimated remaining: 2h 41m 55s. Rate: 7.8 symbols/min [2025-10-22T19:22:34.519327] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-22T19:22:34.544913] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:34.579902] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T19:22:34.619396] [DEBUG] [LOCAL ] INGR: Loaded 33761 existing records from primary storage. [2025-10-22T19:22:34.619711] [INFO ] [MAIN ] INGR: Loaded 33761 existing records. [2025-10-22T19:22:34.805405] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:22:34.805624] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-22T19:22:34.805703] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-22T19:22:34.805888] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-22T19:22:34.805926] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-22T19:22:35.185751] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:35.205776] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:22:35.317621] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-22T19:22:36.000183] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:22:36.117618] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-22T19:22:36.632015] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T19:22:36.917630] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-22T19:22:37.717716] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-22T19:22:37.844395] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T19:22:38.304058] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T19:22:38.517716] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-22T19:22:39.173334] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T19:22:39.317676] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-22T19:22:39.705123] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T19:22:40.117688] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-22T19:22:40.917717] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-22T19:22:41.071501] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T19:22:41.717761] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-22T19:22:41.843180] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T19:22:42.215947] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T19:22:42.517770] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-22T19:22:43.317684] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-22T19:22:43.490305] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:22:44.117676] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-22T19:22:44.202455] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T19:22:44.211111] [INFO ] [REMOTE ] ING: Full fetch complete (73825 records). [2025-10-22T19:22:44.211254] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-22T19:22:44.353099] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T19:22:44.621225] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-22T19:22:44.621316] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-22T19:22:44.622228] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-22T19:22:44.622292] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-22T19:22:44.623723] [DEBUG] [LOCAL ] ING: Trimmed 73825 records to 50701 (keeping 200 days of data) [2025-10-22T19:22:44.917717] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-22T19:22:44.930633] [DEBUG] [LOCAL ] ING: Primary data saved (50701 records). [2025-10-22T19:22:44.930811] [INFO ] [MAIN ] ING: Full history saved. [2025-10-22T19:22:44.930889] [INFO ] [MAIN ] Update Progress: 1109/2367 symbols completed. ING took 29.6s. Estimated remaining: 2h 41m 50s. Rate: 7.8 symbols/min [2025-10-22T19:22:45.103961] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:45.140164] [DEBUG] [LOCAL ] INN: Loaded 41558 existing records from primary storage. [2025-10-22T19:22:45.140458] [INFO ] [MAIN ] INN: Loaded 41558 existing records. [2025-10-22T19:22:45.316366] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:22:45.317233] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-22T19:22:45.317287] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-22T19:22:45.317519] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-22T19:22:45.317558] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-22T19:22:45.683195] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:45.717633] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-22T19:22:45.883785] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T19:22:46.091828] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T19:22:46.517709] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-22T19:22:47.197968] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:22:47.317633] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-22T19:22:47.628582] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T19:22:48.117718] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-22T19:22:48.917688] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-22T19:22:49.042076] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:22:49.485930] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T19:22:49.719053] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-22T19:22:49.722928] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T19:22:50.517763] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-22T19:22:51.018046] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T19:22:51.023040] [INFO ] [REMOTE ] INGM: Full fetch complete (41820 records). [2025-10-22T19:22:51.023162] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-22T19:22:51.322928] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-22T19:22:51.398026] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-22T19:22:51.398105] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-22T19:22:51.398791] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-22T19:22:51.398853] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-22T19:22:51.399723] [DEBUG] [LOCAL ] INGM: Trimmed 41820 records to 28088 (keeping 200 days of data) [2025-10-22T19:22:51.569889] [DEBUG] [LOCAL ] INGM: Primary data saved (28088 records). [2025-10-22T19:22:51.570026] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-22T19:22:51.570125] [INFO ] [MAIN ] Update Progress: 1110/2367 symbols completed. INGM took 26.0s. Estimated remaining: 2h 41m 41s. Rate: 7.8 symbols/min [2025-10-22T19:22:51.738042] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:51.738241] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-22T19:22:51.738284] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-22T19:22:51.738399] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-22T19:22:51.738440] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-22T19:22:51.738482] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-22T19:22:51.738514] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-22T19:22:52.113557] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:52.117617] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-22T19:22:52.248710] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T19:22:52.261603] [INFO ] [REMOTE ] INFY: Full fetch complete (77747 records). [2025-10-22T19:22:52.261857] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-22T19:22:52.706341] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-22T19:22:52.706477] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-22T19:22:52.707558] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-22T19:22:52.707812] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-22T19:22:52.709411] [DEBUG] [LOCAL ] INFY: Trimmed 77747 records to 53596 (keeping 200 days of data) [2025-10-22T19:22:52.801785] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-22T19:22:52.845552] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T19:22:52.919060] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-22T19:22:53.074182] [DEBUG] [LOCAL ] INFY: Primary data saved (53596 records). [2025-10-22T19:22:53.074316] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-22T19:22:53.074396] [INFO ] [MAIN ] Update Progress: 1111/2367 symbols completed. INFY took 40.2s. Estimated remaining: 2h 41m 27s. Rate: 7.8 symbols/min [2025-10-22T19:22:53.241209] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:53.276576] [DEBUG] [LOCAL ] INSP: Loaded 38568 existing records from primary storage. [2025-10-22T19:22:53.276871] [INFO ] [MAIN ] INSP: Loaded 38568 existing records. [2025-10-22T19:22:53.479051] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:22:53.479231] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-22T19:22:53.479285] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-22T19:22:53.479464] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-22T19:22:53.479522] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-22T19:22:53.722734] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-22T19:22:53.850024] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:54.285734] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T19:22:54.517769] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-22T19:22:55.189026] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T19:22:55.317697] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-22T19:22:55.861073] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T19:22:56.117719] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-22T19:22:56.613957] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T19:22:56.917674] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-22T19:22:57.466299] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T19:22:57.717716] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-22T19:22:58.360939] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T19:22:58.517619] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-22T19:22:59.085434] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T19:22:59.317691] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-22T19:22:59.958581] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T19:23:00.117710] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-22T19:23:00.917626] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-22T19:23:01.717754] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-22T19:23:04.748517] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (4.63 seconds). [2025-10-22T19:23:04.755442] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-22T19:23:05.599055] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (6.28 seconds). [2025-10-22T19:23:05.607024] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-22T19:23:05.678872] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (4.76 seconds). [2025-10-22T19:23:05.686066] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-22T19:23:06.011611] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (4.29 seconds). [2025-10-22T19:23:06.021408] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-22T19:23:06.087785] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T19:23:06.094757] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-22T19:23:06.695722] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T19:23:06.701382] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-22T19:23:06.990105] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T19:23:07.317634] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-22T19:23:07.375018] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T19:23:07.490865] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:23:07.518583] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T19:23:08.117677] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-22T19:23:08.759634] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T19:23:08.917640] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-22T19:23:09.241449] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T19:23:09.717639] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-22T19:23:10.135633] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T19:23:10.517697] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-22T19:23:11.013462] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T19:23:11.317700] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-22T19:23:12.041891] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T19:23:12.117619] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-22T19:23:12.789561] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T19:23:12.917610] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-22T19:23:13.717764] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-22T19:23:13.811204] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T19:23:14.360157] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T19:23:14.517625] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-22T19:23:14.933536] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T19:23:15.317703] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-22T19:23:16.054403] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T19:23:16.061026] [INFO ] [REMOTE ] INN: Full fetch complete (57660 records). [2025-10-22T19:23:16.061129] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-22T19:23:16.126359] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-22T19:23:16.376975] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T19:23:16.497269] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-22T19:23:16.497339] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-22T19:23:16.498174] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-22T19:23:16.498237] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-22T19:23:16.499536] [DEBUG] [LOCAL ] INN: Trimmed 57660 records to 41470 (keeping 200 days of data) [2025-10-22T19:23:16.727339] [DEBUG] [LOCAL ] INN: Primary data saved (41470 records). [2025-10-22T19:23:16.727466] [INFO ] [MAIN ] INN: Full history saved. [2025-10-22T19:23:16.727541] [INFO ] [MAIN ] Update Progress: 1112/2367 symbols completed. INN took 31.8s. Estimated remaining: 2h 41m 37s. Rate: 7.8 symbols/min [2025-10-22T19:23:16.896251] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:23:16.917639] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-22T19:23:16.931822] [DEBUG] [LOCAL ] INSW: Loaded 39351 existing records from primary storage. [2025-10-22T19:23:16.932076] [INFO ] [MAIN ] INSW: Loaded 39351 existing records. [2025-10-22T19:23:17.105251] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:23:17.105473] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-22T19:23:17.105519] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-22T19:23:17.105740] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-22T19:23:17.105795] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-22T19:23:17.469378] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:23:17.717698] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-22T19:23:17.824263] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T19:23:18.523159] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-22T19:23:18.535533] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T19:23:18.542358] [INFO ] [REMOTE ] INGR: Full fetch complete (50794 records). [2025-10-22T19:23:18.542459] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-22T19:23:18.972748] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-22T19:23:18.972872] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-22T19:23:18.974137] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-22T19:23:18.974225] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-22T19:23:18.975801] [DEBUG] [LOCAL ] INGR: Trimmed 50794 records to 33764 (keeping 200 days of data) [2025-10-22T19:23:19.101100] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T19:23:19.241851] [DEBUG] [LOCAL ] INGR: Primary data saved (33764 records). [2025-10-22T19:23:19.242130] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-22T19:23:19.242245] [INFO ] [MAIN ] Update Progress: 1113/2367 symbols completed. INGR took 44.9s. Estimated remaining: 2h 41m 23s. Rate: 7.8 symbols/min [2025-10-22T19:23:19.322808] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-22T19:23:19.423866] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:23:19.482575] [DEBUG] [LOCAL ] INVH: Loaded 53194 existing records from primary storage. [2025-10-22T19:23:19.483102] [INFO ] [MAIN ] INVH: Loaded 53194 existing records. [2025-10-22T19:23:19.674922] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:23:19.675428] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-22T19:23:19.675479] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-22T19:23:19.675957] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-22T19:23:19.676016] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-22T19:23:20.074867] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:23:20.117623] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-22T19:23:20.179241] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T19:23:20.186921] [INFO ] [REMOTE ] INSP: Full fetch complete (53886 records). [2025-10-22T19:23:20.187100] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-22T19:23:20.635261] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-22T19:23:20.635396] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-22T19:23:20.636563] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-22T19:23:20.636782] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-22T19:23:20.638988] [DEBUG] [LOCAL ] INSP: Trimmed 53886 records to 38560 (keeping 200 days of data) [2025-10-22T19:23:20.730509] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T19:23:20.918141] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-22T19:23:20.918327] [DEBUG] [LOCAL ] INSP: Primary data saved (38560 records). [2025-10-22T19:23:20.920021] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-22T19:23:20.920148] [INFO ] [MAIN ] Update Progress: 1114/2367 symbols completed. INSP took 27.8s. Estimated remaining: 2h 41m 9s. Rate: 7.8 symbols/min [2025-10-22T19:23:21.087059] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:23:21.120508] [DEBUG] [LOCAL ] INVX: Loaded 29141 existing records from primary storage. [2025-10-22T19:23:21.120910] [INFO ] [MAIN ] INVX: Loaded 29141 existing records. [2025-10-22T19:23:21.303164] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:23:21.303749] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-22T19:23:21.303863] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-22T19:23:21.304276] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-22T19:23:21.304365] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-22T19:23:21.677798] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:23:21.721796] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-22T19:23:21.733147] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:23:22.517718] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-22T19:23:22.591529] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T19:23:23.169752] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T19:23:23.175264] [INFO ] [REMOTE ] INR: Full fetch complete (37245 records). [2025-10-22T19:23:23.175461] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-22T19:23:23.327016] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-22T19:23:23.383677] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-22T19:23:23.384340] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:23:23.384422] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:23:23.384504] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-22T19:23:23.384593] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-22T19:23:23.384636] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-22T19:23:23.384729] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-22T19:23:23.384825] [INFO ] [MAIN ] Update Progress: 1115/2367 symbols completed. INR took 31.8s. Estimated remaining: 2h 40m 55s. Rate: 7.8 symbols/min [2025-10-22T19:23:23.571536] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:23:23.629319] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-22T19:23:23.629818] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-22T19:23:23.826915] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:23:23.827498] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-22T19:23:23.827579] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-22T19:23:23.828094] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-22T19:23:23.828162] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-22T19:23:23.934446] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T19:23:24.127775] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-22T19:23:24.268538] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:23:24.879703] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T19:23:24.917628] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-22T19:23:25.431282] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T19:23:25.717687] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-22T19:23:26.470839] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T19:23:26.517605] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-22T19:23:27.317752] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-22T19:23:27.910868] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T19:23:28.117616] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-22T19:23:28.327584] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-22T19:23:28.490035] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:23:28.917768] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-22T19:23:29.701981] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T19:23:29.717610] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-22T19:23:30.045094] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T19:23:30.517703] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-22T19:23:31.317670] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-22T19:23:31.511199] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T19:23:32.117723] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-22T19:23:32.703491] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T19:23:32.917716] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-22T19:23:33.234148] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-22T19:23:33.717617] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-22T19:23:33.916465] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T19:23:34.152592] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T19:23:34.517694] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-22T19:23:35.317750] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-22T19:23:35.803097] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T19:23:36.117623] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-22T19:23:36.499419] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-22T19:23:36.864815] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T19:23:36.917692] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-22T19:23:37.380602] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T19:23:37.717702] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-22T19:23:38.517663] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-22T19:23:38.843674] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T19:23:39.317627] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-22T19:23:39.591293] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-22T19:23:40.068362] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T19:23:40.119025] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-22T19:23:40.123758] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T19:23:40.917761] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-22T19:23:41.717619] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-22T19:23:41.916687] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T19:23:42.340747] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T19:23:42.517705] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-22T19:23:42.995306] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T19:23:42.999849] [INFO ] [REMOTE ] INVX: Full fetch complete (42835 records). [2025-10-22T19:23:42.999972] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-22T19:23:43.322848] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-22T19:23:43.378323] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-22T19:23:43.378401] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-22T19:23:43.379211] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-22T19:23:43.379331] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-22T19:23:43.380400] [DEBUG] [LOCAL ] INVX: Trimmed 42835 records to 29045 (keeping 200 days of data) [2025-10-22T19:23:43.544755] [DEBUG] [LOCAL ] INVX: Primary data saved (29045 records). [2025-10-22T19:23:43.544888] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-22T19:23:43.544967] [INFO ] [MAIN ] Update Progress: 1116/2367 symbols completed. INVX took 22.6s. Estimated remaining: 2h 41m 2s. Rate: 7.8 symbols/min [2025-10-22T19:23:43.718307] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:23:43.766215] [DEBUG] [LOCAL ] IOT: Loaded 53478 existing records from primary storage. [2025-10-22T19:23:43.766514] [INFO ] [MAIN ] IOT: Loaded 53478 existing records. [2025-10-22T19:23:43.949512] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:23:43.949858] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-22T19:23:43.949942] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-22T19:23:43.950283] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-22T19:23:43.950342] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-22T19:23:44.146089] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-22T19:23:44.192942] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T19:23:44.276274] [INFO ] [REMOTE ] INSW: Full fetch complete (59507 records). [2025-10-22T19:23:44.286820] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-22T19:23:44.415846] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:23:44.746120] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-22T19:23:44.746229] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-22T19:23:44.747230] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-22T19:23:44.747314] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-22T19:23:44.748939] [DEBUG] [LOCAL ] INSW: Trimmed 59507 records to 39208 (keeping 200 days of data) [2025-10-22T19:23:44.919681] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-22T19:23:44.987620] [DEBUG] [LOCAL ] INSW: Primary data saved (39208 records). [2025-10-22T19:23:44.988094] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-22T19:23:44.988208] [INFO ] [MAIN ] Update Progress: 1117/2367 symbols completed. INSW took 28.3s. Estimated remaining: 2h 40m 47s. Rate: 7.8 symbols/min [2025-10-22T19:23:45.160148] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T19:23:45.717687] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-22T19:23:46.709848] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T19:23:46.722144] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-22T19:23:46.915909] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-22T19:23:47.317704] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-22T19:23:47.462121] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T19:23:48.117627] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-22T19:23:48.580469] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T19:23:48.917685] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-22T19:23:49.685050] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-22T19:23:49.717764] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-22T19:23:49.792353] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T19:23:50.517717] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-22T19:23:50.966084] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T19:23:51.317770] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-22T19:23:52.383541] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T19:23:52.392231] [INFO ] [REMOTE ] INVH: Full fetch complete (76993 records). [2025-10-22T19:23:52.392364] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-22T19:23:52.840912] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (3.12 seconds). [2025-10-22T19:23:52.841227] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-22T19:23:52.853397] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-22T19:23:52.855711] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-22T19:23:52.856086] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-22T19:23:52.856983] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-22T19:23:52.860398] [DEBUG] [LOCAL ] INVH: Trimmed 76993 records to 53194 (keeping 200 days of data) [2025-10-22T19:23:53.134838] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T19:23:53.203808] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-22T19:23:53.226635] [DEBUG] [LOCAL ] INVH: Primary data saved (53194 records). [2025-10-22T19:23:53.226750] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-22T19:23:53.226823] [INFO ] [MAIN ] Update Progress: 1118/2367 symbols completed. INVH took 34.0s. Estimated remaining: 2h 40m 40s. Rate: 7.8 symbols/min [2025-10-22T19:23:54.973042] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T19:23:54.984209] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-22T19:23:55.672011] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-22T19:23:55.684916] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-22T19:23:56.903180] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T19:23:56.914322] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-22T19:23:58.349244] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-22T19:23:58.361714] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-22T19:23:58.780816] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T19:23:58.792840] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-22T19:24:00.744978] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T19:24:00.756318] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-22T19:24:01.641072] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (3.28 seconds). [2025-10-22T19:24:01.650609] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-22T19:24:01.650817] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-22T19:24:02.055338] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-22T19:24:02.055452] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-22T19:24:02.056438] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-22T19:24:02.056501] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-22T19:24:02.057972] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-22T19:24:02.372770] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-22T19:24:02.372905] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-22T19:24:02.373437] [INFO ] [MAIN ] Update Progress: 1119/2367 symbols completed. IONQ took 39.0s. Estimated remaining: 2h 40m 34s. Rate: 7.8 symbols/min [2025-10-22T19:24:02.735277] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T19:24:02.746851] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-22T19:24:04.801054] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T19:24:04.809590] [INFO ] [REMOTE ] IOT: Full fetch complete (77551 records). [2025-10-22T19:24:04.809733] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-22T19:24:05.195234] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-22T19:24:05.195308] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-22T19:24:05.196363] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-22T19:24:05.196427] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-22T19:24:05.197936] [DEBUG] [LOCAL ] IOT: Trimmed 77551 records to 53475 (keeping 200 days of data) [2025-10-22T19:24:05.501100] [DEBUG] [LOCAL ] IOT: Primary data saved (53475 records). [2025-10-22T19:24:05.501255] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-22T19:24:05.501350] [INFO ] [MAIN ] Update Progress: 1120/2367 symbols completed. IOT took 22.0s. Estimated remaining: 2h 40m 21s. Rate: 7.8 symbols/min [2025-10-22T19:24:06.081212] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:06.135865] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:06.189175] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:06.187673] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:06.213852] [DEBUG] [LOCAL ] IPI: Loaded 21499 existing records from primary storage. [2025-10-22T19:24:06.214205] [INFO ] [MAIN ] IPI: Loaded 21499 existing records. [2025-10-22T19:24:06.256282] [DEBUG] [LOCAL ] IQI: Loaded 17852 existing records from primary storage. [2025-10-22T19:24:06.286116] [INFO ] [MAIN ] IQI: Loaded 17852 existing records. [2025-10-22T19:24:06.549171] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-22T19:24:06.584881] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-22T19:24:06.676907] [DEBUG] [LOCAL ] IP: Loaded 53304 existing records from primary storage. [2025-10-22T19:24:06.683302] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:06.713569] [INFO ] [MAIN ] IP: Loaded 53304 existing records. [2025-10-22T19:24:06.713451] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-22T19:24:06.728176] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-22T19:24:06.783497] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:06.783617] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-22T19:24:06.834004] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-22T19:24:06.848466] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-22T19:24:06.950265] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-22T19:24:07.065793] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-22T19:24:07.084581] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-22T19:24:07.079363] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:07.106636] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-22T19:24:07.115379] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-22T19:24:07.126254] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-22T19:24:07.224569] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-22T19:24:07.402071] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:07.484232] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-22T19:24:07.534830] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-22T19:24:07.599926] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-22T19:24:07.608975] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-22T19:24:07.966955] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:08.005058] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-22T19:24:08.409306] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:08.467829] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-22T19:24:08.568174] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:08.592074] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-22T19:24:08.678236] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:08.678588] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-22T19:24:09.026109] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T19:24:09.030187] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-22T19:24:09.583270] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T19:24:09.588330] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-22T19:24:10.142766] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T19:24:10.147326] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-22T19:24:10.354695] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:24:10.365743] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-22T19:24:10.408573] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T19:24:10.420525] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-22T19:24:10.435877] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T19:24:10.441467] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-22T19:24:11.291745] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T19:24:11.298245] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-22T19:24:11.382555] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T19:24:11.386373] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-22T19:24:11.913438] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T19:24:11.924913] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-22T19:24:12.008326] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T19:24:12.018794] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-22T19:24:12.104859] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T19:24:12.111152] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-22T19:24:12.128034] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T19:24:12.133949] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-22T19:24:13.011387] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T19:24:13.015478] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-22T19:24:13.101442] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T19:24:13.107524] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-22T19:24:13.771398] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T19:24:13.784113] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-22T19:24:13.812957] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T19:24:13.844120] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T19:24:14.015661] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T19:24:14.517716] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-22T19:24:15.317762] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-22T19:24:15.799958] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T19:24:16.117636] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-22T19:24:16.315447] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T19:24:16.317470] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T19:24:16.917775] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-22T19:24:17.717670] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-22T19:24:17.921906] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T19:24:17.980269] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T19:24:18.517687] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-22T19:24:18.802487] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T19:24:19.317634] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-22T19:24:20.127064] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-22T19:24:20.133678] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T19:24:20.295780] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T19:24:20.917683] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-22T19:24:21.201984] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T19:24:21.717687] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-22T19:24:21.860916] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T19:24:21.863841] [INFO ] [REMOTE ] IQI: Full fetch complete (26407 records). [2025-10-22T19:24:21.863924] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-22T19:24:22.238159] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-22T19:24:22.238257] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-22T19:24:22.238841] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-22T19:24:22.238909] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-22T19:24:22.239792] [DEBUG] [LOCAL ] IQI: Trimmed 26407 records to 17764 (keeping 200 days of data) [2025-10-22T19:24:22.342670] [DEBUG] [LOCAL ] IQI: Primary data saved (17764 records). [2025-10-22T19:24:22.342809] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-22T19:24:22.342893] [INFO ] [MAIN ] Update Progress: 1121/2367 symbols completed. IQI took 16.8s. Estimated remaining: 2h 40m 23s. Rate: 7.8 symbols/min [2025-10-22T19:24:22.509727] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:22.517722] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-22T19:24:22.554722] [DEBUG] [LOCAL ] IQV: Loaded 50013 existing records from primary storage. [2025-10-22T19:24:22.555015] [INFO ] [MAIN ] IQV: Loaded 50013 existing records. [2025-10-22T19:24:22.727412] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:22.727590] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-22T19:24:22.727637] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-22T19:24:22.727893] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-22T19:24:22.727949] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-22T19:24:23.072848] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:23.317704] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-22T19:24:23.538339] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T19:24:23.635520] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T19:24:24.117693] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-22T19:24:24.917635] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-22T19:24:24.978206] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:24:25.717691] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-22T19:24:26.065056] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T19:24:26.517718] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-22T19:24:26.679858] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:24:27.038546] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T19:24:27.045963] [INFO ] [REMOTE ] IPI: Full fetch complete (30308 records). [2025-10-22T19:24:27.046208] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-22T19:24:27.324070] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-22T19:24:27.454719] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-22T19:24:27.454826] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-22T19:24:27.455780] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-22T19:24:27.455848] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-22T19:24:27.457029] [DEBUG] [LOCAL ] IPI: Trimmed 30308 records to 21414 (keeping 200 days of data) [2025-10-22T19:24:27.593170] [DEBUG] [LOCAL ] IPI: Primary data saved (21414 records). [2025-10-22T19:24:27.593392] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-22T19:24:27.593534] [INFO ] [MAIN ] Update Progress: 1122/2367 symbols completed. IPI took 22.1s. Estimated remaining: 2h 40m 13s. Rate: 7.8 symbols/min [2025-10-22T19:24:27.777186] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:27.832498] [DEBUG] [LOCAL ] IR: Loaded 52756 existing records from primary storage. [2025-10-22T19:24:27.833134] [INFO ] [MAIN ] IR: Loaded 52756 existing records. [2025-10-22T19:24:28.029858] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:28.030288] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-22T19:24:28.030374] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-22T19:24:28.031060] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-22T19:24:28.031127] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-22T19:24:28.122284] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-22T19:24:28.173147] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:24:28.455621] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:28.917769] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-22T19:24:29.114600] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:24:29.717759] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-22T19:24:30.089744] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T19:24:30.397018] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:24:30.517698] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-22T19:24:31.224172] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T19:24:31.317701] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-22T19:24:32.117701] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-22T19:24:32.323836] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:24:32.917710] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-22T19:24:32.982240] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T19:24:33.717696] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-22T19:24:33.834088] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T19:24:34.517717] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-22T19:24:35.317676] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-22T19:24:35.429139] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T19:24:35.696782] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-22T19:24:35.705711] [INFO ] [REMOTE ] IP: Full fetch complete (77414 records). [2025-10-22T19:24:35.705843] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-22T19:24:36.117156] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-22T19:24:36.117256] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-22T19:24:36.118236] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-22T19:24:36.118406] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-22T19:24:36.118523] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-22T19:24:36.120903] [DEBUG] [LOCAL ] IP: Trimmed 77414 records to 53300 (keeping 200 days of data) [2025-10-22T19:24:36.358550] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T19:24:36.480837] [DEBUG] [LOCAL ] IP: Primary data saved (53300 records). [2025-10-22T19:24:36.481030] [INFO ] [MAIN ] IP: Full history saved. [2025-10-22T19:24:36.481121] [INFO ] [MAIN ] Update Progress: 1123/2367 symbols completed. IP took 31.0s. Estimated remaining: 2h 40m 6s. Rate: 7.8 symbols/min [2025-10-22T19:24:36.652756] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:36.694109] [DEBUG] [LOCAL ] IRM: Loaded 48973 existing records from primary storage. [2025-10-22T19:24:36.694407] [INFO ] [MAIN ] IRM: Loaded 48973 existing records. [2025-10-22T19:24:36.878824] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:36.879052] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-22T19:24:36.879100] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-22T19:24:36.879438] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-22T19:24:36.879495] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-22T19:24:36.925582] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-22T19:24:37.258341] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:37.288063] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T19:24:37.717619] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-22T19:24:37.953849] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T19:24:38.517692] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-22T19:24:38.731683] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T19:24:39.149259] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T19:24:39.317720] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-22T19:24:40.117695] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-22T19:24:40.359686] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T19:24:40.368513] [INFO ] [REMOTE ] IPG: Full fetch complete (77441 records). [2025-10-22T19:24:40.368699] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-22T19:24:40.767706] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-22T19:24:40.767875] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-22T19:24:40.769083] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-22T19:24:40.769211] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-22T19:24:40.770757] [DEBUG] [LOCAL ] IPG: Trimmed 77441 records to 53330 (keeping 200 days of data) [2025-10-22T19:24:40.918895] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-22T19:24:40.973302] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T19:24:41.149484] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-10-22T19:24:41.149638] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-22T19:24:41.149765] [INFO ] [MAIN ] Update Progress: 1124/2367 symbols completed. IPG took 35.6s. Estimated remaining: 2h 39m 55s. Rate: 7.8 symbols/min [2025-10-22T19:24:41.330863] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:41.354880] [DEBUG] [LOCAL ] IRS: Loaded 23350 existing records from primary storage. [2025-10-22T19:24:41.355197] [INFO ] [MAIN ] IRS: Loaded 23350 existing records. [2025-10-22T19:24:41.548933] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:41.549150] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-22T19:24:41.549198] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-22T19:24:41.549448] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-22T19:24:41.549522] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-22T19:24:41.723539] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-22T19:24:41.946471] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:42.091731] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T19:24:42.517637] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-22T19:24:42.781105] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T19:24:43.317685] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-22T19:24:43.544871] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T19:24:44.117685] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-22T19:24:44.317258] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T19:24:44.482446] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T19:24:44.917762] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-22T19:24:45.604619] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T19:24:45.717615] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-22T19:24:45.925681] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T19:24:46.517685] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-22T19:24:47.317754] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-22T19:24:47.465433] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T19:24:48.070487] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T19:24:48.117660] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-22T19:24:48.298855] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T19:24:48.917762] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-22T19:24:49.717676] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-22T19:24:49.907323] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:24:49.960691] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T19:24:50.517690] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-22T19:24:51.317676] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-22T19:24:51.364090] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:24:52.117675] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-22T19:24:52.266192] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T19:24:52.917678] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-22T19:24:53.057768] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T19:24:53.079963] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T19:24:53.717687] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-22T19:24:54.517685] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-22T19:24:54.561188] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T19:24:54.749333] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T19:24:55.031986] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-22T19:24:55.040211] [INFO ] [REMOTE ] IQV: Full fetch complete (72555 records). [2025-10-22T19:24:55.040338] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-22T19:24:55.322753] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-22T19:24:55.427256] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-22T19:24:55.427336] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-22T19:24:55.428258] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-22T19:24:55.428321] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-22T19:24:55.429744] [DEBUG] [LOCAL ] IQV: Trimmed 72555 records to 49962 (keeping 200 days of data) [2025-10-22T19:24:55.721610] [DEBUG] [LOCAL ] IQV: Primary data saved (49962 records). [2025-10-22T19:24:55.721764] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-22T19:24:55.721846] [INFO ] [MAIN ] Update Progress: 1125/2367 symbols completed. IQV took 33.4s. Estimated remaining: 2h 39m 55s. Rate: 7.8 symbols/min [2025-10-22T19:24:55.903204] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:55.951362] [DEBUG] [LOCAL ] IRT: Loaded 50486 existing records from primary storage. [2025-10-22T19:24:55.951695] [INFO ] [MAIN ] IRT: Loaded 50486 existing records. [2025-10-22T19:24:56.124601] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-22T19:24:56.129898] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:56.131051] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-22T19:24:56.131104] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-22T19:24:56.131294] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-22T19:24:56.131334] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-22T19:24:56.480639] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:56.914952] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T19:24:56.924175] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-22T19:24:57.371727] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T19:24:57.717687] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-22T19:24:58.517767] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-22T19:24:58.603553] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T19:24:59.317714] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-22T19:24:59.436454] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T19:25:00.018056] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T19:25:00.117667] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-22T19:25:00.377048] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T19:25:00.917699] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-22T19:25:01.563096] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T19:25:01.717686] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-22T19:25:02.517760] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-22T19:25:02.852267] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T19:25:02.860927] [INFO ] [REMOTE ] IR: Full fetch complete (76487 records). [2025-10-22T19:25:02.861053] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-22T19:25:03.260690] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-22T19:25:03.260815] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-22T19:25:03.261939] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-22T19:25:03.262021] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-22T19:25:03.263673] [DEBUG] [LOCAL ] IR: Trimmed 76487 records to 52749 (keeping 200 days of data) [2025-10-22T19:25:03.318083] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-22T19:25:03.391536] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T19:25:03.613524] [DEBUG] [LOCAL ] IR: Primary data saved (52749 records). [2025-10-22T19:25:03.613692] [INFO ] [MAIN ] IR: Full history saved. [2025-10-22T19:25:03.614176] [INFO ] [MAIN ] Update Progress: 1126/2367 symbols completed. IR took 36.0s. Estimated remaining: 2h 39m 47s. Rate: 7.8 symbols/min [2025-10-22T19:25:03.781453] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:03.799906] [DEBUG] [LOCAL ] ISD: Loaded 15750 existing records from primary storage. [2025-10-22T19:25:03.800163] [INFO ] [MAIN ] ISD: Loaded 15750 existing records. [2025-10-22T19:25:03.976958] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:03.977153] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-22T19:25:03.977199] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-22T19:25:03.977381] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-22T19:25:03.977435] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-22T19:25:04.128117] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-22T19:25:04.339903] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:04.367352] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T19:25:04.917665] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-22T19:25:05.164255] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T19:25:05.213242] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T19:25:05.218208] [INFO ] [REMOTE ] IRS: Full fetch complete (32660 records). [2025-10-22T19:25:05.218287] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-22T19:25:05.607094] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-22T19:25:05.607181] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-22T19:25:05.607981] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-22T19:25:05.608044] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-22T19:25:05.608900] [DEBUG] [LOCAL ] IRS: Trimmed 32660 records to 23290 (keeping 200 days of data) [2025-10-22T19:25:05.724793] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-22T19:25:05.744811] [DEBUG] [LOCAL ] IRS: Primary data saved (23290 records). [2025-10-22T19:25:05.745005] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-22T19:25:05.745100] [INFO ] [MAIN ] Update Progress: 1127/2367 symbols completed. IRS took 24.6s. Estimated remaining: 2h 39m 34s. Rate: 7.8 symbols/min [2025-10-22T19:25:05.910180] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:05.949344] [DEBUG] [LOCAL ] IT: Loaded 42230 existing records from primary storage. [2025-10-22T19:25:05.949634] [INFO ] [MAIN ] IT: Loaded 42230 existing records. [2025-10-22T19:25:06.120957] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:25:06.148032] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:06.148245] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-22T19:25:06.148292] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-22T19:25:06.148476] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-22T19:25:06.148517] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-22T19:25:06.525064] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:06.521712] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-22T19:25:07.317775] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-22T19:25:07.613146] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T19:25:07.621139] [INFO ] [REMOTE ] IRM: Full fetch complete (72131 records). [2025-10-22T19:25:07.621291] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-22T19:25:08.012339] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-22T19:25:08.012436] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-22T19:25:08.013482] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-22T19:25:08.013560] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-22T19:25:08.014907] [DEBUG] [LOCAL ] IRM: Trimmed 72131 records to 48910 (keeping 200 days of data) [2025-10-22T19:25:08.131307] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-22T19:25:08.165064] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T19:25:08.356805] [DEBUG] [LOCAL ] IRM: Primary data saved (48910 records). [2025-10-22T19:25:08.357026] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-22T19:25:08.357122] [INFO ] [MAIN ] Update Progress: 1128/2367 symbols completed. IRM took 31.9s. Estimated remaining: 2h 39m 20s. Rate: 7.8 symbols/min [2025-10-22T19:25:08.530538] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:08.559618] [DEBUG] [LOCAL ] ITGR: Loaded 31006 existing records from primary storage. [2025-10-22T19:25:08.559890] [INFO ] [MAIN ] ITGR: Loaded 31006 existing records. [2025-10-22T19:25:08.737373] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:08.737769] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-22T19:25:08.737835] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-22T19:25:08.738104] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-22T19:25:08.738159] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-22T19:25:08.920001] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-22T19:25:09.000459] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:25:09.122519] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:09.164540] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T19:25:09.717775] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-22T19:25:10.517705] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-22T19:25:10.635731] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:25:10.840637] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T19:25:11.147838] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T19:25:11.317683] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-22T19:25:12.117665] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-22T19:25:12.359302] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T19:25:12.917701] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-22T19:25:13.419868] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T19:25:13.717772] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-22T19:25:14.497328] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T19:25:14.517615] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-22T19:25:14.633725] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T19:25:15.317707] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-22T19:25:16.111289] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T19:25:16.121966] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-22T19:25:16.841092] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T19:25:16.917638] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-22T19:25:17.121512] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T19:25:17.717691] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-22T19:25:18.517696] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-22T19:25:18.595084] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:25:18.618429] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T19:25:19.317710] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-22T19:25:20.117639] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-22T19:25:20.156062] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T19:25:20.437295] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T19:25:20.917678] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-22T19:25:21.717638] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-22T19:25:21.757291] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T19:25:22.395502] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:25:22.517680] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-22T19:25:23.221267] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T19:25:23.317676] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-22T19:25:24.117636] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-22T19:25:24.204795] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T19:25:24.259107] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:25:24.267694] [INFO ] [REMOTE ] IRT: Full fetch complete (72928 records). [2025-10-22T19:25:24.267882] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-22T19:25:24.664935] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-22T19:25:24.665045] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-22T19:25:24.666123] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-22T19:25:24.666190] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-22T19:25:24.667528] [DEBUG] [LOCAL ] IRT: Trimmed 72928 records to 50443 (keeping 200 days of data) [2025-10-22T19:25:24.941699] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-22T19:25:24.979226] [DEBUG] [LOCAL ] IRT: Primary data saved (50443 records). [2025-10-22T19:25:24.979330] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-22T19:25:24.979406] [INFO ] [MAIN ] Update Progress: 1129/2367 symbols completed. IRT took 29.3s. Estimated remaining: 2h 39m 22s. Rate: 7.8 symbols/min [2025-10-22T19:25:25.145721] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:25.175444] [DEBUG] [LOCAL ] ITT: Loaded 32438 existing records from primary storage. [2025-10-22T19:25:25.175771] [INFO ] [MAIN ] ITT: Loaded 32438 existing records. [2025-10-22T19:25:25.351824] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:25.352101] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-22T19:25:25.352177] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-22T19:25:25.352445] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-22T19:25:25.352554] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-22T19:25:25.686194] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T19:25:25.727483] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-22T19:25:25.752220] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T19:25:25.766463] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:26.517685] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-22T19:25:27.279480] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T19:25:27.317612] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-22T19:25:27.798050] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T19:25:28.117680] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-22T19:25:28.917711] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-22T19:25:28.965158] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T19:25:29.451992] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T19:25:29.717672] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-22T19:25:30.321947] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T19:25:30.517631] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-22T19:25:30.829611] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T19:25:31.317760] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-22T19:25:32.117723] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-22T19:25:32.449672] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T19:25:32.917717] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-22T19:25:32.969907] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:25:33.051245] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T19:25:33.717673] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-22T19:25:34.041381] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T19:25:34.044820] [INFO ] [REMOTE ] ISD: Full fetch complete (24166 records). [2025-10-22T19:25:34.044902] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-22T19:25:34.405116] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-22T19:25:34.405188] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-22T19:25:34.405691] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-22T19:25:34.405751] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-22T19:25:34.406325] [DEBUG] [LOCAL ] ISD: Trimmed 24166 records to 15648 (keeping 200 days of data) [2025-10-22T19:25:34.501538] [DEBUG] [LOCAL ] ISD: Primary data saved (15648 records). [2025-10-22T19:25:34.501692] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-22T19:25:34.501782] [INFO ] [MAIN ] Update Progress: 1130/2367 symbols completed. ISD took 30.9s. Estimated remaining: 2h 39m 17s. Rate: 7.8 symbols/min [2025-10-22T19:25:34.522802] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-22T19:25:34.672334] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:34.719531] [DEBUG] [LOCAL ] ITUB: Loaded 53322 existing records from primary storage. [2025-10-22T19:25:34.719857] [INFO ] [MAIN ] ITUB: Loaded 53322 existing records. [2025-10-22T19:25:34.892151] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:34.892374] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-22T19:25:34.892441] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-22T19:25:34.892720] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-22T19:25:34.892777] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-22T19:25:35.252467] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:35.317618] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-22T19:25:35.403274] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:25:36.117632] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-22T19:25:36.379431] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T19:25:36.723553] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T19:25:36.917679] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-22T19:25:37.295159] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T19:25:37.717692] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-22T19:25:38.517632] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-22T19:25:38.676834] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T19:25:38.684178] [INFO ] [REMOTE ] IT: Full fetch complete (57943 records). [2025-10-22T19:25:38.684293] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-22T19:25:39.059460] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-22T19:25:39.059539] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-22T19:25:39.060350] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-22T19:25:39.060412] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-22T19:25:39.061543] [DEBUG] [LOCAL ] IT: Trimmed 57943 records to 42205 (keeping 200 days of data) [2025-10-22T19:25:39.311588] [DEBUG] [LOCAL ] IT: Primary data saved (42205 records). [2025-10-22T19:25:39.311766] [INFO ] [MAIN ] IT: Full history saved. [2025-10-22T19:25:39.311856] [INFO ] [MAIN ] Update Progress: 1131/2367 symbols completed. IT took 33.6s. Estimated remaining: 2h 39m 6s. Rate: 7.8 symbols/min [2025-10-22T19:25:39.323102] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-22T19:25:39.484976] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:39.513849] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T19:25:39.559855] [DEBUG] [LOCAL ] ITW: Loaded 45596 existing records from primary storage. [2025-10-22T19:25:39.560143] [INFO ] [MAIN ] ITW: Loaded 45596 existing records. [2025-10-22T19:25:39.737685] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:39.738408] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-22T19:25:39.738516] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-22T19:25:39.738852] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-22T19:25:39.738947] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-22T19:25:39.909815] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T19:25:40.116892] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:40.117608] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-22T19:25:40.548437] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T19:25:40.917698] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-22T19:25:41.670832] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T19:25:41.717630] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-22T19:25:42.096859] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T19:25:42.517684] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-22T19:25:43.317627] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-22T19:25:43.484551] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T19:25:44.117787] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-22T19:25:44.174346] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:25:44.261701] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T19:25:44.266877] [INFO ] [REMOTE ] ITGR: Full fetch complete (43260 records). [2025-10-22T19:25:44.267004] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-22T19:25:44.636030] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-22T19:25:44.636117] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-22T19:25:44.636924] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-22T19:25:44.636989] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-22T19:25:44.638016] [DEBUG] [LOCAL ] ITGR: Trimmed 43260 records to 30945 (keeping 200 days of data) [2025-10-22T19:25:44.818112] [DEBUG] [LOCAL ] ITGR: Primary data saved (30945 records). [2025-10-22T19:25:44.818241] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-22T19:25:44.818317] [INFO ] [MAIN ] Update Progress: 1132/2367 symbols completed. ITGR took 36.5s. Estimated remaining: 2h 38m 55s. Rate: 7.8 symbols/min [2025-10-22T19:25:44.917927] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-22T19:25:44.989045] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:45.030236] [DEBUG] [LOCAL ] IVR: Loaded 47886 existing records from primary storage. [2025-10-22T19:25:45.030537] [INFO ] [MAIN ] IVR: Loaded 47886 existing records. [2025-10-22T19:25:45.207304] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:45.207685] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-22T19:25:45.207908] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-22T19:25:45.208090] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-22T19:25:45.208130] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-22T19:25:45.602287] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T19:25:45.614939] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:45.717683] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-22T19:25:46.517818] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-22T19:25:46.781694] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T19:25:47.317779] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-22T19:25:47.393130] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:25:48.117755] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-22T19:25:48.216702] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:25:48.866791] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T19:25:48.917621] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-22T19:25:49.294277] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T19:25:49.717763] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-22T19:25:50.517677] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-22T19:25:50.624237] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:25:51.317692] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-22T19:25:51.382063] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:25:51.902630] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T19:25:52.117685] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-22T19:25:52.559708] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T19:25:52.917691] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-22T19:25:53.717721] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-22T19:25:53.846180] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T19:25:53.966800] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T19:25:53.972226] [INFO ] [REMOTE ] ITT: Full fetch complete (47614 records). [2025-10-22T19:25:53.972338] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-22T19:25:54.359753] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-22T19:25:54.359879] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-22T19:25:54.360747] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-22T19:25:54.360811] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-22T19:25:54.361842] [DEBUG] [LOCAL ] ITT: Trimmed 47614 records to 32352 (keeping 200 days of data) [2025-10-22T19:25:54.520049] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-22T19:25:54.566112] [DEBUG] [LOCAL ] ITT: Primary data saved (32352 records). [2025-10-22T19:25:54.566221] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-22T19:25:54.566294] [INFO ] [MAIN ] Update Progress: 1133/2367 symbols completed. ITT took 29.6s. Estimated remaining: 2h 38m 50s. Rate: 7.8 symbols/min [2025-10-22T19:25:54.740826] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:54.770002] [DEBUG] [LOCAL ] IVT: Loaded 31476 existing records from primary storage. [2025-10-22T19:25:54.770290] [INFO ] [MAIN ] IVT: Loaded 31476 existing records. [2025-10-22T19:25:54.952078] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:54.952284] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-22T19:25:54.952332] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-22T19:25:54.952497] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-22T19:25:54.952537] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-22T19:25:55.323789] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-22T19:25:55.323732] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:55.602798] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T19:25:56.117803] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-22T19:25:56.378745] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T19:25:56.917773] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-22T19:25:56.981325] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T19:25:57.717668] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-22T19:25:57.765804] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T19:25:58.517637] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-22T19:25:58.606968] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T19:25:58.856629] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:25:59.317620] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-22T19:25:59.344817] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:26:00.117676] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-22T19:26:00.917630] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-22T19:26:01.266534] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T19:26:01.717665] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-22T19:26:01.845017] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T19:26:02.517683] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-22T19:26:02.762555] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T19:26:02.980028] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T19:26:03.317703] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-22T19:26:04.117761] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-22T19:26:04.252546] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T19:26:04.530566] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T19:26:04.917724] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-22T19:26:05.717695] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-22T19:26:05.798429] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:26:06.517766] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-22T19:26:06.655566] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T19:26:07.317634] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-22T19:26:07.568349] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T19:26:07.577315] [INFO ] [REMOTE ] ITUB: Full fetch complete (77317 records). [2025-10-22T19:26:07.577500] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-22T19:26:08.025446] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-22T19:26:08.025306] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T19:26:08.032568] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-22T19:26:08.033892] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-22T19:26:08.034371] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-22T19:26:08.036005] [DEBUG] [LOCAL ] ITUB: Trimmed 77317 records to 53318 (keeping 200 days of data) [2025-10-22T19:26:08.121074] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-22T19:26:08.346277] [DEBUG] [LOCAL ] ITUB: Primary data saved (53318 records). [2025-10-22T19:26:08.346412] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-22T19:26:08.347059] [INFO ] [MAIN ] Update Progress: 1134/2367 symbols completed. ITUB took 33.8s. Estimated remaining: 2h 38m 49s. Rate: 7.8 symbols/min [2025-10-22T19:26:08.512709] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:08.562749] [DEBUG] [LOCAL ] IVZ: Loaded 53133 existing records from primary storage. [2025-10-22T19:26:08.563078] [INFO ] [MAIN ] IVZ: Loaded 53133 existing records. [2025-10-22T19:26:08.738000] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:08.738209] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-22T19:26:08.738257] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-22T19:26:08.738442] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-22T19:26:08.738481] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-22T19:26:08.930171] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-22T19:26:09.121195] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:09.352014] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T19:26:09.717705] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-22T19:26:09.944679] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T19:26:09.996830] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T19:26:10.517706] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-22T19:26:11.317672] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-22T19:26:11.509821] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T19:26:12.002738] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:26:12.010771] [INFO ] [REMOTE ] IVR: Full fetch complete (69079 records). [2025-10-22T19:26:12.010892] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-22T19:26:12.122859] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-22T19:26:12.410203] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-22T19:26:12.410332] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-22T19:26:12.411482] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-22T19:26:12.411675] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-22T19:26:12.413203] [DEBUG] [LOCAL ] IVR: Trimmed 69079 records to 47827 (keeping 200 days of data) [2025-10-22T19:26:12.695032] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T19:26:12.714125] [DEBUG] [LOCAL ] IVR: Primary data saved (47827 records). [2025-10-22T19:26:12.714878] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-22T19:26:12.715347] [INFO ] [MAIN ] Update Progress: 1135/2367 symbols completed. IVR took 27.9s. Estimated remaining: 2h 38m 37s. Rate: 7.8 symbols/min [2025-10-22T19:26:12.881703] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:12.902795] [DEBUG] [LOCAL ] IX: Loaded 22198 existing records from primary storage. [2025-10-22T19:26:12.903051] [INFO ] [MAIN ] IX: Loaded 22198 existing records. [2025-10-22T19:26:12.923340] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-22T19:26:13.080557] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:13.080812] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-22T19:26:13.080861] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-22T19:26:13.081022] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-22T19:26:13.081060] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-22T19:26:13.434437] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:13.717712] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-22T19:26:13.822745] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T19:26:14.515841] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T19:26:14.517944] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-22T19:26:14.633808] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T19:26:14.641203] [INFO ] [REMOTE ] ITW: Full fetch complete (66790 records). [2025-10-22T19:26:14.641353] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-22T19:26:15.023132] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-22T19:26:15.023224] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-22T19:26:15.024129] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-22T19:26:15.024192] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-22T19:26:15.025538] [DEBUG] [LOCAL ] ITW: Trimmed 66790 records to 45583 (keeping 200 days of data) [2025-10-22T19:26:15.308227] [DEBUG] [LOCAL ] ITW: Primary data saved (45583 records). [2025-10-22T19:26:15.308367] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-22T19:26:15.308449] [INFO ] [MAIN ] Update Progress: 1136/2367 symbols completed. ITW took 36.0s. Estimated remaining: 2h 38m 24s. Rate: 7.8 symbols/min [2025-10-22T19:26:15.322728] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-22T19:26:15.381160] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T19:26:15.510931] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:15.550623] [DEBUG] [LOCAL ] J: Loaded 40509 existing records from primary storage. [2025-10-22T19:26:15.550962] [INFO ] [MAIN ] J: Loaded 40509 existing records. [2025-10-22T19:26:15.724022] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:15.724269] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-22T19:26:15.724316] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-22T19:26:15.724499] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-22T19:26:15.724537] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-22T19:26:16.124969] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-22T19:26:16.124868] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:16.721540] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T19:26:16.917773] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-22T19:26:17.209382] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T19:26:17.717752] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-22T19:26:18.336776] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T19:26:18.517754] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-22T19:26:19.247327] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T19:26:19.317619] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-22T19:26:20.117688] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-22T19:26:20.335367] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T19:26:20.853126] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T19:26:20.917669] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-22T19:26:21.486462] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T19:26:21.717828] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-22T19:26:22.472405] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T19:26:22.517624] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-22T19:26:22.910825] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T19:26:23.317668] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-22T19:26:24.117754] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-22T19:26:24.149062] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T19:26:24.917664] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-22T19:26:25.273869] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T19:26:25.377064] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T19:26:25.717622] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-22T19:26:26.036953] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T19:26:26.517675] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-22T19:26:27.292802] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T19:26:27.317609] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-22T19:26:27.611438] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:26:28.117715] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-22T19:26:28.917677] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-22T19:26:28.975695] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T19:26:29.598437] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T19:26:29.604549] [INFO ] [REMOTE ] IVT: Full fetch complete (45792 records). [2025-10-22T19:26:29.604674] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-22T19:26:29.719781] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-22T19:26:29.954459] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T19:26:30.040180] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-22T19:26:30.040310] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-22T19:26:30.041198] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-22T19:26:30.041296] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-22T19:26:30.042424] [DEBUG] [LOCAL ] IVT: Trimmed 45792 records to 31418 (keeping 200 days of data) [2025-10-22T19:26:30.244849] [DEBUG] [LOCAL ] IVT: Primary data saved (31418 records). [2025-10-22T19:26:30.245121] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-22T19:26:30.245230] [INFO ] [MAIN ] Update Progress: 1137/2367 symbols completed. IVT took 35.7s. Estimated remaining: 2h 38m 24s. Rate: 7.8 symbols/min [2025-10-22T19:26:30.413183] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:30.449043] [DEBUG] [LOCAL ] JBGS: Loaded 41810 existing records from primary storage. [2025-10-22T19:26:30.449371] [INFO ] [MAIN ] JBGS: Loaded 41810 existing records. [2025-10-22T19:26:30.522890] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-22T19:26:30.626640] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:30.626867] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-22T19:26:30.626913] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-22T19:26:30.627154] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-22T19:26:30.627210] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-22T19:26:30.987633] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:31.317639] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-22T19:26:31.699455] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T19:26:32.117699] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-22T19:26:32.152182] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T19:26:32.327992] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T19:26:32.917724] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-22T19:26:33.224684] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T19:26:33.717710] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-22T19:26:34.353088] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T19:26:34.517706] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-22T19:26:35.317616] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-22T19:26:35.594203] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T19:26:35.628307] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T19:26:35.632059] [INFO ] [REMOTE ] IX: Full fetch complete (28666 records). [2025-10-22T19:26:35.632130] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-22T19:26:35.999133] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-22T19:26:35.999217] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-22T19:26:35.999951] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-22T19:26:36.000014] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-22T19:26:36.000898] [DEBUG] [LOCAL ] IX: Trimmed 28666 records to 22121 (keeping 200 days of data) [2025-10-22T19:26:36.119184] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-22T19:26:36.126017] [DEBUG] [LOCAL ] IX: Primary data saved (22121 records). [2025-10-22T19:26:36.127460] [INFO ] [MAIN ] IX: Full history saved. [2025-10-22T19:26:36.127558] [INFO ] [MAIN ] Update Progress: 1138/2367 symbols completed. IX took 23.4s. Estimated remaining: 2h 38m 15s. Rate: 7.8 symbols/min [2025-10-22T19:26:36.311508] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:36.350135] [DEBUG] [LOCAL ] JBI: Loaded 42692 existing records from primary storage. [2025-10-22T19:26:36.350459] [INFO ] [MAIN ] JBI: Loaded 42692 existing records. [2025-10-22T19:26:36.532068] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:36.532432] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-22T19:26:36.532724] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-22T19:26:36.539880] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-22T19:26:36.551751] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-22T19:26:36.632591] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T19:26:36.928632] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-22T19:26:36.951423] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:37.717636] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-22T19:26:37.842307] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:26:38.517720] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-22T19:26:38.562733] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:26:38.733088] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T19:26:39.317719] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-22T19:26:40.117703] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-22T19:26:40.333719] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T19:26:40.343857] [INFO ] [REMOTE ] IVZ: Full fetch complete (77043 records). [2025-10-22T19:26:40.344138] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-22T19:26:40.740471] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-22T19:26:40.740680] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-22T19:26:40.741839] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-22T19:26:40.741927] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-22T19:26:40.753275] [DEBUG] [LOCAL ] IVZ: Trimmed 77043 records to 53130 (keeping 200 days of data) [2025-10-22T19:26:40.770187] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T19:26:40.953917] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-22T19:26:41.108197] [DEBUG] [LOCAL ] IVZ: Primary data saved (53130 records). [2025-10-22T19:26:41.108452] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-22T19:26:41.108703] [INFO ] [MAIN ] Update Progress: 1139/2367 symbols completed. IVZ took 32.8s. Estimated remaining: 2h 38m 4s. Rate: 7.8 symbols/min [2025-10-22T19:26:41.307156] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:41.309668] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T19:26:41.359187] [DEBUG] [LOCAL ] JBL: Loaded 48345 existing records from primary storage. [2025-10-22T19:26:41.359479] [INFO ] [MAIN ] JBL: Loaded 48345 existing records. [2025-10-22T19:26:41.542012] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:41.542186] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-22T19:26:41.542235] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-22T19:26:41.542403] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-22T19:26:41.542442] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-22T19:26:41.722868] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-22T19:26:41.917830] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:42.517670] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-22T19:26:42.571819] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:26:43.148089] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T19:26:43.317750] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-22T19:26:43.640717] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T19:26:44.117708] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-22T19:26:44.821992] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:26:44.917619] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-22T19:26:45.532269] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T19:26:45.717715] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-22T19:26:46.500148] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T19:26:46.517622] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-22T19:26:47.132890] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T19:26:47.140435] [INFO ] [REMOTE ] J: Full fetch complete (59870 records). [2025-10-22T19:26:47.140568] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-22T19:26:47.328325] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-22T19:26:47.527286] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-22T19:26:47.527354] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-22T19:26:47.528229] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-22T19:26:47.528295] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-22T19:26:47.529544] [DEBUG] [LOCAL ] J: Trimmed 59870 records to 40527 (keeping 200 days of data) [2025-10-22T19:26:47.775011] [DEBUG] [LOCAL ] J: Primary data saved (40527 records). [2025-10-22T19:26:47.775128] [INFO ] [MAIN ] J: Full history saved. [2025-10-22T19:26:47.775201] [INFO ] [MAIN ] Update Progress: 1140/2367 symbols completed. J took 32.5s. Estimated remaining: 2h 37m 55s. Rate: 7.8 symbols/min [2025-10-22T19:26:47.939086] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:47.964244] [DEBUG] [LOCAL ] JBND: Loaded 27324 existing records from primary storage. [2025-10-22T19:26:47.964507] [INFO ] [MAIN ] JBND: Loaded 27324 existing records. [2025-10-22T19:26:48.134454] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-22T19:26:48.140158] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:48.140738] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-22T19:26:48.140790] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-22T19:26:48.141005] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-22T19:26:48.141042] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-22T19:26:48.498017] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:48.524947] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T19:26:48.924983] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-22T19:26:48.929905] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T19:26:49.505724] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T19:26:49.717769] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-22T19:26:49.899954] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T19:26:50.517719] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-22T19:26:51.265240] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T19:26:51.317634] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-22T19:26:52.097438] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T19:26:52.117618] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-22T19:26:52.917702] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-22T19:26:53.046668] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:26:53.562863] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:26:53.717710] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-22T19:26:54.517683] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-22T19:26:54.625317] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T19:26:54.747926] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T19:26:55.317715] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-22T19:26:56.117767] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-22T19:26:56.385497] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T19:26:56.510436] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T19:26:56.917750] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-22T19:26:57.303980] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T19:26:57.310719] [INFO ] [REMOTE ] JBGS: Full fetch complete (59200 records). [2025-10-22T19:26:57.310864] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-22T19:26:57.715925] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-22T19:26:57.716012] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-22T19:26:57.716975] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-22T19:26:57.717040] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-22T19:26:57.717811] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-22T19:26:57.719748] [DEBUG] [LOCAL ] JBGS: Trimmed 59200 records to 41708 (keeping 200 days of data) [2025-10-22T19:26:57.966558] [DEBUG] [LOCAL ] JBGS: Primary data saved (41708 records). [2025-10-22T19:26:57.966720] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-22T19:26:57.966809] [INFO ] [MAIN ] Update Progress: 1141/2367 symbols completed. JBGS took 27.7s. Estimated remaining: 2h 37m 50s. Rate: 7.8 symbols/min [2025-10-22T19:26:58.159109] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:58.161155] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-22T19:26:58.161003] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T19:26:58.161256] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-22T19:26:58.166943] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-22T19:26:58.167243] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-22T19:26:58.167816] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-22T19:26:58.168288] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-22T19:26:58.519754] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-22T19:26:58.543823] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:59.266841] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T19:26:59.317688] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-22T19:26:59.510270] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:26:59.510492] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-22T19:26:59.510591] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:26:59.510663] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-22T19:26:59.510721] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:26:59.510788] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-22T19:26:59.510850] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-22T19:26:59.510884] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-22T19:26:59.510921] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-22T19:26:59.510965] [INFO ] [MAIN ] Update Progress: 1142/2367 symbols completed. JBS took 1.5s. Estimated remaining: 2h 37m 36s. Rate: 7.8 symbols/min [2025-10-22T19:26:59.676406] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:59.708829] [DEBUG] [LOCAL ] JBTM: Loaded 33651 existing records from primary storage. [2025-10-22T19:26:59.709083] [INFO ] [MAIN ] JBTM: Loaded 33651 existing records. [2025-10-22T19:26:59.883879] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:59.884091] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-22T19:26:59.884138] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-22T19:26:59.884408] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-10-22T19:26:59.884462] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-22T19:27:00.119824] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-22T19:27:00.239629] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:00.394663] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T19:27:00.917681] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-22T19:27:01.258031] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T19:27:01.717689] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-22T19:27:02.517692] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-22T19:27:03.317701] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-22T19:27:03.365012] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T19:27:03.665375] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-22T19:27:04.029188] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T19:27:04.117633] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-22T19:27:04.917675] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-22T19:27:05.404097] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T19:27:05.717677] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-22T19:27:05.780563] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:27:06.517630] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-22T19:27:06.699007] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T19:27:06.955588] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T19:27:07.317700] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-22T19:27:07.860587] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:27:08.117684] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-22T19:27:08.917671] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-22T19:27:09.308525] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:27:09.647439] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T19:27:09.717718] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-22T19:27:10.442587] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T19:27:10.449442] [INFO ] [REMOTE ] JBI: Full fetch complete (63610 records). [2025-10-22T19:27:10.449581] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-22T19:27:10.522909] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-22T19:27:10.842993] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-22T19:27:10.843084] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-22T19:27:10.843993] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-22T19:27:10.844055] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-22T19:27:10.845211] [DEBUG] [LOCAL ] JBI: Trimmed 63610 records to 42579 (keeping 200 days of data) [2025-10-22T19:27:11.080231] [DEBUG] [LOCAL ] JBI: Primary data saved (42579 records). [2025-10-22T19:27:11.080349] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-22T19:27:11.080433] [INFO ] [MAIN ] Update Progress: 1143/2367 symbols completed. JBI took 35.0s. Estimated remaining: 2h 37m 32s. Rate: 7.8 symbols/min [2025-10-22T19:27:11.259520] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:11.290026] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T19:27:11.304017] [DEBUG] [LOCAL ] JCE: Loaded 7278 existing records from primary storage. [2025-10-22T19:27:11.304567] [INFO ] [MAIN ] JCE: Loaded 7278 existing records. [2025-10-22T19:27:11.326116] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-22T19:27:11.490045] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:11.490262] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-22T19:27:11.490334] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-22T19:27:11.490562] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-22T19:27:11.490620] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-22T19:27:11.817442] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T19:27:11.890027] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:12.117613] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-22T19:27:12.825788] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-22T19:27:12.917611] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-22T19:27:13.338971] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T19:27:13.717698] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-22T19:27:14.403747] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T19:27:14.517708] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-22T19:27:15.180386] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T19:27:15.317720] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-22T19:27:15.993621] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T19:27:16.117684] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-22T19:27:16.917802] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-22T19:27:17.235935] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T19:27:17.244084] [INFO ] [REMOTE ] JBL: Full fetch complete (70627 records). [2025-10-22T19:27:17.244223] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-22T19:27:17.674741] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:27:17.675218] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-22T19:27:17.681264] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-22T19:27:17.682882] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-22T19:27:17.683012] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-22T19:27:17.683378] [INFO ] [REMOTE ] JBND: Full fetch complete (36186 records). [2025-10-22T19:27:17.683558] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-22T19:27:17.720098] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-22T19:27:17.774609] [DEBUG] [LOCAL ] JBL: Trimmed 70627 records to 48330 (keeping 200 days of data) [2025-10-22T19:27:18.158972] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T19:27:18.240869] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-22T19:27:18.241109] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-22T19:27:18.242776] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-22T19:27:18.293900] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-22T19:27:18.340199] [DEBUG] [LOCAL ] JBND: Trimmed 36186 records to 27369 (keeping 200 days of data) [2025-10-22T19:27:18.375717] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:27:18.523558] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-22T19:27:18.556442] [DEBUG] [LOCAL ] JBL: Primary data saved (48330 records). [2025-10-22T19:27:18.557889] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-22T19:27:18.558520] [INFO ] [MAIN ] Update Progress: 1144/2367 symbols completed. JBL took 37.4s. Estimated remaining: 2h 37m 24s. Rate: 7.8 symbols/min [2025-10-22T19:27:18.790779] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:18.806302] [DEBUG] [LOCAL ] JBND: Primary data saved (27369 records). [2025-10-22T19:27:18.806700] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-22T19:27:18.806837] [INFO ] [MAIN ] Update Progress: 1145/2367 symbols completed. JBND took 31.0s. Estimated remaining: 2h 37m 8s. Rate: 7.8 symbols/min [2025-10-22T19:27:18.998480] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:19.042746] [DEBUG] [LOCAL ] JCI: Loaded 53519 existing records from primary storage. [2025-10-22T19:27:19.043242] [INFO ] [MAIN ] JCI: Loaded 53519 existing records. [2025-10-22T19:27:19.212241] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-22T19:27:19.215027] [DEBUG] [LOCAL ] JEF: Loaded 50196 existing records from primary storage. [2025-10-22T19:27:19.238872] [INFO ] [MAIN ] JEF: Loaded 50196 existing records. [2025-10-22T19:27:19.319314] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-22T19:27:19.358739] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:19.395262] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-22T19:27:19.400536] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-22T19:27:19.425102] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-22T19:27:19.440918] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-22T19:27:19.615157] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:19.641893] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-22T19:27:19.662961] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-22T19:27:19.716384] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-22T19:27:19.727579] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-22T19:27:20.043160] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:20.122859] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-22T19:27:20.173588] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T19:27:20.287581] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:20.917639] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-22T19:27:21.717675] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-22T19:27:21.969137] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T19:27:22.299579] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T19:27:22.355799] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T19:27:22.517760] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-22T19:27:23.187612] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-22T19:27:23.317696] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-22T19:27:24.117699] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-22T19:27:24.905945] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T19:27:24.917610] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-22T19:27:25.075343] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T19:27:25.554030] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T19:27:25.717669] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-22T19:27:26.517700] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-22T19:27:27.275446] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-22T19:27:27.317628] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-22T19:27:27.394369] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T19:27:28.117632] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-22T19:27:28.245922] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T19:27:28.248191] [INFO ] [REMOTE ] JCE: Full fetch complete (9652 records). [2025-10-22T19:27:28.248263] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-22T19:27:28.627278] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-22T19:27:28.627352] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-22T19:27:28.627581] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-22T19:27:28.627620] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-22T19:27:28.628108] [DEBUG] [LOCAL ] JCE: Trimmed 9652 records to 7251 (keeping 200 days of data) [2025-10-22T19:27:28.670187] [DEBUG] [LOCAL ] JCE: Primary data saved (7251 records). [2025-10-22T19:27:28.670276] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-22T19:27:28.670352] [INFO ] [MAIN ] Update Progress: 1146/2367 symbols completed. JCE took 17.6s. Estimated remaining: 2h 37m 3s. Rate: 7.8 symbols/min [2025-10-22T19:27:28.837532] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:28.876188] [DEBUG] [LOCAL ] JELD: Loaded 45921 existing records from primary storage. [2025-10-22T19:27:28.876491] [INFO ] [MAIN ] JELD: Loaded 45921 existing records. [2025-10-22T19:27:28.929479] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-22T19:27:29.053460] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:29.053689] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-22T19:27:29.053747] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-22T19:27:29.053980] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-22T19:27:29.054017] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-22T19:27:29.405578] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:29.456139] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T19:27:29.717694] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-22T19:27:30.518791] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-22T19:27:30.521444] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T19:27:31.143441] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T19:27:31.317754] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-22T19:27:31.827694] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T19:27:32.117688] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-22T19:27:32.917632] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-22T19:27:33.186576] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:27:33.563990] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T19:27:33.717632] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-22T19:27:34.517632] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-22T19:27:34.784418] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:27:35.216148] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T19:27:35.317722] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-22T19:27:36.117709] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-22T19:27:36.295223] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T19:27:36.917708] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-22T19:27:36.958134] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T19:27:37.545075] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T19:27:37.551848] [INFO ] [REMOTE ] JBTM: Full fetch complete (47148 records). [2025-10-22T19:27:37.551981] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-22T19:27:37.729490] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-22T19:27:37.938043] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-22T19:27:37.938130] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-22T19:27:37.938935] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-22T19:27:37.938999] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-22T19:27:37.940099] [DEBUG] [LOCAL ] JBTM: Trimmed 47148 records to 33593 (keeping 200 days of data) [2025-10-22T19:27:38.145126] [DEBUG] [LOCAL ] JBTM: Primary data saved (33593 records). [2025-10-22T19:27:38.145280] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-22T19:27:38.145367] [INFO ] [MAIN ] Update Progress: 1147/2367 symbols completed. JBTM took 38.6s. Estimated remaining: 2h 36m 57s. Rate: 7.8 symbols/min [2025-10-22T19:27:38.316953] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:38.347297] [DEBUG] [LOCAL ] JFR: Loaded 31046 existing records from primary storage. [2025-10-22T19:27:38.347552] [INFO ] [MAIN ] JFR: Loaded 31046 existing records. [2025-10-22T19:27:38.519907] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-22T19:27:38.555627] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:38.556160] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-22T19:27:38.556270] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-22T19:27:38.556638] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-22T19:27:38.556739] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-22T19:27:38.927744] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T19:27:39.021081] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:39.317632] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-22T19:27:39.509695] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T19:27:39.814402] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T19:27:40.117726] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-22T19:27:40.846073] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T19:27:40.917612] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-22T19:27:41.729973] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-22T19:27:41.750511] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:27:42.402032] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T19:27:42.517689] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-22T19:27:43.113958] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T19:27:43.317672] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-22T19:27:44.117778] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-22T19:27:44.218432] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T19:27:44.922751] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-22T19:27:44.939007] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:27:45.520827] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T19:27:45.717696] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-22T19:27:46.517631] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-22T19:27:46.812843] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T19:27:46.891410] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T19:27:47.290617] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T19:27:47.317611] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-22T19:27:48.117674] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-22T19:27:48.917754] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-22T19:27:48.974113] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T19:27:49.717778] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-22T19:27:49.861161] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T19:27:50.433132] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T19:27:50.517703] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-22T19:27:51.262142] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T19:27:51.317673] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-22T19:27:52.069123] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T19:27:52.076373] [INFO ] [REMOTE ] JELD: Full fetch complete (64607 records). [2025-10-22T19:27:52.076479] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-22T19:27:52.122817] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-22T19:27:52.455606] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-22T19:27:52.455708] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-22T19:27:52.456533] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-22T19:27:52.456575] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-22T19:27:52.457869] [DEBUG] [LOCAL ] JELD: Trimmed 64607 records to 45878 (keeping 200 days of data) [2025-10-22T19:27:52.707045] [DEBUG] [LOCAL ] JELD: Primary data saved (45878 records). [2025-10-22T19:27:52.707158] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-22T19:27:52.707235] [INFO ] [MAIN ] Update Progress: 1148/2367 symbols completed. JELD took 24.0s. Estimated remaining: 2h 36m 57s. Rate: 7.8 symbols/min [2025-10-22T19:27:52.881700] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:52.905084] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T19:27:52.916904] [INFO ] [REMOTE ] JEF: Full fetch complete (73348 records). [2025-10-22T19:27:52.917064] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-22T19:27:52.917619] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-22T19:27:52.958473] [DEBUG] [LOCAL ] JGH: Loaded 12652 existing records from primary storage. [2025-10-22T19:27:52.959421] [INFO ] [MAIN ] JGH: Loaded 12652 existing records. [2025-10-22T19:27:53.353591] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:53.385954] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-22T19:27:53.391172] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-22T19:27:53.411537] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-22T19:27:53.411694] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-22T19:27:53.676694] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-22T19:27:53.676884] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-22T19:27:53.683009] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-22T19:27:53.688214] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-22T19:27:53.772235] [DEBUG] [LOCAL ] JEF: Trimmed 73348 records to 50191 (keeping 200 days of data) [2025-10-22T19:27:54.062327] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:54.064603] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-22T19:27:54.108244] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:27:54.228945] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T19:27:54.324600] [DEBUG] [LOCAL ] JEF: Primary data saved (50191 records). [2025-10-22T19:27:54.324763] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-22T19:27:54.325730] [INFO ] [MAIN ] Update Progress: 1149/2367 symbols completed. JEF took 35.5s. Estimated remaining: 2h 36m 42s. Rate: 7.8 symbols/min [2025-10-22T19:27:54.494354] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:54.518704] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-22T19:27:54.537771] [DEBUG] [LOCAL ] JHG: Loaded 47511 existing records from primary storage. [2025-10-22T19:27:54.538058] [INFO ] [MAIN ] JHG: Loaded 47511 existing records. [2025-10-22T19:27:54.716278] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:54.716533] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-22T19:27:54.716590] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-22T19:27:54.716791] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-22T19:27:54.716847] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-22T19:27:54.823590] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T19:27:55.078099] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:55.317703] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-22T19:27:56.117710] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-22T19:27:56.431592] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T19:27:56.841582] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T19:27:56.918380] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-22T19:27:56.920792] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T19:27:57.717726] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-22T19:27:58.517668] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-22T19:27:58.789465] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T19:27:58.987319] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T19:27:59.317776] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-22T19:28:00.119565] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-22T19:28:00.122554] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T19:28:00.156530] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T19:28:00.917705] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-22T19:28:01.717775] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-22T19:28:02.517799] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-22T19:28:03.290372] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T19:28:03.317613] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-22T19:28:03.375314] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (3.26 seconds). [2025-10-22T19:28:03.384110] [INFO ] [REMOTE ] JCI: Full fetch complete (77655 records). [2025-10-22T19:28:03.384225] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-22T19:28:03.529416] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T19:28:03.566695] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-22T19:28:03.821255] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-22T19:28:03.821341] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-22T19:28:03.822351] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-22T19:28:03.822438] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-22T19:28:03.823895] [DEBUG] [LOCAL ] JCI: Trimmed 77655 records to 53518 (keeping 200 days of data) [2025-10-22T19:28:04.127561] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-22T19:28:04.152217] [DEBUG] [LOCAL ] JCI: Primary data saved (53518 records). [2025-10-22T19:28:04.152737] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-22T19:28:04.152869] [INFO ] [MAIN ] Update Progress: 1150/2367 symbols completed. JCI took 45.6s. Estimated remaining: 2h 36m 37s. Rate: 7.8 symbols/min [2025-10-22T19:28:04.318529] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:04.324043] [DEBUG] [LOCAL ] JHI: Loaded 4184 existing records from primary storage. [2025-10-22T19:28:04.324212] [INFO ] [MAIN ] JHI: Loaded 4184 existing records. [2025-10-22T19:28:04.496940] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:04.497145] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-22T19:28:04.497191] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-22T19:28:04.497331] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-22T19:28:04.497368] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-22T19:28:04.849315] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:04.917614] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-22T19:28:05.080846] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T19:28:05.328366] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T19:28:05.355186] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-22T19:28:05.717690] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-22T19:28:06.517694] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-22T19:28:07.317629] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-22T19:28:07.398974] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T19:28:07.442766] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T19:28:07.760080] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T19:28:08.117709] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-22T19:28:08.698795] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-22T19:28:08.917686] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-22T19:28:09.717676] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-22T19:28:10.486497] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T19:28:10.486254] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:28:10.517614] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-22T19:28:11.317634] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-22T19:28:11.380952] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T19:28:11.971976] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-22T19:28:12.117632] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-22T19:28:12.917686] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-22T19:28:13.718020] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-22T19:28:13.776981] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T19:28:14.209387] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-22T19:28:14.212969] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T19:28:14.517674] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-22T19:28:15.080623] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T19:28:15.317689] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-22T19:28:16.117709] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-22T19:28:16.730447] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T19:28:16.736663] [INFO ] [REMOTE ] JFR: Full fetch complete (48499 records). [2025-10-22T19:28:16.736779] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-22T19:28:16.923796] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-22T19:28:17.064050] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T19:28:17.129580] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-22T19:28:17.129682] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-22T19:28:17.130413] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-22T19:28:17.130464] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-22T19:28:17.131469] [DEBUG] [LOCAL ] JFR: Trimmed 48499 records to 30994 (keeping 200 days of data) [2025-10-22T19:28:17.313712] [DEBUG] [LOCAL ] JFR: Primary data saved (30994 records). [2025-10-22T19:28:17.313855] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-22T19:28:17.313944] [INFO ] [MAIN ] Update Progress: 1151/2367 symbols completed. JFR took 39.2s. Estimated remaining: 2h 36m 35s. Rate: 7.8 symbols/min [2025-10-22T19:28:17.487612] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T19:28:17.490822] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:17.496316] [DEBUG] [LOCAL ] JHS: Loaded 2986 existing records from primary storage. [2025-10-22T19:28:17.496455] [INFO ] [MAIN ] JHS: Loaded 2986 existing records. [2025-10-22T19:28:17.676733] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:17.676944] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-22T19:28:17.676996] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-22T19:28:17.677136] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-22T19:28:17.677175] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-22T19:28:17.722734] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-22T19:28:18.031174] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:18.166621] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T19:28:18.517759] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-22T19:28:19.097879] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-22T19:28:19.317687] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-22T19:28:20.117681] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-22T19:28:20.730381] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T19:28:20.917626] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-22T19:28:20.996470] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:28:21.564051] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-22T19:28:21.717722] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-22T19:28:21.824409] [DEBUG] [REMOTE ] JHG: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-22T19:28:21.824632] [WARN ] [REMOTE ] JHG: No data returned for month 2025-09 [2025-10-22T19:28:21.824781] [FATAL] [REMOTE ] JHG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:28:21.824871] [FATAL] [MAIN ] JHG: Failed to fetch primary data. [2025-10-22T19:28:21.824932] [WARN ] [MAIN ] JHG: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:28:21.824999] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-22T19:28:21.825056] [DEBUG] [LOCAL ] JHG: No primary data file found to delete. [2025-10-22T19:28:21.825091] [INFO ] [LOCAL ] JHG: Starting deletion of derivative data. [2025-10-22T19:28:21.825238] [DEBUG] [LOCAL ] JHG: Deleted derivative data file. [2025-10-22T19:28:21.825316] [INFO ] [MAIN ] Update Progress: 1152/2367 symbols completed. JHG took 27.5s. Estimated remaining: 2h 36m 24s. Rate: 7.8 symbols/min [2025-10-22T19:28:21.993523] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:22.044175] [DEBUG] [LOCAL ] JHX: Loaded 53200 existing records from primary storage. [2025-10-22T19:28:22.044585] [INFO ] [MAIN ] JHX: Loaded 53200 existing records. [2025-10-22T19:28:22.216507] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:22.216713] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-22T19:28:22.216767] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-22T19:28:22.216959] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-22T19:28:22.217014] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-22T19:28:22.523066] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-22T19:28:22.561843] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:23.317760] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-22T19:28:23.339197] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T19:28:23.341401] [INFO ] [REMOTE ] JHI: Full fetch complete (5813 records). [2025-10-22T19:28:23.341493] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-22T19:28:23.813392] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-22T19:28:23.903869] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-22T19:28:23.903987] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-22T19:28:23.904351] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-22T19:28:23.904420] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-22T19:28:23.905210] [DEBUG] [LOCAL ] JHI: Trimmed 5813 records to 4142 (keeping 200 days of data) [2025-10-22T19:28:23.937086] [DEBUG] [LOCAL ] JHI: Primary data saved (4142 records). [2025-10-22T19:28:23.937247] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-22T19:28:23.937334] [INFO ] [MAIN ] Update Progress: 1153/2367 symbols completed. JHI took 19.8s. Estimated remaining: 2h 36m 10s. Rate: 7.8 symbols/min [2025-10-22T19:28:24.125326] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-22T19:28:24.162698] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:24.180940] [DEBUG] [LOCAL ] JILL: Loaded 15442 existing records from primary storage. [2025-10-22T19:28:24.181233] [INFO ] [MAIN ] JILL: Loaded 15442 existing records. [2025-10-22T19:28:24.396967] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:24.397227] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-22T19:28:24.397313] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-22T19:28:24.397535] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-22T19:28:24.397593] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-22T19:28:24.774779] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:24.917695] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-22T19:28:25.017165] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:28:25.717683] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-22T19:28:25.897473] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T19:28:26.493830] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T19:28:26.517613] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-22T19:28:26.992604] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T19:28:27.317619] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-22T19:28:27.777800] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T19:28:28.117674] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-22T19:28:28.758319] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T19:28:28.917710] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-22T19:28:29.476496] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T19:28:29.717759] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-22T19:28:30.208417] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T19:28:30.517714] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-22T19:28:31.148818] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T19:28:31.317688] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-22T19:28:32.083853] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T19:28:32.117755] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-22T19:28:32.917678] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-22T19:28:33.235487] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T19:28:33.240120] [INFO ] [REMOTE ] JGH: Full fetch complete (16431 records). [2025-10-22T19:28:33.240222] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-22T19:28:33.614339] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-22T19:28:33.614425] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-22T19:28:33.614870] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-22T19:28:33.614944] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-22T19:28:33.615522] [DEBUG] [LOCAL ] JGH: Trimmed 16431 records to 12537 (keeping 200 days of data) [2025-10-22T19:28:33.693535] [DEBUG] [LOCAL ] JGH: Primary data saved (12537 records). [2025-10-22T19:28:33.693709] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-22T19:28:33.693801] [INFO ] [MAIN ] Update Progress: 1154/2367 symbols completed. JGH took 41.0s. Estimated remaining: 2h 36m 5s. Rate: 7.8 symbols/min [2025-10-22T19:28:33.725220] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-22T19:28:33.823731] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T19:28:33.884241] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:33.919774] [DEBUG] [LOCAL ] JKS: Loaded 39289 existing records from primary storage. [2025-10-22T19:28:33.920094] [INFO ] [MAIN ] JKS: Loaded 39289 existing records. [2025-10-22T19:28:34.092532] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:34.092782] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-22T19:28:34.092830] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-22T19:28:34.093007] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-22T19:28:34.093045] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-22T19:28:34.453790] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:34.517613] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-22T19:28:34.840287] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T19:28:35.317683] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-22T19:28:35.679438] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T19:28:36.117685] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-22T19:28:36.297056] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T19:28:36.729449] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-22T19:28:36.730510] [INFO ] [REMOTE ] JHS: Full fetch complete (4557 records). [2025-10-22T19:28:36.730581] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-22T19:28:36.922797] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-22T19:28:37.085555] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-22T19:28:37.085627] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-22T19:28:37.085794] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-22T19:28:37.085843] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-22T19:28:37.086225] [DEBUG] [LOCAL ] JHS: Trimmed 4557 records to 2984 (keeping 200 days of data) [2025-10-22T19:28:37.103676] [DEBUG] [LOCAL ] JHS: Primary data saved (2984 records). [2025-10-22T19:28:37.103739] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-22T19:28:37.103805] [INFO ] [MAIN ] Update Progress: 1155/2367 symbols completed. JHS took 19.8s. Estimated remaining: 2h 35m 52s. Rate: 7.8 symbols/min [2025-10-22T19:28:37.267335] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:37.295449] [DEBUG] [LOCAL ] JLL: Loaded 31598 existing records from primary storage. [2025-10-22T19:28:37.295731] [INFO ] [MAIN ] JLL: Loaded 31598 existing records. [2025-10-22T19:28:37.466258] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:37.466440] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-22T19:28:37.466487] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-22T19:28:37.466849] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-22T19:28:37.466905] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-22T19:28:37.724280] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-22T19:28:37.812952] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:38.219525] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T19:28:38.517688] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-22T19:28:38.724035] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T19:28:39.317698] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-22T19:28:40.081322] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:28:40.117609] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-22T19:28:40.355042] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T19:28:40.917722] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-22T19:28:41.717671] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-22T19:28:41.753388] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T19:28:41.808037] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T19:28:42.517797] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-22T19:28:43.030827] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T19:28:43.317719] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-22T19:28:43.821255] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T19:28:44.117701] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-22T19:28:44.917700] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-22T19:28:45.069520] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T19:28:45.543421] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T19:28:45.717770] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-22T19:28:45.827454] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T19:28:46.517723] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-22T19:28:47.317716] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-22T19:28:47.454257] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T19:28:47.491303] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T19:28:48.117713] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-22T19:28:48.696689] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T19:28:48.917706] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-22T19:28:49.683210] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:28:49.717618] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-22T19:28:49.859970] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T19:28:50.517681] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-22T19:28:51.317676] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-22T19:28:51.550365] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T19:28:51.562183] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T19:28:51.565012] [INFO ] [REMOTE ] JILL: Full fetch complete (22358 records). [2025-10-22T19:28:51.565102] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-22T19:28:51.932938] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-22T19:28:51.933028] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-22T19:28:51.933518] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-22T19:28:51.933559] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-22T19:28:51.934349] [DEBUG] [LOCAL ] JILL: Trimmed 22358 records to 15268 (keeping 200 days of data) [2025-10-22T19:28:52.025247] [DEBUG] [LOCAL ] JILL: Primary data saved (15268 records). [2025-10-22T19:28:52.025382] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-22T19:28:52.025461] [INFO ] [MAIN ] Update Progress: 1156/2367 symbols completed. JILL took 28.1s. Estimated remaining: 2h 35m 52s. Rate: 7.8 symbols/min [2025-10-22T19:28:52.123302] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-22T19:28:52.191493] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:52.197915] [DEBUG] [LOCAL ] JLS: Loaded 4074 existing records from primary storage. [2025-10-22T19:28:52.198125] [INFO ] [MAIN ] JLS: Loaded 4074 existing records. [2025-10-22T19:28:52.374242] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:52.374449] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-22T19:28:52.374516] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-22T19:28:52.374733] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-22T19:28:52.374790] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-22T19:28:52.729635] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:52.809408] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:28:52.917624] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-22T19:28:53.717634] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-22T19:28:53.999561] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T19:28:54.374273] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-22T19:28:54.426254] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T19:28:54.517665] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-22T19:28:55.317675] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-22T19:28:55.945009] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T19:28:56.023028] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:28:56.117621] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-22T19:28:56.917684] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-22T19:28:57.619203] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-22T19:28:57.626357] [INFO ] [REMOTE ] JKS: Full fetch complete (58772 records). [2025-10-22T19:28:57.626468] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-22T19:28:57.723895] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-22T19:28:58.017832] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-22T19:28:58.017918] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-22T19:28:58.018719] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-22T19:28:58.018781] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-22T19:28:58.019943] [DEBUG] [LOCAL ] JKS: Trimmed 58772 records to 39215 (keeping 200 days of data) [2025-10-22T19:28:58.250010] [DEBUG] [LOCAL ] JKS: Primary data saved (39215 records). [2025-10-22T19:28:58.250158] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-22T19:28:58.250235] [INFO ] [MAIN ] Update Progress: 1157/2367 symbols completed. JKS took 24.6s. Estimated remaining: 2h 35m 43s. Rate: 7.8 symbols/min [2025-10-22T19:28:58.517632] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-22T19:28:58.921676] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T19:28:59.063205] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:28:59.118125] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T19:28:59.317690] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-22T19:29:00.117682] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-22T19:29:00.814388] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T19:29:00.814230] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T19:29:00.917716] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-22T19:29:01.644917] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:29:01.717620] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-22T19:29:02.517760] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-22T19:29:03.068446] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T19:29:03.128079] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T19:29:03.317631] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-22T19:29:03.977968] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-22T19:29:04.117709] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-22T19:29:04.917713] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-22T19:29:05.483732] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T19:29:05.717721] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-22T19:29:05.849307] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T19:29:05.857965] [INFO ] [REMOTE ] JHX: Full fetch complete (62610 records). [2025-10-22T19:29:05.858068] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-22T19:29:06.263792] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-22T19:29:06.263868] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-22T19:29:06.264704] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-22T19:29:06.264766] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-22T19:29:06.265947] [DEBUG] [LOCAL ] JHX: Trimmed 62610 records to 53199 (keeping 200 days of data) [2025-10-22T19:29:06.326199] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T19:29:06.534558] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-22T19:29:06.582278] [DEBUG] [LOCAL ] JHX: Primary data saved (53199 records). [2025-10-22T19:29:06.582412] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-22T19:29:06.582531] [INFO ] [MAIN ] Update Progress: 1158/2367 symbols completed. JHX took 44.8s. Estimated remaining: 2h 35m 36s. Rate: 7.8 symbols/min [2025-10-22T19:29:07.317760] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-22T19:29:07.961372] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T19:29:07.962608] [INFO ] [REMOTE ] JLS: Full fetch complete (5832 records). [2025-10-22T19:29:07.962711] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-22T19:29:08.163025] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:29:08.222276] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-22T19:29:08.415475] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-22T19:29:08.415551] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-22T19:29:08.415747] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-22T19:29:08.415807] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-22T19:29:08.416173] [DEBUG] [LOCAL ] JLS: Trimmed 5832 records to 4013 (keeping 200 days of data) [2025-10-22T19:29:08.440408] [DEBUG] [LOCAL ] JLS: Primary data saved (4013 records). [2025-10-22T19:29:08.440534] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-22T19:29:08.440613] [INFO ] [MAIN ] Update Progress: 1159/2367 symbols completed. JLS took 16.4s. Estimated remaining: 2h 35m 22s. Rate: 7.8 symbols/min [2025-10-22T19:29:09.669488] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T19:29:09.676606] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-22T19:29:11.375574] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:29:11.383286] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-22T19:29:12.780758] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T19:29:12.787589] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-22T19:29:14.076514] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T19:29:14.081067] [INFO ] [REMOTE ] JLL: Full fetch complete (45113 records). [2025-10-22T19:29:14.081152] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-22T19:29:14.449768] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-22T19:29:14.449847] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-22T19:29:14.450553] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-22T19:29:14.450594] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-22T19:29:14.451510] [DEBUG] [LOCAL ] JLL: Trimmed 45113 records to 31450 (keeping 200 days of data) [2025-10-22T19:29:14.632592] [DEBUG] [LOCAL ] JLL: Primary data saved (31450 records). [2025-10-22T19:29:14.632774] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-22T19:29:14.632865] [INFO ] [MAIN ] Update Progress: 1160/2367 symbols completed. JLL took 37.5s. Estimated remaining: 2h 35m 13s. Rate: 7.8 symbols/min [2025-10-22T19:29:15.240922] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:15.239795] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:15.385188] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:15.385557] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-22T19:29:15.382373] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:15.385702] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-22T19:29:15.386238] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-22T19:29:15.386297] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-22T19:29:15.386342] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-22T19:29:15.386406] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-22T19:29:15.704131] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-22T19:29:15.744673] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-22T19:29:15.745791] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-22T19:29:15.791580] [INFO ] [MAIN ] JOBY: Loaded 53809 existing records. [2025-10-22T19:29:15.875792] [DEBUG] [LOCAL ] JMIA: Loaded 51203 existing records from primary storage. [2025-10-22T19:29:15.976299] [INFO ] [MAIN ] JMIA: Loaded 51203 existing records. [2025-10-22T19:29:16.088082] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:16.137764] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-22T19:29:16.376129] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:16.363104] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:16.389056] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-22T19:29:16.389179] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-22T19:29:16.389615] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-22T19:29:16.389669] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-22T19:29:16.410556] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-22T19:29:16.456797] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-22T19:29:16.469986] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-22T19:29:16.469689] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:16.470282] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-22T19:29:16.469882] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-22T19:29:16.470389] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-22T19:29:16.487364] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-22T19:29:16.493928] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-22T19:29:16.707197] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T19:29:16.774044] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-22T19:29:17.351771] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T19:29:17.362481] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-22T19:29:17.548592] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:17.596699] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:17.600573] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:17.601096] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-22T19:29:17.601502] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-22T19:29:17.601948] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-22T19:29:17.764418] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T19:29:17.765368] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-22T19:29:18.196463] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-22T19:29:18.197584] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-22T19:29:18.697848] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-22T19:29:18.699128] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-22T19:29:19.139292] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T19:29:19.141045] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-22T19:29:19.352094] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:29:19.364124] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-22T19:29:19.440756] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:29:19.620952] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T19:29:20.022993] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-22T19:29:20.117615] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-22T19:29:20.917698] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-22T19:29:21.170667] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T19:29:21.321853] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-22T19:29:21.717678] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-22T19:29:22.501359] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-22T19:29:22.517600] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-22T19:29:23.317624] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-22T19:29:23.445964] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:29:23.758804] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T19:29:24.117690] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-22T19:29:24.576241] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T19:29:24.917699] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-22T19:29:25.436321] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T19:29:25.717640] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-22T19:29:26.517674] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-22T19:29:27.317612] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-22T19:29:27.803852] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-22T19:29:27.844906] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-10-22T19:29:27.917578] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T19:29:27.918325] [INFO ] [REMOTE ] JMM: Full fetch complete (2288 records). [2025-10-22T19:29:27.918391] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-22T19:29:28.090405] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-22T19:29:28.090620] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:29:28.090718] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:29:28.090790] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-22T19:29:28.090852] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-22T19:29:28.090888] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-22T19:29:28.090926] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-22T19:29:28.090979] [INFO ] [MAIN ] Update Progress: 1161/2367 symbols completed. JMM took 13.5s. Estimated remaining: 2h 35m 11s. Rate: 7.8 symbols/min [2025-10-22T19:29:28.122747] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-22T19:29:28.262276] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:28.284830] [DEBUG] [LOCAL ] JOE: Loaded 23783 existing records from primary storage. [2025-10-22T19:29:28.285105] [INFO ] [MAIN ] JOE: Loaded 23783 existing records. [2025-10-22T19:29:28.457685] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:28.457919] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-22T19:29:28.457965] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-22T19:29:28.458139] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-22T19:29:28.458177] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-22T19:29:28.804866] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:28.917818] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-22T19:29:29.107674] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-22T19:29:29.717774] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-22T19:29:30.517757] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-22T19:29:30.828443] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T19:29:31.157343] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-10-22T19:29:31.317782] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-22T19:29:31.647015] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T19:29:31.911864] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T19:29:32.117704] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-22T19:29:32.917719] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-22T19:29:33.717622] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-22T19:29:33.820032] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-22T19:29:34.327809] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-22T19:29:34.517632] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-22T19:29:34.613200] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T19:29:34.863348] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T19:29:35.317710] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-22T19:29:36.117718] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-22T19:29:36.917637] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-22T19:29:37.253634] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-22T19:29:37.326426] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T19:29:37.717665] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-22T19:29:37.975413] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T19:29:38.072193] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T19:29:38.517728] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-22T19:29:39.317696] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-22T19:29:40.117716] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-22T19:29:40.420568] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T19:29:40.461368] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-22T19:29:40.638412] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T19:29:40.917685] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-22T19:29:41.717723] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-22T19:29:42.201782] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T19:29:42.517679] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-22T19:29:42.908002] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T19:29:43.317672] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-22T19:29:44.117756] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-22T19:29:44.430716] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-22T19:29:44.732612] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T19:29:44.917612] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-22T19:29:45.244053] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T19:29:45.409074] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-22T19:29:45.417982] [INFO ] [REMOTE ] JMIA: Full fetch complete (73496 records). [2025-10-22T19:29:45.418134] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-22T19:29:45.722710] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-22T19:29:45.812440] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-22T19:29:45.812517] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-22T19:29:45.813442] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-22T19:29:45.813505] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-22T19:29:45.814870] [DEBUG] [LOCAL ] JMIA: Trimmed 73496 records to 51205 (keeping 200 days of data) [2025-10-22T19:29:46.103491] [DEBUG] [LOCAL ] JMIA: Primary data saved (51205 records). [2025-10-22T19:29:46.103679] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-22T19:29:46.103777] [INFO ] [MAIN ] Update Progress: 1162/2367 symbols completed. JMIA took 31.5s. Estimated remaining: 2h 35m 14s. Rate: 7.8 symbols/min [2025-10-22T19:29:46.269773] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:46.278238] [DEBUG] [LOCAL ] JOF: Loaded 6932 existing records from primary storage. [2025-10-22T19:29:46.278451] [INFO ] [MAIN ] JOF: Loaded 6932 existing records. [2025-10-22T19:29:46.451866] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:46.452066] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-22T19:29:46.452111] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-22T19:29:46.452247] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-22T19:29:46.452283] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-22T19:29:46.525033] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-22T19:29:46.805777] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:47.317724] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-22T19:29:47.662801] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:29:47.900593] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T19:29:47.919976] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T19:29:47.990485] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (3.07 seconds). [2025-10-22T19:29:47.999121] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-22T19:29:47.999252] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-22T19:29:48.122809] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-22T19:29:48.396539] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-22T19:29:48.396614] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-22T19:29:48.397550] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-22T19:29:48.397607] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-22T19:29:48.398999] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53809 (keeping 200 days of data) [2025-10-22T19:29:48.709873] [DEBUG] [LOCAL ] JOBY: Primary data saved (53809 records). [2025-10-22T19:29:48.710006] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-22T19:29:48.710108] [INFO ] [MAIN ] Update Progress: 1163/2367 symbols completed. JOBY took 34.1s. Estimated remaining: 2h 35m 1s. Rate: 7.8 symbols/min [2025-10-22T19:29:48.799788] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T19:29:48.898247] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:48.917634] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-22T19:29:48.929867] [DEBUG] [LOCAL ] JPC: Loaded 37060 existing records from primary storage. [2025-10-22T19:29:48.930105] [INFO ] [MAIN ] JPC: Loaded 37060 existing records. [2025-10-22T19:29:49.103252] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:49.103482] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-22T19:29:49.103538] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-22T19:29:49.103829] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-22T19:29:49.103884] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-22T19:29:49.444994] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:49.717691] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-22T19:29:49.825136] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T19:29:50.517686] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-22T19:29:50.534140] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T19:29:51.317690] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-22T19:29:52.011477] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T19:29:52.077521] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T19:29:52.117616] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-22T19:29:52.917764] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-22T19:29:53.238982] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T19:29:53.717755] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-22T19:29:54.517778] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-22T19:29:54.704533] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T19:29:54.708505] [INFO ] [REMOTE ] JOE: Full fetch complete (35577 records). [2025-10-22T19:29:54.708626] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-22T19:29:55.048228] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-22T19:29:55.113741] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-22T19:29:55.113959] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-22T19:29:55.114723] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-22T19:29:55.114785] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-22T19:29:55.115540] [DEBUG] [LOCAL ] JOE: Trimmed 35577 records to 23683 (keeping 200 days of data) [2025-10-22T19:29:55.226420] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-22T19:29:55.248718] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-22T19:29:55.250231] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-22T19:29:55.320589] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-22T19:29:55.568528] [DEBUG] [LOCAL ] JOE: Primary data saved (23683 records). [2025-10-22T19:29:55.589051] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-22T19:29:55.589205] [INFO ] [MAIN ] Update Progress: 1164/2367 symbols completed. JOE took 27.5s. Estimated remaining: 2h 34m 52s. Rate: 7.8 symbols/min [2025-10-22T19:29:55.835367] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-22T19:29:55.842668] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-22T19:29:55.858599] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-22T19:29:55.858707] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-22T19:29:55.861687] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:55.863267] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-22T19:29:56.021442] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-22T19:29:56.021865] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-22T19:29:56.128317] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-22T19:29:56.184488] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T19:29:56.324834] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:56.326853] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-22T19:29:56.330260] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-22T19:29:56.336238] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-22T19:29:56.336826] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-22T19:29:56.728104] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-22T19:29:56.738468] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-22T19:29:56.744581] [INFO ] [MAIN ] Update Progress: 1165/2367 symbols completed. JNJ took 42.1s. Estimated remaining: 2h 34m 38s. Rate: 7.8 symbols/min [2025-10-22T19:29:56.896670] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:56.922805] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-22T19:29:56.965798] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:56.996227] [DEBUG] [LOCAL ] JQC: Loaded 33940 existing records from primary storage. [2025-10-22T19:29:56.996507] [INFO ] [MAIN ] JQC: Loaded 33940 existing records. [2025-10-22T19:29:57.169082] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:57.169276] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-22T19:29:57.169323] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-22T19:29:57.169572] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-22T19:29:57.169609] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-22T19:29:57.546086] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:57.587298] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T19:29:57.641848] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T19:29:57.717671] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-22T19:29:58.517758] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-22T19:29:59.036591] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T19:29:59.228741] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T19:29:59.317608] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-22T19:30:00.089973] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T19:30:00.117619] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-22T19:30:00.905312] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T19:30:00.917608] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-22T19:30:01.717890] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-22T19:30:01.800054] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T19:30:01.802679] [INFO ] [REMOTE ] JOF: Full fetch complete (9510 records). [2025-10-22T19:30:01.802831] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-22T19:30:02.191573] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-22T19:30:02.191687] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-22T19:30:02.191983] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-22T19:30:02.192025] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-22T19:30:02.192462] [DEBUG] [LOCAL ] JOF: Trimmed 9510 records to 6920 (keeping 200 days of data) [2025-10-22T19:30:02.235823] [DEBUG] [LOCAL ] JOF: Primary data saved (6920 records). [2025-10-22T19:30:02.235962] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-22T19:30:02.236040] [INFO ] [MAIN ] Update Progress: 1166/2367 symbols completed. JOF took 16.1s. Estimated remaining: 2h 34m 28s. Rate: 7.8 symbols/min [2025-10-22T19:30:02.407100] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:02.423939] [DEBUG] [LOCAL ] JRI: Loaded 15402 existing records from primary storage. [2025-10-22T19:30:02.424241] [INFO ] [MAIN ] JRI: Loaded 15402 existing records. [2025-10-22T19:30:02.523451] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-22T19:30:02.605922] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:30:02.606170] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-22T19:30:02.606238] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-22T19:30:02.606420] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-22T19:30:02.606467] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-22T19:30:02.970263] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:30:03.310896] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T19:30:03.318992] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-22T19:30:04.117707] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-22T19:30:04.789519] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T19:30:04.906857] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-22T19:30:04.917809] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-22T19:30:05.336889] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T19:30:05.717688] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-22T19:30:06.517712] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-22T19:30:06.799384] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T19:30:07.257574] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-22T19:30:07.317627] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-22T19:30:07.915489] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T19:30:08.117635] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-22T19:30:08.311914] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T19:30:08.917685] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-22T19:30:09.447753] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T19:30:09.717637] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-22T19:30:10.069493] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T19:30:10.517709] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-22T19:30:11.106836] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T19:30:11.317678] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-22T19:30:11.967193] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T19:30:12.117711] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-22T19:30:12.917673] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-22T19:30:13.688462] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-22T19:30:13.717629] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-22T19:30:13.751299] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T19:30:13.886567] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T19:30:14.517687] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-22T19:30:15.195895] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:30:15.211460] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T19:30:15.317617] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-22T19:30:16.117637] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-22T19:30:16.917725] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-22T19:30:17.130120] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:30:17.717679] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-22T19:30:17.878580] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-22T19:30:18.281099] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T19:30:18.517682] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-22T19:30:19.097343] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T19:30:19.317708] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-22T19:30:20.117689] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-22T19:30:20.455408] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T19:30:20.611780] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T19:30:20.917698] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-22T19:30:21.106302] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T19:30:21.717691] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-22T19:30:22.517806] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-22T19:30:22.605702] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T19:30:23.243988] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-22T19:30:23.317771] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-22T19:30:23.972502] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T19:30:24.117699] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-22T19:30:24.315532] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:30:24.917703] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-22T19:30:25.717701] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-22T19:30:26.200345] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T19:30:26.517637] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-22T19:30:26.684449] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-22T19:30:26.767554] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T19:30:26.770716] [INFO ] [REMOTE ] JRI: Full fetch complete (22990 records). [2025-10-22T19:30:26.770789] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-22T19:30:27.139605] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-22T19:30:27.139727] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-22T19:30:27.140300] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-22T19:30:27.140343] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-22T19:30:27.141232] [DEBUG] [LOCAL ] JRI: Trimmed 22990 records to 15306 (keeping 200 days of data) [2025-10-22T19:30:27.231963] [DEBUG] [LOCAL ] JRI: Primary data saved (15306 records). [2025-10-22T19:30:27.232101] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-22T19:30:27.232196] [INFO ] [MAIN ] Update Progress: 1167/2367 symbols completed. JRI took 25.0s. Estimated remaining: 2h 34m 38s. Rate: 7.8 symbols/min [2025-10-22T19:30:27.330846] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-22T19:30:27.402411] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:27.414321] [DEBUG] [LOCAL ] JRS: Loaded 11594 existing records from primary storage. [2025-10-22T19:30:27.414495] [INFO ] [MAIN ] JRS: Loaded 11594 existing records. [2025-10-22T19:30:27.586585] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:30:27.586821] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-22T19:30:27.586868] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-22T19:30:27.587027] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-22T19:30:27.587083] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-22T19:30:27.932540] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:30:28.038692] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T19:30:28.047585] [INFO ] [REMOTE ] JPC: Full fetch complete (55022 records). [2025-10-22T19:30:28.047786] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-22T19:30:28.122781] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-22T19:30:28.431380] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-22T19:30:28.431466] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-22T19:30:28.432382] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-22T19:30:28.432448] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-22T19:30:28.433678] [DEBUG] [LOCAL ] JPC: Trimmed 55022 records to 36948 (keeping 200 days of data) [2025-10-22T19:30:28.647591] [DEBUG] [LOCAL ] JPC: Primary data saved (36948 records). [2025-10-22T19:30:28.647894] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-22T19:30:28.648112] [INFO ] [MAIN ] Update Progress: 1168/2367 symbols completed. JPC took 39.9s. Estimated remaining: 2h 34m 24s. Rate: 7.8 symbols/min [2025-10-22T19:30:28.846717] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:28.844504] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:30:28.892151] [DEBUG] [LOCAL ] JXN: Loaded 44418 existing records from primary storage. [2025-10-22T19:30:28.892453] [INFO ] [MAIN ] JXN: Loaded 44418 existing records. [2025-10-22T19:30:28.922927] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-22T19:30:29.067503] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:30:29.067714] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-22T19:30:29.067789] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-22T19:30:29.067973] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-22T19:30:29.068014] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-22T19:30:29.417869] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:30:29.580990] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-22T19:30:29.717717] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-22T19:30:30.419871] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-22T19:30:30.517720] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-22T19:30:31.307564] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T19:30:31.316028] [INFO ] [REMOTE ] JQC: Full fetch complete (50044 records). [2025-10-22T19:30:31.316194] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-22T19:30:31.328073] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-22T19:30:31.735030] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-22T19:30:31.735127] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-22T19:30:31.735879] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-22T19:30:31.735942] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-22T19:30:31.737020] [DEBUG] [LOCAL ] JQC: Trimmed 50044 records to 33868 (keeping 200 days of data) [2025-10-22T19:30:31.935048] [DEBUG] [LOCAL ] JQC: Primary data saved (33868 records). [2025-10-22T19:30:31.935175] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-22T19:30:31.935251] [INFO ] [MAIN ] Update Progress: 1169/2367 symbols completed. JQC took 35.2s. Estimated remaining: 2h 34m 11s. Rate: 7.8 symbols/min [2025-10-22T19:30:32.104943] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:32.127142] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-22T19:30:32.147376] [DEBUG] [LOCAL ] K: Loaded 50401 existing records from primary storage. [2025-10-22T19:30:32.147704] [INFO ] [MAIN ] K: Loaded 50401 existing records. [2025-10-22T19:30:32.316963] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:30:32.317117] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-22T19:30:32.317163] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-22T19:30:32.317438] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-22T19:30:32.317476] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-22T19:30:32.663481] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:30:32.861977] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-22T19:30:32.917625] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-22T19:30:32.950569] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:30:32.954942] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:30:33.717757] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-22T19:30:34.517723] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-22T19:30:35.235829] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T19:30:35.317682] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-22T19:30:35.596311] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-22T19:30:35.605005] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-22T19:30:35.605129] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-22T19:30:35.997157] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-22T19:30:35.997321] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-22T19:30:35.998359] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-22T19:30:35.998439] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-22T19:30:35.999985] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-22T19:30:36.126913] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-22T19:30:36.141312] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:30:36.365785] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-22T19:30:36.365911] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-22T19:30:36.366094] [INFO ] [MAIN ] Update Progress: 1170/2367 symbols completed. JPM took 40.8s. Estimated remaining: 2h 34m 0s. Rate: 7.8 symbols/min [2025-10-22T19:30:36.532438] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:36.547289] [DEBUG] [LOCAL ] KAI: Loaded 13490 existing records from primary storage. [2025-10-22T19:30:36.547511] [INFO ] [MAIN ] KAI: Loaded 13490 existing records. [2025-10-22T19:30:36.727537] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:30:36.727912] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-22T19:30:36.728004] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-22T19:30:36.728213] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-22T19:30:36.728274] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-22T19:30:36.923508] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T19:30:36.922301] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-22T19:30:37.080877] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T19:30:37.163630] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:30:37.717728] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-22T19:30:38.424893] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-22T19:30:38.517792] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-22T19:30:38.810378] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T19:30:39.305793] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T19:30:39.317638] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-22T19:30:40.117708] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-22T19:30:40.329954] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T19:30:40.917718] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-22T19:30:41.718799] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-22T19:30:41.719849] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T19:30:41.894877] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T19:30:42.517637] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-22T19:30:42.665878] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T19:30:43.295737] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T19:30:43.317630] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-22T19:30:44.117708] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-22T19:30:44.770697] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T19:30:44.917716] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-22T19:30:45.717760] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-22T19:30:45.764630] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:30:46.517668] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-22T19:30:46.547791] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:30:46.728156] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:30:47.317753] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-22T19:30:48.117699] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-22T19:30:48.214961] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:30:48.427022] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T19:30:48.917635] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-22T19:30:48.993089] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T19:30:49.717697] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-22T19:30:50.492714] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T19:30:50.517615] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-22T19:30:50.674263] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T19:30:51.317756] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-22T19:30:52.122776] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-22T19:30:52.137183] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T19:30:52.871402] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T19:30:52.917616] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-22T19:30:53.086185] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T19:30:53.717679] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-22T19:30:54.394047] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T19:30:54.517688] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-22T19:30:55.038407] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T19:30:55.317635] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-22T19:30:56.117623] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-22T19:30:56.227394] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T19:30:56.917669] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-22T19:30:56.996977] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:30:56.995707] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T19:30:57.717668] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-22T19:30:58.360185] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:30:58.367545] [INFO ] [REMOTE ] JXN: Full fetch complete (65506 records). [2025-10-22T19:30:58.367704] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-22T19:30:58.518826] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-22T19:30:58.682572] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T19:30:58.700634] [INFO ] [REMOTE ] JRS: Full fetch complete (16207 records). [2025-10-22T19:30:58.700758] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-22T19:30:58.865341] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-22T19:30:58.865724] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-22T19:30:58.872094] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-22T19:30:58.877290] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-22T19:30:58.940759] [DEBUG] [LOCAL ] JXN: Trimmed 65506 records to 44322 (keeping 200 days of data) [2025-10-22T19:30:59.243716] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-22T19:30:59.245262] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-22T19:30:59.245872] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-22T19:30:59.245950] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-22T19:30:59.252377] [DEBUG] [LOCAL ] JRS: Trimmed 16207 records to 11529 (keeping 200 days of data) [2025-10-22T19:30:59.337870] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-22T19:30:59.418484] [DEBUG] [LOCAL ] JRS: Primary data saved (11529 records). [2025-10-22T19:30:59.422257] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-22T19:30:59.426240] [INFO ] [MAIN ] Update Progress: 1171/2367 symbols completed. JRS took 32.2s. Estimated remaining: 2h 34m 8s. Rate: 7.8 symbols/min [2025-10-22T19:30:59.589574] [DEBUG] [LOCAL ] JXN: Primary data saved (44322 records). [2025-10-22T19:30:59.600126] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-22T19:30:59.610346] [INFO ] [MAIN ] Update Progress: 1172/2367 symbols completed. JXN took 31.0s. Estimated remaining: 2h 33m 53s. Rate: 7.8 symbols/min [2025-10-22T19:30:59.883809] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:59.887131] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:59.918244] [DEBUG] [LOCAL ] KB: Loaded 23189 existing records from primary storage. [2025-10-22T19:30:59.918555] [INFO ] [MAIN ] KB: Loaded 23189 existing records. [2025-10-22T19:31:00.035019] [DEBUG] [LOCAL ] KAR: Loaded 39768 existing records from primary storage. [2025-10-22T19:31:00.050884] [INFO ] [MAIN ] KAR: Loaded 39768 existing records. [2025-10-22T19:31:00.158502] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:00.194706] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-22T19:31:00.210712] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-22T19:31:00.229312] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-22T19:31:00.239909] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-22T19:31:00.377971] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:00.404429] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-22T19:31:00.411246] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-22T19:31:00.423147] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-22T19:31:00.423494] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-22T19:31:00.424686] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:31:00.489153] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-22T19:31:00.869519] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-22T19:31:01.024409] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:01.035342] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-22T19:31:01.127981] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:01.569930] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T19:31:01.717766] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-22T19:31:02.517627] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-22T19:31:02.761247] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T19:31:02.912802] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T19:31:02.921296] [INFO ] [REMOTE ] K: Full fetch complete (72311 records). [2025-10-22T19:31:02.921474] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-22T19:31:03.296315] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T19:31:03.333955] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-22T19:31:03.338199] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-22T19:31:03.339230] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-22T19:31:03.340294] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-22T19:31:03.340485] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-22T19:31:03.341946] [DEBUG] [LOCAL ] K: Trimmed 72311 records to 50378 (keeping 200 days of data) [2025-10-22T19:31:03.644107] [DEBUG] [LOCAL ] K: Primary data saved (50378 records). [2025-10-22T19:31:03.644235] [INFO ] [MAIN ] K: Full history saved. [2025-10-22T19:31:03.644841] [INFO ] [MAIN ] Update Progress: 1173/2367 symbols completed. K took 31.7s. Estimated remaining: 2h 33m 41s. Rate: 7.8 symbols/min [2025-10-22T19:31:03.814121] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:03.836899] [DEBUG] [LOCAL ] KBDC: Loaded 22747 existing records from primary storage. [2025-10-22T19:31:03.837136] [INFO ] [MAIN ] KBDC: Loaded 22747 existing records. [2025-10-22T19:31:04.010661] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:04.010879] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-22T19:31:04.010936] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-22T19:31:04.011096] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-22T19:31:04.011134] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-22T19:31:04.122817] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-22T19:31:04.364264] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:04.478321] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T19:31:04.917759] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-22T19:31:05.332495] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T19:31:05.717688] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-22T19:31:06.332325] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T19:31:06.517701] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-22T19:31:07.153439] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T19:31:07.317628] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-22T19:31:07.715743] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T19:31:08.117675] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-22T19:31:08.323852] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T19:31:08.917695] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-22T19:31:09.597601] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:31:09.717692] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-22T19:31:09.929990] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T19:31:09.933109] [INFO ] [REMOTE ] KAI: Full fetch complete (19274 records). [2025-10-22T19:31:09.933205] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-22T19:31:10.290778] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-22T19:31:10.290875] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-22T19:31:10.291285] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-22T19:31:10.291323] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-22T19:31:10.291871] [DEBUG] [LOCAL ] KAI: Trimmed 19274 records to 13405 (keeping 200 days of data) [2025-10-22T19:31:10.374911] [DEBUG] [LOCAL ] KAI: Primary data saved (13405 records). [2025-10-22T19:31:10.375033] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-22T19:31:10.375110] [INFO ] [MAIN ] Update Progress: 1174/2367 symbols completed. KAI took 34.0s. Estimated remaining: 2h 33m 32s. Rate: 7.8 symbols/min [2025-10-22T19:31:10.522792] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-22T19:31:10.568201] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:10.610234] [DEBUG] [LOCAL ] KBH: Loaded 48751 existing records from primary storage. [2025-10-22T19:31:10.610530] [INFO ] [MAIN ] KBH: Loaded 48751 existing records. [2025-10-22T19:31:10.786559] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:10.786792] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-22T19:31:10.786840] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-22T19:31:10.787022] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-22T19:31:10.787060] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-22T19:31:11.137025] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:11.223489] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T19:31:11.317633] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-22T19:31:11.572377] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T19:31:12.117695] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-22T19:31:12.717318] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T19:31:12.917707] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-22T19:31:13.717694] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-22T19:31:13.867849] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:31:13.962738] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T19:31:14.517671] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-22T19:31:14.698392] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-22T19:31:15.317729] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-22T19:31:15.822445] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T19:31:16.117784] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-22T19:31:16.917764] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-22T19:31:17.118806] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T19:31:17.281550] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T19:31:17.717670] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-22T19:31:17.938221] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T19:31:18.517709] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-22T19:31:19.317719] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-22T19:31:19.379011] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T19:31:19.684955] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T19:31:20.117627] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-22T19:31:20.583529] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T19:31:20.917693] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-22T19:31:21.717633] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-22T19:31:21.932193] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:31:22.013471] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:31:22.517689] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-22T19:31:23.202862] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:31:23.317618] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-22T19:31:23.404817] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:31:24.117683] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-22T19:31:24.753847] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T19:31:24.917667] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-22T19:31:25.162000] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T19:31:25.165280] [INFO ] [REMOTE ] KB: Full fetch complete (33535 records). [2025-10-22T19:31:25.165352] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-22T19:31:25.546122] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-22T19:31:25.546189] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-22T19:31:25.546925] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-22T19:31:25.546993] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-22T19:31:25.548000] [DEBUG] [LOCAL ] KB: Trimmed 33535 records to 23045 (keeping 200 days of data) [2025-10-22T19:31:25.688874] [DEBUG] [LOCAL ] KB: Primary data saved (23045 records). [2025-10-22T19:31:25.689068] [INFO ] [MAIN ] KB: Full history saved. [2025-10-22T19:31:25.689153] [INFO ] [MAIN ] Update Progress: 1175/2367 symbols completed. KB took 26.1s. Estimated remaining: 2h 33m 32s. Rate: 7.8 symbols/min [2025-10-22T19:31:25.722765] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-22T19:31:25.868370] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:25.908782] [DEBUG] [LOCAL ] KBR: Loaded 47999 existing records from primary storage. [2025-10-22T19:31:25.909083] [INFO ] [MAIN ] KBR: Loaded 47999 existing records. [2025-10-22T19:31:26.019621] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T19:31:26.098104] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:26.098312] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-22T19:31:26.098358] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-22T19:31:26.098800] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-22T19:31:26.098856] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-22T19:31:26.443808] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:26.517892] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-22T19:31:26.935412] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T19:31:27.317634] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-22T19:31:27.543209] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T19:31:28.117703] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-22T19:31:28.917690] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-22T19:31:29.729584] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-22T19:31:29.736141] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-22T19:31:29.864331] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T19:31:29.871340] [INFO ] [REMOTE ] KAR: Full fetch complete (56919 records). [2025-10-22T19:31:29.871460] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-22T19:31:30.260211] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-22T19:31:30.260363] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-22T19:31:30.261687] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-22T19:31:30.261956] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-22T19:31:30.263402] [DEBUG] [LOCAL ] KAR: Trimmed 56919 records to 39707 (keeping 200 days of data) [2025-10-22T19:31:30.491470] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:31:30.522842] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-22T19:31:30.532241] [DEBUG] [LOCAL ] KAR: Primary data saved (39707 records). [2025-10-22T19:31:30.532513] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-22T19:31:30.532617] [INFO ] [MAIN ] Update Progress: 1176/2367 symbols completed. KAR took 31.1s. Estimated remaining: 2h 33m 22s. Rate: 7.8 symbols/min [2025-10-22T19:31:30.702041] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:30.749625] [DEBUG] [LOCAL ] KD: Loaded 52344 existing records from primary storage. [2025-10-22T19:31:30.750011] [INFO ] [MAIN ] KD: Loaded 52344 existing records. [2025-10-22T19:31:30.936533] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:30.938879] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-22T19:31:30.938716] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T19:31:30.939052] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-22T19:31:30.944102] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-22T19:31:30.944167] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-22T19:31:31.289463] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:31.317614] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-22T19:31:32.117717] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-22T19:31:32.170818] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T19:31:32.917771] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-22T19:31:33.250677] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T19:31:33.544474] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T19:31:33.717708] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-22T19:31:34.348603] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T19:31:34.517744] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-22T19:31:35.317688] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-22T19:31:35.477005] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T19:31:36.117685] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-22T19:31:36.147515] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T19:31:36.253764] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T19:31:36.917688] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-22T19:31:37.530435] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:31:37.717671] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-22T19:31:38.349571] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T19:31:38.517620] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-22T19:31:39.163294] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:31:39.317767] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-22T19:31:40.117721] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-22T19:31:40.308295] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T19:31:40.709202] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T19:31:40.714681] [INFO ] [REMOTE ] KBDC: Full fetch complete (30922 records). [2025-10-22T19:31:40.714761] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-22T19:31:40.927314] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-22T19:31:41.121810] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-22T19:31:41.121925] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-22T19:31:41.123011] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-22T19:31:41.123078] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-22T19:31:41.124126] [DEBUG] [LOCAL ] KBDC: Trimmed 30922 records to 22661 (keeping 200 days of data) [2025-10-22T19:31:41.279019] [DEBUG] [LOCAL ] KBDC: Primary data saved (22661 records). [2025-10-22T19:31:41.279247] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-22T19:31:41.279377] [INFO ] [MAIN ] Update Progress: 1177/2367 symbols completed. KBDC took 37.6s. Estimated remaining: 2h 33m 17s. Rate: 7.8 symbols/min [2025-10-22T19:31:41.468865] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:41.475865] [DEBUG] [LOCAL ] KEN: Loaded 4665 existing records from primary storage. [2025-10-22T19:31:41.476102] [INFO ] [MAIN ] KEN: Loaded 4665 existing records. [2025-10-22T19:31:41.692338] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:41.692920] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-22T19:31:41.692991] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-22T19:31:41.693326] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-22T19:31:41.693388] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-22T19:31:41.724074] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-22T19:31:42.075679] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:31:42.110252] [INFO ] [REMOTE ] KBH: Full fetch complete (71077 records). [2025-10-22T19:31:42.131849] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-22T19:31:42.238712] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:42.522911] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-22T19:31:42.591560] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-22T19:31:42.592548] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-22T19:31:42.593573] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-22T19:31:42.593769] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-22T19:31:42.595213] [DEBUG] [LOCAL ] KBH: Trimmed 71077 records to 48710 (keeping 200 days of data) [2025-10-22T19:31:42.881210] [DEBUG] [LOCAL ] KBH: Primary data saved (48710 records). [2025-10-22T19:31:42.881407] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-22T19:31:42.881513] [INFO ] [MAIN ] Update Progress: 1178/2367 symbols completed. KBH took 32.5s. Estimated remaining: 2h 33m 3s. Rate: 7.8 symbols/min [2025-10-22T19:31:43.007290] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-22T19:31:43.088737] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:43.118034] [DEBUG] [LOCAL ] KEP: Loaded 32502 existing records from primary storage. [2025-10-22T19:31:43.118332] [INFO ] [MAIN ] KEP: Loaded 32502 existing records. [2025-10-22T19:31:43.221076] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T19:31:43.306144] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:43.306513] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-22T19:31:43.306661] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-22T19:31:43.307073] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-22T19:31:43.307128] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-22T19:31:43.322898] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-22T19:31:43.721712] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:43.736089] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T19:31:44.117670] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-22T19:31:44.917764] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-22T19:31:45.450884] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-22T19:31:45.467974] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T19:31:45.543513] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T19:31:45.717675] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-22T19:31:46.339780] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T19:31:46.517668] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-22T19:31:47.317686] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-22T19:31:47.620365] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T19:31:48.072507] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T19:31:48.117687] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-22T19:31:48.917690] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-22T19:31:49.360178] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T19:31:49.525720] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T19:31:49.717671] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-22T19:31:50.517702] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-22T19:31:50.978520] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T19:31:51.317717] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-22T19:31:52.117727] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-22T19:31:52.512360] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T19:31:52.694889] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T19:31:52.820672] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T19:31:52.917682] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-22T19:31:53.717694] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-22T19:31:54.517707] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-22T19:31:54.595117] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T19:31:55.141722] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T19:31:55.317726] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-22T19:31:56.108536] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T19:31:56.117603] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-22T19:31:56.917687] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-22T19:31:57.203333] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T19:31:57.629983] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T19:31:57.717617] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-22T19:31:58.328959] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:31:58.517684] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-22T19:31:59.137040] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T19:31:59.167171] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T19:31:59.317632] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-22T19:31:59.884828] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T19:32:00.117711] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-22T19:32:00.917706] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-22T19:32:01.717730] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-22T19:32:02.155370] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-22T19:32:02.367297] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:32:02.517690] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-22T19:32:03.317720] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-22T19:32:03.472582] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:32:03.951411] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T19:32:04.027012] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T19:32:04.032761] [INFO ] [REMOTE ] KEP: Full fetch complete (42435 records). [2025-10-22T19:32:04.032861] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-22T19:32:04.122774] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-22T19:32:04.399366] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-22T19:32:04.399441] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-22T19:32:04.400117] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-22T19:32:04.400179] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-22T19:32:04.401036] [DEBUG] [LOCAL ] KEP: Trimmed 42435 records to 32572 (keeping 200 days of data) [2025-10-22T19:32:04.581804] [DEBUG] [LOCAL ] KEP: Primary data saved (32572 records). [2025-10-22T19:32:04.581932] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-22T19:32:04.582009] [INFO ] [MAIN ] Update Progress: 1179/2367 symbols completed. KEP took 21.7s. Estimated remaining: 2h 33m 10s. Rate: 7.8 symbols/min [2025-10-22T19:32:04.752947] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:04.788113] [DEBUG] [LOCAL ] KEX: Loaded 38788 existing records from primary storage. [2025-10-22T19:32:04.788393] [INFO ] [MAIN ] KEX: Loaded 38788 existing records. [2025-10-22T19:32:04.859832] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T19:32:04.884139] [INFO ] [REMOTE ] KEN: Full fetch complete (5877 records). [2025-10-22T19:32:04.892124] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-22T19:32:04.923554] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-22T19:32:05.132812] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:05.160695] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-22T19:32:05.169419] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-22T19:32:05.223699] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-22T19:32:05.238676] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-22T19:32:05.507330] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-22T19:32:05.508595] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-22T19:32:05.523819] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-22T19:32:05.525162] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-22T19:32:05.603437] [DEBUG] [LOCAL ] KEN: Trimmed 5877 records to 4612 (keeping 200 days of data) [2025-10-22T19:32:05.734918] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-22T19:32:05.741267] [DEBUG] [LOCAL ] KEN: Primary data saved (4612 records). [2025-10-22T19:32:05.744953] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-22T19:32:05.745092] [INFO ] [MAIN ] Update Progress: 1180/2367 symbols completed. KEN took 24.5s. Estimated remaining: 2h 32m 55s. Rate: 7.8 symbols/min [2025-10-22T19:32:05.744558] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:05.917678] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:05.917887] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-22T19:32:05.917931] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-22T19:32:05.918049] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-22T19:32:05.918091] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-22T19:32:05.918133] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-22T19:32:05.918167] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-22T19:32:06.277044] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:06.517638] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-22T19:32:06.876818] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T19:32:07.317672] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-22T19:32:07.562774] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T19:32:07.570582] [INFO ] [REMOTE ] KBR: Full fetch complete (69937 records). [2025-10-22T19:32:07.570762] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-22T19:32:07.964250] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-22T19:32:07.964364] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-22T19:32:07.965360] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-22T19:32:07.965442] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-22T19:32:07.966916] [DEBUG] [LOCAL ] KBR: Trimmed 69937 records to 47970 (keeping 200 days of data) [2025-10-22T19:32:08.146893] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-22T19:32:08.273940] [DEBUG] [LOCAL ] KBR: Primary data saved (47970 records). [2025-10-22T19:32:08.274077] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-22T19:32:08.274180] [INFO ] [MAIN ] Update Progress: 1181/2367 symbols completed. KBR took 42.6s. Estimated remaining: 2h 32m 42s. Rate: 7.8 symbols/min [2025-10-22T19:32:08.491570] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:08.532475] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T19:32:08.586378] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T19:32:08.645805] [DEBUG] [LOCAL ] KEYS: Loaded 43207 existing records from primary storage. [2025-10-22T19:32:08.646272] [INFO ] [MAIN ] KEYS: Loaded 43207 existing records. [2025-10-22T19:32:08.926341] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-22T19:32:08.935371] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:08.937182] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-22T19:32:08.937256] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-22T19:32:08.937540] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-22T19:32:08.937610] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-22T19:32:09.445762] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:09.717673] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-22T19:32:10.131135] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T19:32:10.139830] [INFO ] [REMOTE ] KD: Full fetch complete (76108 records). [2025-10-22T19:32:10.139953] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-22T19:32:10.534288] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-22T19:32:10.534722] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-22T19:32:10.534815] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-22T19:32:10.536603] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-22T19:32:10.536798] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-22T19:32:10.538369] [DEBUG] [LOCAL ] KD: Trimmed 76108 records to 52332 (keeping 200 days of data) [2025-10-22T19:32:10.661156] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:32:10.877513] [DEBUG] [LOCAL ] KD: Primary data saved (52332 records). [2025-10-22T19:32:10.877673] [INFO ] [MAIN ] KD: Full history saved. [2025-10-22T19:32:10.877790] [INFO ] [MAIN ] Update Progress: 1182/2367 symbols completed. KD took 40.3s. Estimated remaining: 2h 32m 29s. Rate: 7.8 symbols/min [2025-10-22T19:32:11.046339] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:11.050559] [DEBUG] [LOCAL ] KF: Loaded 2359 existing records from primary storage. [2025-10-22T19:32:11.050762] [INFO ] [MAIN ] KF: Loaded 2359 existing records. [2025-10-22T19:32:11.236171] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:11.248574] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T19:32:11.247968] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-22T19:32:11.255055] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-22T19:32:11.255883] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-22T19:32:11.255942] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-22T19:32:11.322740] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-22T19:32:11.605407] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:12.117691] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-22T19:32:12.156315] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:32:12.615312] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-22T19:32:12.911873] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:32:12.921548] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-22T19:32:13.389292] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-22T19:32:13.717689] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-22T19:32:14.517713] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-22T19:32:15.123750] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T19:32:15.147168] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:32:15.317688] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-22T19:32:16.117692] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-22T19:32:16.873388] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T19:32:16.917709] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-22T19:32:17.317711] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T19:32:17.451265] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-22T19:32:17.717690] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-22T19:32:18.517714] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-22T19:32:19.317701] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-22T19:32:19.581070] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T19:32:19.867985] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T19:32:20.117630] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-22T19:32:20.241638] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T19:32:20.712810] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T19:32:20.917672] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-22T19:32:21.717729] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-22T19:32:22.517680] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-22T19:32:22.648382] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:32:22.813568] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-22T19:32:23.317626] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-22T19:32:23.744293] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T19:32:24.117764] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-22T19:32:24.666488] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T19:32:24.917677] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-22T19:32:25.717627] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-22T19:32:25.909531] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:32:26.154726] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T19:32:26.517655] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-22T19:32:26.586497] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T19:32:27.317721] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-22T19:32:28.117676] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-22T19:32:28.172659] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T19:32:28.924141] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-22T19:32:28.942218] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:32:29.375745] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-22T19:32:29.485916] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T19:32:29.717779] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-22T19:32:30.517706] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-22T19:32:31.317631] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-22T19:32:31.660921] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:32:32.117724] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-22T19:32:32.190588] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:32:32.737151] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T19:32:32.790833] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-22T19:32:32.791811] [INFO ] [REMOTE ] KF: Full fetch complete (3505 records). [2025-10-22T19:32:32.791879] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-22T19:32:32.929319] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-22T19:32:33.145056] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-22T19:32:33.145134] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-22T19:32:33.145250] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-22T19:32:33.145288] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-22T19:32:33.145622] [DEBUG] [LOCAL ] KF: Trimmed 3505 records to 2360 (keeping 200 days of data) [2025-10-22T19:32:33.159540] [DEBUG] [LOCAL ] KF: Primary data saved (2360 records). [2025-10-22T19:32:33.159658] [INFO ] [MAIN ] KF: Full history saved. [2025-10-22T19:32:33.159757] [INFO ] [MAIN ] Update Progress: 1183/2367 symbols completed. KF took 22.3s. Estimated remaining: 2h 32m 36s. Rate: 7.8 symbols/min [2025-10-22T19:32:33.328112] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:33.346562] [DEBUG] [LOCAL ] KFRC: Loaded 20800 existing records from primary storage. [2025-10-22T19:32:33.346819] [INFO ] [MAIN ] KFRC: Loaded 20800 existing records. [2025-10-22T19:32:33.519619] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:33.519859] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-22T19:32:33.519908] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-22T19:32:33.520143] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-22T19:32:33.520180] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-22T19:32:33.723766] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-22T19:32:33.870129] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:34.517676] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-22T19:32:34.607862] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T19:32:35.313378] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T19:32:35.321814] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-22T19:32:35.973471] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T19:32:36.117685] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-22T19:32:36.389713] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T19:32:36.917689] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-22T19:32:37.029369] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T19:32:37.717723] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-22T19:32:38.517637] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-22T19:32:38.600201] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T19:32:38.607828] [INFO ] [REMOTE ] KEYS: Full fetch complete (63118 records). [2025-10-22T19:32:38.607950] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-22T19:32:38.992191] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-22T19:32:38.992265] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-22T19:32:38.993183] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-22T19:32:38.993244] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-22T19:32:38.994413] [DEBUG] [LOCAL ] KEYS: Trimmed 63118 records to 43120 (keeping 200 days of data) [2025-10-22T19:32:39.254935] [DEBUG] [LOCAL ] KEYS: Primary data saved (43120 records). [2025-10-22T19:32:39.255104] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-22T19:32:39.255216] [INFO ] [MAIN ] Update Progress: 1184/2367 symbols completed. KEYS took 31.0s. Estimated remaining: 2h 32m 27s. Rate: 7.8 symbols/min [2025-10-22T19:32:39.322857] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-22T19:32:39.426040] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:39.457984] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T19:32:39.472325] [DEBUG] [LOCAL ] KFS: Loaded 8691 existing records from primary storage. [2025-10-22T19:32:39.472532] [INFO ] [MAIN ] KFS: Loaded 8691 existing records. [2025-10-22T19:32:39.645270] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:39.645453] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-22T19:32:39.645504] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-22T19:32:39.645676] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-22T19:32:39.645732] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-22T19:32:40.002765] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:40.056051] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T19:32:40.117617] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-22T19:32:40.409951] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T19:32:40.917726] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-22T19:32:41.717666] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-22T19:32:41.821709] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:32:41.828718] [INFO ] [REMOTE ] KEX: Full fetch complete (56106 records). [2025-10-22T19:32:41.828809] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-22T19:32:42.206742] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-22T19:32:42.206820] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-22T19:32:42.207577] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-22T19:32:42.207617] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-22T19:32:42.208742] [DEBUG] [LOCAL ] KEX: Trimmed 56106 records to 38734 (keeping 200 days of data) [2025-10-22T19:32:42.416435] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T19:32:42.437599] [DEBUG] [LOCAL ] KEX: Primary data saved (38734 records). [2025-10-22T19:32:42.437712] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-22T19:32:42.437821] [INFO ] [MAIN ] Update Progress: 1185/2367 symbols completed. KEX took 37.9s. Estimated remaining: 2h 32m 15s. Rate: 7.8 symbols/min [2025-10-22T19:32:42.526214] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-22T19:32:42.606085] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:42.633781] [DEBUG] [LOCAL ] KFY: Loaded 29615 existing records from primary storage. [2025-10-22T19:32:42.634032] [INFO ] [MAIN ] KFY: Loaded 29615 existing records. [2025-10-22T19:32:42.805883] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:42.806125] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-22T19:32:42.806202] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-22T19:32:42.806410] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-22T19:32:42.806468] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-22T19:32:43.174933] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:43.197332] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-22T19:32:43.206261] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-22T19:32:43.206390] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-22T19:32:43.321121] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-22T19:32:43.315931] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T19:32:43.407762] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T19:32:43.408639] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:32:43.408739] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:32:43.408830] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-22T19:32:43.408929] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-22T19:32:43.408993] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-22T19:32:43.409040] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-22T19:32:43.409099] [INFO ] [MAIN ] Update Progress: 1186/2367 symbols completed. KEY took 37.7s. Estimated remaining: 2h 32m 0s. Rate: 7.8 symbols/min [2025-10-22T19:32:43.575054] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:43.623878] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-22T19:32:43.624218] [INFO ] [MAIN ] KGC: Loaded 53700 existing records. [2025-10-22T19:32:43.797437] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:43.797671] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-22T19:32:43.797767] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-22T19:32:43.798146] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-22T19:32:43.798204] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-22T19:32:44.123852] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-22T19:32:44.166859] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:44.469947] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T19:32:44.778804] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-22T19:32:44.917628] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-22T19:32:45.717622] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-22T19:32:46.121080] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:32:46.490288] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T19:32:46.517619] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-22T19:32:47.243150] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:32:47.317672] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-22T19:32:48.100020] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T19:32:48.117622] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-22T19:32:48.917722] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-22T19:32:48.972892] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T19:32:49.717781] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-22T19:32:49.989354] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T19:32:50.517682] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-22T19:32:51.317696] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-22T19:32:51.450453] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T19:32:51.656727] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T19:32:52.117701] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-22T19:32:52.486625] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:32:52.917707] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-22T19:32:53.690530] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T19:32:53.717626] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-22T19:32:54.030628] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T19:32:54.517699] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-22T19:32:54.747599] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T19:32:55.317763] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-22T19:32:55.873713] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T19:32:56.117622] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-22T19:32:56.569425] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T19:32:56.917716] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-22T19:32:57.498532] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T19:32:57.717685] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-22T19:32:58.517667] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-22T19:32:58.919148] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T19:32:58.962113] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T19:32:59.268355] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T19:32:59.317638] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-22T19:33:00.117691] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-22T19:33:00.213908] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-22T19:33:00.217146] [INFO ] [REMOTE ] KFS: Full fetch complete (11224 records). [2025-10-22T19:33:00.217285] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-22T19:33:00.590577] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-22T19:33:00.590683] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-22T19:33:00.590982] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-22T19:33:00.591025] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-22T19:33:00.591470] [DEBUG] [LOCAL ] KFS: Trimmed 11224 records to 8701 (keeping 200 days of data) [2025-10-22T19:33:00.641908] [DEBUG] [LOCAL ] KFS: Primary data saved (8701 records). [2025-10-22T19:33:00.642048] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-22T19:33:00.642130] [INFO ] [MAIN ] Update Progress: 1187/2367 symbols completed. KFS took 21.4s. Estimated remaining: 2h 32m 2s. Rate: 7.8 symbols/min [2025-10-22T19:33:00.810082] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:00.848581] [DEBUG] [LOCAL ] KGS: Loaded 46136 existing records from primary storage. [2025-10-22T19:33:00.848921] [INFO ] [MAIN ] KGS: Loaded 46136 existing records. [2025-10-22T19:33:00.922827] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-22T19:33:01.035624] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:01.035876] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-22T19:33:01.035934] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-22T19:33:01.036213] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-22T19:33:01.036268] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-22T19:33:01.406162] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:01.717705] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-22T19:33:01.772845] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T19:33:02.517718] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-22T19:33:03.317723] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-22T19:33:04.075033] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-22T19:33:04.117612] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-22T19:33:04.191454] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (3.27 seconds). [2025-10-22T19:33:04.283713] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T19:33:04.756752] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:33:04.761101] [INFO ] [REMOTE ] KFRC: Full fetch complete (27064 records). [2025-10-22T19:33:04.761182] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-22T19:33:04.930977] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-22T19:33:05.127387] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-22T19:33:05.127462] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-22T19:33:05.128121] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-22T19:33:05.128201] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-22T19:33:05.129345] [DEBUG] [LOCAL ] KFRC: Trimmed 27064 records to 20843 (keeping 200 days of data) [2025-10-22T19:33:05.265263] [DEBUG] [LOCAL ] KFRC: Primary data saved (20843 records). [2025-10-22T19:33:05.265414] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-22T19:33:05.265492] [INFO ] [MAIN ] Update Progress: 1188/2367 symbols completed. KFRC took 32.1s. Estimated remaining: 2h 31m 51s. Rate: 7.8 symbols/min [2025-10-22T19:33:05.432230] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:05.477875] [DEBUG] [LOCAL ] KIM: Loaded 53000 existing records from primary storage. [2025-10-22T19:33:05.478183] [INFO ] [MAIN ] KIM: Loaded 53000 existing records. [2025-10-22T19:33:05.653378] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:05.653612] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-22T19:33:05.653697] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-22T19:33:05.654303] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-22T19:33:05.654342] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-22T19:33:05.726963] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-22T19:33:06.013944] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:06.134488] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-22T19:33:06.284634] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T19:33:06.517682] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-22T19:33:07.317692] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-22T19:33:07.902073] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-22T19:33:08.117713] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-22T19:33:08.315045] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T19:33:08.917692] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-22T19:33:09.045709] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T19:33:09.717689] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-22T19:33:10.038374] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T19:33:10.067453] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T19:33:10.517716] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-22T19:33:11.317628] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-22T19:33:11.369263] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T19:33:12.117725] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-22T19:33:12.162214] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T19:33:12.775161] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T19:33:12.917700] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-22T19:33:13.644776] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:33:13.717701] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-22T19:33:14.517684] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-22T19:33:14.990005] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-22T19:33:15.309613] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T19:33:15.317978] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-22T19:33:16.073867] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:33:16.081015] [INFO ] [REMOTE ] KFY: Full fetch complete (43343 records). [2025-10-22T19:33:16.081199] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-22T19:33:16.122888] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-22T19:33:16.632549] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-22T19:33:16.632724] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-22T19:33:16.634260] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-22T19:33:16.634338] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-22T19:33:16.636082] [DEBUG] [LOCAL ] KFY: Trimmed 43343 records to 29511 (keeping 200 days of data) [2025-10-22T19:33:16.856026] [DEBUG] [LOCAL ] KFY: Primary data saved (29511 records). [2025-10-22T19:33:16.856250] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-22T19:33:16.856411] [INFO ] [MAIN ] Update Progress: 1189/2367 symbols completed. KFY took 34.4s. Estimated remaining: 2h 31m 47s. Rate: 7.8 symbols/min [2025-10-22T19:33:16.922918] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-22T19:33:17.068308] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:17.094397] [DEBUG] [LOCAL ] KIO: Loaded 21750 existing records from primary storage. [2025-10-22T19:33:17.094926] [INFO ] [MAIN ] KIO: Loaded 21750 existing records. [2025-10-22T19:33:17.304239] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:17.304888] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-22T19:33:17.305078] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-22T19:33:17.305408] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-22T19:33:17.305512] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-22T19:33:17.442419] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T19:33:17.720253] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-22T19:33:17.720148] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:17.762870] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T19:33:18.410863] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T19:33:18.517677] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-22T19:33:19.317686] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-22T19:33:19.811234] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T19:33:20.117780] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-22T19:33:20.277904] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T19:33:20.757317] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T19:33:20.917620] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-22T19:33:21.029707] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T19:33:21.717702] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-22T19:33:22.001181] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T19:33:22.517667] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-22T19:33:23.317665] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-22T19:33:23.370615] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:33:23.495458] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T19:33:24.117724] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-22T19:33:24.221522] [DEBUG] [REMOTE ] KIM: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-22T19:33:24.222020] [WARN ] [REMOTE ] KIM: No data returned for month 2025-05 [2025-10-22T19:33:24.222124] [FATAL] [REMOTE ] KIM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:33:24.222258] [FATAL] [MAIN ] KIM: Failed to fetch primary data. [2025-10-22T19:33:24.222339] [WARN ] [MAIN ] KIM: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:33:24.222451] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-22T19:33:24.222545] [DEBUG] [LOCAL ] KIM: No primary data file found to delete. [2025-10-22T19:33:24.222602] [INFO ] [LOCAL ] KIM: Starting deletion of derivative data. [2025-10-22T19:33:24.222978] [DEBUG] [LOCAL ] KIM: Deleted derivative data file. [2025-10-22T19:33:24.223265] [INFO ] [MAIN ] Update Progress: 1190/2367 symbols completed. KIM took 19.0s. Estimated remaining: 2h 31m 39s. Rate: 7.8 symbols/min [2025-10-22T19:33:24.389875] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:24.439186] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-10-22T19:33:24.439488] [INFO ] [MAIN ] KKR: Loaded 53500 existing records. [2025-10-22T19:33:24.611100] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:24.611307] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-22T19:33:24.611353] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-22T19:33:24.611541] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-22T19:33:24.611578] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-22T19:33:24.922780] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-22T19:33:24.961440] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:25.721757] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-22T19:33:25.724592] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-22T19:33:25.734144] [INFO ] [REMOTE ] KGC: Full fetch complete (77874 records). [2025-10-22T19:33:25.734294] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-22T19:33:26.119714] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-22T19:33:26.119813] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-22T19:33:26.120790] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-22T19:33:26.120853] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-22T19:33:26.122293] [DEBUG] [LOCAL ] KGC: Trimmed 77874 records to 53700 (keeping 200 days of data) [2025-10-22T19:33:26.447550] [DEBUG] [LOCAL ] KGC: Primary data saved (53700 records). [2025-10-22T19:33:26.447728] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-22T19:33:26.448746] [INFO ] [MAIN ] Update Progress: 1191/2367 symbols completed. KGC took 43.0s. Estimated remaining: 2h 31m 26s. Rate: 7.8 symbols/min [2025-10-22T19:33:26.520049] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-22T19:33:26.628699] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:26.637417] [DEBUG] [LOCAL ] KKRS: Loaded 5573 existing records from primary storage. [2025-10-22T19:33:26.637636] [INFO ] [MAIN ] KKRS: Loaded 5573 existing records. [2025-10-22T19:33:26.829611] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:26.830228] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-22T19:33:26.830841] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-22T19:33:26.843269] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-22T19:33:26.856179] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-22T19:33:26.868005] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T19:33:26.867089] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T19:33:26.965517] [INFO ] [REMOTE ] KGS: Full fetch complete (66556 records). [2025-10-22T19:33:26.984207] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-22T19:33:27.333147] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-22T19:33:27.534533] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:27.661240] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-22T19:33:27.661334] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-22T19:33:27.662252] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-22T19:33:27.662318] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-22T19:33:27.663695] [DEBUG] [LOCAL ] KGS: Trimmed 66556 records to 46063 (keeping 200 days of data) [2025-10-22T19:33:27.933529] [DEBUG] [LOCAL ] KGS: Primary data saved (46063 records). [2025-10-22T19:33:27.933745] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-22T19:33:27.933845] [INFO ] [MAIN ] Update Progress: 1192/2367 symbols completed. KGS took 27.3s. Estimated remaining: 2h 31m 12s. Rate: 7.8 symbols/min [2025-10-22T19:33:28.102514] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:28.103153] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-22T19:33:28.103340] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-22T19:33:28.103624] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-22T19:33:28.108880] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-22T19:33:28.115479] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-22T19:33:28.116101] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-22T19:33:28.127251] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-22T19:33:28.128022] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:33:28.563478] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T19:33:28.561729] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:28.757728] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T19:33:28.917689] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-22T19:33:29.115634] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:33:29.115988] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-22T19:33:29.116073] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:33:29.116120] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-22T19:33:29.116155] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:33:29.116220] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-22T19:33:29.116287] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-22T19:33:29.116323] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-22T19:33:29.116364] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-22T19:33:29.116411] [INFO ] [MAIN ] Update Progress: 1193/2367 symbols completed. KKRT took 1.2s. Estimated remaining: 2h 30m 58s. Rate: 7.8 symbols/min [2025-10-22T19:33:29.298894] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:29.299056] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-22T19:33:29.299092] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-22T19:33:29.299219] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-22T19:33:29.299259] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-22T19:33:29.299353] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-22T19:33:29.299400] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-22T19:33:29.718909] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-22T19:33:29.722484] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:30.517855] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-22T19:33:31.180351] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T19:33:31.317723] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-22T19:33:31.444411] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:33:31.888593] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T19:33:32.117680] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-22T19:33:32.332089] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:33:32.332386] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-22T19:33:32.332477] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:33:32.332522] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-22T19:33:32.332582] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:33:32.332677] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-22T19:33:32.332756] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-22T19:33:32.332792] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-22T19:33:32.332830] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-22T19:33:32.332875] [INFO ] [MAIN ] Update Progress: 1194/2367 symbols completed. KLAR took 3.2s. Estimated remaining: 2h 30m 46s. Rate: 7.8 symbols/min [2025-10-22T19:33:32.501548] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:32.532367] [DEBUG] [LOCAL ] KLC: Loaded 36207 existing records from primary storage. [2025-10-22T19:33:32.532663] [INFO ] [MAIN ] KLC: Loaded 36207 existing records. [2025-10-22T19:33:32.703079] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:32.703326] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-22T19:33:32.703392] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-22T19:33:32.704095] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-22T19:33:32.704152] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-22T19:33:32.925741] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-22T19:33:33.049393] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:33.717691] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-22T19:33:34.291797] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-22T19:33:34.517699] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-22T19:33:34.934918] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-22T19:33:35.317810] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-22T19:33:35.722976] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:33:36.117725] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-22T19:33:36.874750] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T19:33:36.917692] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-22T19:33:37.360994] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T19:33:37.717678] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-22T19:33:38.118636] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:33:38.517676] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-22T19:33:38.594049] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T19:33:39.317707] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-22T19:33:40.117699] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-22T19:33:40.369870] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T19:33:40.564780] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T19:33:40.715739] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T19:33:40.917753] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-22T19:33:41.501622] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-22T19:33:41.717762] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-22T19:33:42.517724] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-22T19:33:43.167878] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-22T19:33:43.317727] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-22T19:33:43.504774] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:33:44.117692] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-22T19:33:44.422258] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:33:44.917695] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-22T19:33:45.583886] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T19:33:45.598577] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T19:33:45.717702] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-22T19:33:46.517714] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-22T19:33:47.317789] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-22T19:33:47.322783] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T19:33:47.323974] [INFO ] [REMOTE ] KKRS: Full fetch complete (7549 records). [2025-10-22T19:33:47.324045] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-22T19:33:47.694203] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-22T19:33:47.694321] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-22T19:33:47.694586] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-22T19:33:47.694631] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-22T19:33:47.695059] [DEBUG] [LOCAL ] KKRS: Trimmed 7549 records to 5547 (keeping 200 days of data) [2025-10-22T19:33:47.729402] [DEBUG] [LOCAL ] KKRS: Primary data saved (5547 records). [2025-10-22T19:33:47.729781] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-22T19:33:47.729913] [INFO ] [MAIN ] Update Progress: 1195/2367 symbols completed. KKRS took 21.3s. Estimated remaining: 2h 30m 46s. Rate: 7.8 symbols/min [2025-10-22T19:33:47.900764] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:47.944808] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-22T19:33:47.999721] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-22T19:33:48.000093] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-22T19:33:48.122830] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-22T19:33:48.178233] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:48.178507] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-22T19:33:48.178560] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-22T19:33:48.178778] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-22T19:33:48.178835] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-22T19:33:48.536472] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:48.834612] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T19:33:48.917709] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-22T19:33:49.069575] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T19:33:49.717788] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-22T19:33:50.517723] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-22T19:33:51.136985] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T19:33:51.151103] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T19:33:51.317692] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-22T19:33:51.689588] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T19:33:51.695023] [INFO ] [REMOTE ] KIO: Full fetch complete (32326 records). [2025-10-22T19:33:51.695305] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-22T19:33:52.082561] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-22T19:33:52.082700] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-22T19:33:52.083716] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-22T19:33:52.083782] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-22T19:33:52.084890] [DEBUG] [LOCAL ] KIO: Trimmed 32326 records to 21683 (keeping 200 days of data) [2025-10-22T19:33:52.137115] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-22T19:33:52.227026] [DEBUG] [LOCAL ] KIO: Primary data saved (21683 records). [2025-10-22T19:33:52.227202] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-22T19:33:52.227301] [INFO ] [MAIN ] Update Progress: 1196/2367 symbols completed. KIO took 35.4s. Estimated remaining: 2h 30m 35s. Rate: 7.8 symbols/min [2025-10-22T19:33:52.412371] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:52.419685] [DEBUG] [LOCAL ] KMPB: Loaded 3533 existing records from primary storage. [2025-10-22T19:33:52.419940] [INFO ] [MAIN ] KMPB: Loaded 3533 existing records. [2025-10-22T19:33:52.601320] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:52.601608] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-22T19:33:52.601690] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-22T19:33:52.601883] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-22T19:33:52.601925] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-22T19:33:52.922805] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-22T19:33:52.962716] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:53.286314] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T19:33:53.571072] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T19:33:53.717689] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-22T19:33:54.086178] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-22T19:33:54.408907] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T19:33:54.517678] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-22T19:33:55.317773] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-22T19:33:56.117706] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-22T19:33:56.471344] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T19:33:56.551673] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T19:33:56.669861] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T19:33:56.917691] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-22T19:33:57.717714] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-22T19:33:58.347902] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T19:33:58.517711] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-22T19:33:59.317692] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-22T19:33:59.681207] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T19:33:59.895787] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-22T19:34:00.117766] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-22T19:34:00.666373] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T19:34:00.675174] [INFO ] [REMOTE ] KKR: Full fetch complete (77660 records). [2025-10-22T19:34:00.675297] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-22T19:34:00.930415] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-22T19:34:01.062185] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-22T19:34:01.062267] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-22T19:34:01.063267] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-22T19:34:01.063332] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-22T19:34:01.064840] [DEBUG] [LOCAL ] KKR: Trimmed 77660 records to 53500 (keeping 200 days of data) [2025-10-22T19:34:01.386631] [DEBUG] [LOCAL ] KKR: Primary data saved (53500 records). [2025-10-22T19:34:01.386784] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-22T19:34:01.386861] [INFO ] [MAIN ] Update Progress: 1197/2367 symbols completed. KKR took 37.2s. Estimated remaining: 2h 30m 28s. Rate: 7.8 symbols/min [2025-10-22T19:34:01.717716] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-22T19:34:01.883943] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T19:34:02.517774] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-22T19:34:03.424185] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:34:03.425548] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-22T19:34:03.903978] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-22T19:34:03.946719] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-10-22T19:34:04.117681] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-22T19:34:04.557783] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T19:34:04.564200] [INFO ] [REMOTE ] KLC: Full fetch complete (50613 records). [2025-10-22T19:34:04.564309] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-22T19:34:04.925464] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-22T19:34:04.943903] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-22T19:34:04.943991] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-22T19:34:04.944774] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-22T19:34:04.944940] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-22T19:34:04.945955] [DEBUG] [LOCAL ] KLC: Trimmed 50613 records to 36128 (keeping 200 days of data) [2025-10-22T19:34:05.144519] [DEBUG] [LOCAL ] KLC: Primary data saved (36128 records). [2025-10-22T19:34:05.144668] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-22T19:34:05.144763] [INFO ] [MAIN ] Update Progress: 1198/2367 symbols completed. KLC took 32.8s. Estimated remaining: 2h 30m 17s. Rate: 7.8 symbols/min [2025-10-22T19:34:05.582347] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T19:34:05.717813] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-22T19:34:06.019701] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T19:34:06.208436] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-22T19:34:06.517756] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-22T19:34:07.317790] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-22T19:34:07.898894] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T19:34:08.117763] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-22T19:34:08.409511] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T19:34:08.664796] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T19:34:08.917769] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-22T19:34:09.698598] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T19:34:09.699859] [INFO ] [REMOTE ] KMPB: Full fetch complete (4947 records). [2025-10-22T19:34:09.699935] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-22T19:34:09.733340] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-22T19:34:10.076262] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-22T19:34:10.076372] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-22T19:34:10.076567] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-22T19:34:10.076609] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-22T19:34:10.077039] [DEBUG] [LOCAL ] KMPB: Trimmed 4947 records to 3484 (keeping 200 days of data) [2025-10-22T19:34:10.099454] [DEBUG] [LOCAL ] KMPB: Primary data saved (3484 records). [2025-10-22T19:34:10.099609] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-22T19:34:10.099743] [INFO ] [MAIN ] Update Progress: 1199/2367 symbols completed. KMPB took 17.9s. Estimated remaining: 2h 30m 6s. Rate: 7.8 symbols/min [2025-10-22T19:34:11.826128] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-22T19:34:11.840380] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-22T19:34:13.781911] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T19:34:13.794759] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-22T19:34:15.973676] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T19:34:15.987308] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-22T19:34:17.572896] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T19:34:17.582970] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-22T19:34:17.583165] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-22T19:34:18.009436] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-22T19:34:18.009562] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-22T19:34:18.011034] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-22T19:34:18.011105] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-22T19:34:18.013229] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-22T19:34:18.355746] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-22T19:34:18.355943] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-22T19:34:18.356952] [INFO ] [MAIN ] Update Progress: 1200/2367 symbols completed. KMI took 30.6s. Estimated remaining: 2h 29m 59s. Rate: 7.8 symbols/min [2025-10-22T19:34:19.065454] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:19.117451] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:19.149225] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:19.151203] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:19.231237] [DEBUG] [LOCAL ] KMT: Loaded 42860 existing records from primary storage. [2025-10-22T19:34:19.231878] [INFO ] [MAIN ] KMT: Loaded 42860 existing records. [2025-10-22T19:34:19.306479] [DEBUG] [LOCAL ] KMX: Loaded 53285 existing records from primary storage. [2025-10-22T19:34:19.321789] [INFO ] [MAIN ] KMX: Loaded 53285 existing records. [2025-10-22T19:34:19.322887] [DEBUG] [LOCAL ] KMPR: Loaded 40497 existing records from primary storage. [2025-10-22T19:34:19.378302] [INFO ] [MAIN ] KMPR: Loaded 40497 existing records. [2025-10-22T19:34:19.446120] [DEBUG] [LOCAL ] KN: Loaded 38436 existing records from primary storage. [2025-10-22T19:34:19.515584] [INFO ] [MAIN ] KN: Loaded 38436 existing records. [2025-10-22T19:34:19.803552] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:19.932499] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-22T19:34:19.985692] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:20.097819] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-22T19:34:20.097676] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:20.101440] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:20.101931] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-22T19:34:20.098149] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-22T19:34:20.101559] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-22T19:34:20.102298] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-22T19:34:20.102453] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-22T19:34:20.102704] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-22T19:34:20.102855] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-22T19:34:20.102902] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-22T19:34:20.103348] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-22T19:34:20.103258] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-22T19:34:20.103812] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-22T19:34:20.103622] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-22T19:34:20.103028] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-22T19:34:20.159086] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-22T19:34:21.562308] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:21.592346] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:21.595598] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-22T19:34:21.588860] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-22T19:34:21.634836] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:21.683024] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-22T19:34:21.718350] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:21.718869] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-22T19:34:23.179062] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T19:34:23.184712] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-22T19:34:23.326203] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T19:34:23.333932] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-22T19:34:23.358970] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:34:23.367238] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-22T19:34:23.483083] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T19:34:23.493229] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-22T19:34:24.435421] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T19:34:24.444387] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-22T19:34:24.846750] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T19:34:24.896778] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-22T19:34:24.901463] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T19:34:24.910380] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-22T19:34:25.161295] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T19:34:25.170997] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-22T19:34:25.344068] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T19:34:25.350895] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-22T19:34:26.123627] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T19:34:26.132512] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-22T19:34:26.364894] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T19:34:26.373601] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-22T19:34:26.735700] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T19:34:26.743352] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-22T19:34:26.951148] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T19:34:26.962388] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-22T19:34:27.509441] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T19:34:27.520843] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-22T19:34:28.042668] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T19:34:28.054137] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-22T19:34:28.131176] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T19:34:28.139274] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-22T19:34:28.498587] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T19:34:28.917802] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-22T19:34:29.111070] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T19:34:29.169049] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T19:34:29.306450] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T19:34:29.717684] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-22T19:34:30.444802] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:34:30.517686] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-22T19:34:31.220065] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:34:31.317671] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-22T19:34:32.026428] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T19:34:32.117680] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-22T19:34:32.806173] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:34:32.917726] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-22T19:34:33.717631] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-22T19:34:34.057221] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:34:34.475606] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T19:34:34.517672] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-22T19:34:35.201998] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T19:34:35.317674] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-22T19:34:36.117669] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-22T19:34:36.403504] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T19:34:36.783842] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T19:34:36.917671] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-22T19:34:37.717614] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-22T19:34:37.819774] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:34:38.330505] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T19:34:38.517679] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-22T19:34:39.317627] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-22T19:34:39.670365] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T19:34:40.117635] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-22T19:34:40.164327] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:34:40.868778] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T19:34:40.917705] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-22T19:34:41.717691] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-22T19:34:42.434730] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-22T19:34:42.443972] [INFO ] [REMOTE ] KMX: Full fetch complete (76400 records). [2025-10-22T19:34:42.444163] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-22T19:34:42.522726] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-22T19:34:42.844525] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-22T19:34:42.850507] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-22T19:34:42.856757] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-22T19:34:42.861720] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-22T19:34:42.863363] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T19:34:42.870406] [INFO ] [REMOTE ] KMT: Full fetch complete (61940 records). [2025-10-22T19:34:42.870562] [DEBUG] [LOCAL ] KMX: Trimmed 76400 records to 53286 (keeping 200 days of data) [2025-10-22T19:34:42.870701] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-22T19:34:43.389609] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:34:43.418837] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-22T19:34:43.582223] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-22T19:34:43.583675] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-22T19:34:43.586310] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-22T19:34:43.588395] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-22T19:34:43.605216] [DEBUG] [LOCAL ] KMT: Trimmed 61940 records to 42861 (keeping 200 days of data) [2025-10-22T19:34:43.608395] [DEBUG] [LOCAL ] KMX: Primary data saved (53286 records). [2025-10-22T19:34:43.608803] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-22T19:34:43.609081] [INFO ] [MAIN ] Update Progress: 1201/2367 symbols completed. KMX took 25.2s. Estimated remaining: 2h 30m 9s. Rate: 7.8 symbols/min [2025-10-22T19:34:43.953729] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:44.040409] [DEBUG] [LOCAL ] KMT: Primary data saved (42861 records). [2025-10-22T19:34:44.040557] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-22T19:34:44.040672] [INFO ] [MAIN ] Update Progress: 1202/2367 symbols completed. KMT took 25.7s. Estimated remaining: 2h 29m 54s. Rate: 7.8 symbols/min [2025-10-22T19:34:44.229933] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:44.230941] [DEBUG] [LOCAL ] KNF: Loaded 36664 existing records from primary storage. [2025-10-22T19:34:44.231861] [INFO ] [MAIN ] KNF: Loaded 36664 existing records. [2025-10-22T19:34:44.339434] [DEBUG] [LOCAL ] KNOP: Loaded 10137 existing records from primary storage. [2025-10-22T19:34:44.339843] [INFO ] [MAIN ] KNOP: Loaded 10137 existing records. [2025-10-22T19:34:44.503382] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:44.472736] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T19:34:44.533388] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-22T19:34:44.539018] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-22T19:34:44.547914] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-22T19:34:44.548184] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-22T19:34:44.572272] [INFO ] [REMOTE ] KMPR: Full fetch complete (53554 records). [2025-10-22T19:34:44.605521] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-22T19:34:44.837929] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:44.857945] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-22T19:34:44.863437] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-22T19:34:44.933326] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-22T19:34:44.994981] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-22T19:34:45.274674] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T19:34:45.443476] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-22T19:34:45.687443] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:45.721964] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-22T19:34:45.730553] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-22T19:34:45.748415] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-22T19:34:45.756619] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-22T19:34:45.756780] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-22T19:34:45.821569] [DEBUG] [LOCAL ] KMPR: Trimmed 53554 records to 40496 (keeping 200 days of data) [2025-10-22T19:34:45.841236] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:45.841891] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-22T19:34:46.082665] [DEBUG] [LOCAL ] KMPR: Primary data saved (40496 records). [2025-10-22T19:34:46.082821] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-22T19:34:46.082907] [INFO ] [MAIN ] Update Progress: 1203/2367 symbols completed. KMPR took 27.7s. Estimated remaining: 2h 29m 41s. Rate: 7.8 symbols/min [2025-10-22T19:34:46.247233] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:46.265854] [DEBUG] [LOCAL ] KNSL: Loaded 18446 existing records from primary storage. [2025-10-22T19:34:46.266085] [INFO ] [MAIN ] KNSL: Loaded 18446 existing records. [2025-10-22T19:34:46.437920] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:46.438183] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-22T19:34:46.438229] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-22T19:34:46.438413] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-22T19:34:46.438467] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-22T19:34:46.788446] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:46.788846] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-22T19:34:46.854160] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T19:34:47.175040] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T19:34:47.236732] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T19:34:47.243254] [INFO ] [REMOTE ] KN: Full fetch complete (56686 records). [2025-10-22T19:34:47.243365] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-22T19:34:47.322788] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-22T19:34:47.619925] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-22T19:34:47.620002] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-22T19:34:47.620842] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-22T19:34:47.620904] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-22T19:34:47.621957] [DEBUG] [LOCAL ] KN: Trimmed 56686 records to 38389 (keeping 200 days of data) [2025-10-22T19:34:47.826120] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T19:34:47.859391] [DEBUG] [LOCAL ] KN: Primary data saved (38389 records). [2025-10-22T19:34:47.859539] [INFO ] [MAIN ] KN: Full history saved. [2025-10-22T19:34:47.859631] [INFO ] [MAIN ] Update Progress: 1204/2367 symbols completed. KN took 29.5s. Estimated remaining: 2h 29m 27s. Rate: 7.8 symbols/min [2025-10-22T19:34:48.026437] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:48.067322] [DEBUG] [LOCAL ] KNTK: Loaded 47232 existing records from primary storage. [2025-10-22T19:34:48.067610] [INFO ] [MAIN ] KNTK: Loaded 47232 existing records. [2025-10-22T19:34:48.129134] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-22T19:34:48.245159] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:48.245359] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-22T19:34:48.245405] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-22T19:34:48.245590] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-22T19:34:48.245628] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-22T19:34:48.628425] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:48.645950] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T19:34:48.906549] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T19:34:48.917610] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-22T19:34:49.706826] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T19:34:49.717602] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-22T19:34:50.517675] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-22T19:34:50.692951] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T19:34:51.317682] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-22T19:34:52.089271] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:34:52.104820] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:34:52.117608] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-22T19:34:52.917685] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-22T19:34:53.620726] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:34:53.717685] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-22T19:34:53.958844] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T19:34:54.517682] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-22T19:34:55.194009] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T19:34:55.225725] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T19:34:55.317691] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-22T19:34:56.111432] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T19:34:56.117616] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-22T19:34:56.885511] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T19:34:56.917635] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-22T19:34:57.717700] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-22T19:34:57.810634] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:34:58.517671] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-22T19:34:58.821314] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T19:34:59.317699] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-22T19:35:00.031383] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T19:35:00.117717] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-22T19:35:00.917912] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-22T19:35:01.009881] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T19:35:01.717692] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-22T19:35:02.276821] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T19:35:02.445022] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-22T19:35:02.517698] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-22T19:35:03.266541] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T19:35:03.317618] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-22T19:35:03.697551] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T19:35:03.700163] [INFO ] [REMOTE ] KNOP: Full fetch complete (14669 records). [2025-10-22T19:35:03.700232] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-22T19:35:04.055083] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-22T19:35:04.055176] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-22T19:35:04.055521] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-22T19:35:04.055587] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-22T19:35:04.056115] [DEBUG] [LOCAL ] KNOP: Trimmed 14669 records to 10075 (keeping 200 days of data) [2025-10-22T19:35:04.113465] [DEBUG] [LOCAL ] KNOP: Primary data saved (10075 records). [2025-10-22T19:35:04.113589] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-22T19:35:04.113689] [INFO ] [MAIN ] Update Progress: 1205/2367 symbols completed. KNOP took 20.1s. Estimated remaining: 2h 29m 28s. Rate: 7.8 symbols/min [2025-10-22T19:35:04.124809] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-22T19:35:04.280468] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:04.327865] [DEBUG] [LOCAL ] KNX: Loaded 52645 existing records from primary storage. [2025-10-22T19:35:04.328189] [INFO ] [MAIN ] KNX: Loaded 52645 existing records. [2025-10-22T19:35:04.501781] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:04.501986] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-22T19:35:04.502032] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-22T19:35:04.502209] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-22T19:35:04.502245] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-22T19:35:04.869876] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:04.902420] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T19:35:04.917633] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-22T19:35:05.187131] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T19:35:05.717763] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-22T19:35:06.097513] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T19:35:06.517707] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-22T19:35:06.798482] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T19:35:07.317762] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-22T19:35:08.126418] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-22T19:35:08.132082] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T19:35:08.731979] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T19:35:08.917725] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-22T19:35:08.988325] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T19:35:09.717694] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-22T19:35:10.517675] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-22T19:35:11.024008] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-22T19:35:11.241346] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T19:35:11.263395] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T19:35:11.317620] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-22T19:35:12.117629] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-22T19:35:12.764991] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T19:35:12.917636] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-22T19:35:13.693463] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T19:35:13.717612] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-22T19:35:14.004466] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T19:35:14.517689] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-22T19:35:15.309506] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T19:35:15.319229] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-22T19:35:15.936271] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T19:35:16.117707] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-22T19:35:16.917696] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-22T19:35:17.047039] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:35:17.717670] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-22T19:35:17.862750] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T19:35:17.870261] [INFO ] [REMOTE ] KNF: Full fetch complete (51474 records). [2025-10-22T19:35:17.870417] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-22T19:35:18.089822] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T19:35:18.184864] [INFO ] [REMOTE ] KNSL: Full fetch complete (27112 records). [2025-10-22T19:35:18.214941] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-22T19:35:18.443332] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-22T19:35:18.448542] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-22T19:35:18.471635] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-22T19:35:18.474143] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-22T19:35:18.527540] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-22T19:35:18.543176] [DEBUG] [LOCAL ] KNF: Trimmed 51474 records to 36630 (keeping 200 days of data) [2025-10-22T19:35:18.814847] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-22T19:35:18.814986] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-22T19:35:18.815698] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-22T19:35:18.855120] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-22T19:35:18.897760] [DEBUG] [LOCAL ] KNSL: Trimmed 27112 records to 18288 (keeping 200 days of data) [2025-10-22T19:35:18.915181] [DEBUG] [LOCAL ] KNF: Primary data saved (36630 records). [2025-10-22T19:35:18.915606] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-22T19:35:18.915736] [INFO ] [MAIN ] Update Progress: 1206/2367 symbols completed. KNF took 35.3s. Estimated remaining: 2h 29m 27s. Rate: 7.8 symbols/min [2025-10-22T19:35:19.221821] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:19.227425] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-22T19:35:19.228274] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-22T19:35:19.229954] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-22T19:35:19.233422] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-22T19:35:19.235042] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-22T19:35:19.235199] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-22T19:35:19.279576] [DEBUG] [LOCAL ] KNSL: Primary data saved (18288 records). [2025-10-22T19:35:19.300708] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-22T19:35:19.310231] [INFO ] [MAIN ] Update Progress: 1207/2367 symbols completed. KNSL took 33.2s. Estimated remaining: 2h 29m 12s. Rate: 7.8 symbols/min [2025-10-22T19:35:19.711228] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T19:35:19.692226] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:19.774433] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-22T19:35:19.862267] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:19.900514] [DEBUG] [LOCAL ] KODK: Loaded 43762 existing records from primary storage. [2025-10-22T19:35:19.900837] [INFO ] [MAIN ] KODK: Loaded 43762 existing records. [2025-10-22T19:35:20.085793] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:20.086043] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-22T19:35:20.086095] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-22T19:35:20.086281] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-22T19:35:20.086321] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-22T19:35:20.118907] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-22T19:35:20.443843] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:20.475016] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T19:35:20.483835] [INFO ] [REMOTE ] KNTK: Full fetch complete (65760 records). [2025-10-22T19:35:20.484069] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-22T19:35:20.867452] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-22T19:35:20.867548] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-22T19:35:20.868526] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-22T19:35:20.868592] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-22T19:35:20.870094] [DEBUG] [LOCAL ] KNTK: Trimmed 65760 records to 47207 (keeping 200 days of data) [2025-10-22T19:35:20.931312] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-22T19:35:21.155083] [DEBUG] [LOCAL ] KNTK: Primary data saved (47207 records). [2025-10-22T19:35:21.155245] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-22T19:35:21.156268] [INFO ] [MAIN ] Update Progress: 1208/2367 symbols completed. KNTK took 33.3s. Estimated remaining: 2h 28m 59s. Rate: 7.8 symbols/min [2025-10-22T19:35:21.326493] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:21.353959] [DEBUG] [LOCAL ] KOF: Loaded 26600 existing records from primary storage. [2025-10-22T19:35:21.354325] [INFO ] [MAIN ] KOF: Loaded 26600 existing records. [2025-10-22T19:35:21.533356] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:21.533661] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-22T19:35:21.533818] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-22T19:35:21.534094] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-22T19:35:21.534154] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-22T19:35:21.904950] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T19:35:21.942100] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:21.943023] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-22T19:35:22.517682] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-22T19:35:22.684635] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:35:22.991931] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-10-22T19:35:23.317706] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-22T19:35:23.372197] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T19:35:24.117681] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-22T19:35:24.260441] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T19:35:24.839148] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T19:35:24.917688] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-22T19:35:25.717700] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-22T19:35:26.151198] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T19:35:26.390695] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-22T19:35:26.517800] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-22T19:35:27.317684] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-22T19:35:27.428112] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T19:35:27.712936] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T19:35:28.117683] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-22T19:35:28.917697] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-22T19:35:29.717784] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-22T19:35:29.870305] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T19:35:29.917900] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-22T19:35:29.997485] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T19:35:30.517697] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-22T19:35:31.319094] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-22T19:35:31.322955] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T19:35:32.117788] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-22T19:35:32.389627] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T19:35:32.657841] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T19:35:32.917701] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-22T19:35:33.717774] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-22T19:35:34.517765] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-22T19:35:34.655509] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T19:35:34.767873] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-22T19:35:34.966596] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T19:35:35.317704] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-22T19:35:35.987858] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T19:35:36.117697] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-22T19:35:36.917758] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-22T19:35:37.356901] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T19:35:37.717666] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-22T19:35:37.838852] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-22T19:35:38.376290] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:35:38.517703] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-22T19:35:39.317688] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-22T19:35:39.549637] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T19:35:39.558571] [INFO ] [REMOTE ] KNX: Full fetch complete (76309 records). [2025-10-22T19:35:39.558746] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-22T19:35:39.961156] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-22T19:35:39.961252] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-22T19:35:39.962321] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-22T19:35:39.962393] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-22T19:35:39.963968] [DEBUG] [LOCAL ] KNX: Trimmed 76309 records to 52645 (keeping 200 days of data) [2025-10-22T19:35:40.143165] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-22T19:35:40.291244] [DEBUG] [LOCAL ] KNX: Primary data saved (52645 records). [2025-10-22T19:35:40.291406] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-22T19:35:40.291498] [INFO ] [MAIN ] Update Progress: 1209/2367 symbols completed. KNX took 36.2s. Estimated remaining: 2h 29m 2s. Rate: 7.8 symbols/min [2025-10-22T19:35:40.459138] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:40.477818] [DEBUG] [LOCAL ] KOP: Loaded 17428 existing records from primary storage. [2025-10-22T19:35:40.478051] [INFO ] [MAIN ] KOP: Loaded 17428 existing records. [2025-10-22T19:35:40.655734] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:40.655935] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-22T19:35:40.655983] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-22T19:35:40.656159] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-22T19:35:40.656216] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-22T19:35:41.011843] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:41.012420] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-22T19:35:41.039752] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T19:35:41.080156] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-22T19:35:41.231406] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:35:41.717730] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-22T19:35:42.369608] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T19:35:42.517637] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-22T19:35:43.081484] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T19:35:43.317721] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-22T19:35:44.117707] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-22T19:35:44.373156] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T19:35:44.917693] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-22T19:35:45.358031] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-22T19:35:45.401688] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T19:35:45.717707] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-22T19:35:45.745659] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T19:35:46.517763] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-22T19:35:47.317781] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-22T19:35:47.606562] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T19:35:48.117627] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-22T19:35:48.325121] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-22T19:35:48.854282] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-22T19:35:48.917753] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-22T19:35:48.961083] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T19:35:49.717699] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-22T19:35:49.945069] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T19:35:50.517728] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-22T19:35:51.317676] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-22T19:35:52.079027] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:35:52.083885] [INFO ] [REMOTE ] KOF: Full fetch complete (38037 records). [2025-10-22T19:35:52.083966] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-22T19:35:52.126669] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-22T19:35:52.471847] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-22T19:35:52.471969] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-22T19:35:52.472859] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-22T19:35:52.472971] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-22T19:35:52.500407] [DEBUG] [LOCAL ] KOF: Trimmed 38037 records to 26529 (keeping 200 days of data) [2025-10-22T19:35:52.502210] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-22T19:35:52.682038] [DEBUG] [LOCAL ] KOF: Primary data saved (26529 records). [2025-10-22T19:35:52.682244] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-22T19:35:52.682370] [INFO ] [MAIN ] Update Progress: 1210/2367 symbols completed. KOF took 31.5s. Estimated remaining: 2h 28m 59s. Rate: 7.8 symbols/min [2025-10-22T19:35:52.807028] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:35:52.859458] [INFO ] [REMOTE ] KODK: Full fetch complete (63348 records). [2025-10-22T19:35:52.867966] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-22T19:35:52.886867] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:52.919280] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-22T19:35:52.970598] [DEBUG] [LOCAL ] KORE: Loaded 2184 existing records from primary storage. [2025-10-22T19:35:52.971770] [INFO ] [MAIN ] KORE: Loaded 2184 existing records. [2025-10-22T19:35:53.294983] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-22T19:35:53.412728] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:53.435169] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-22T19:35:53.441676] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-22T19:35:53.445668] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-22T19:35:53.465672] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-22T19:35:53.550825] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-22T19:35:53.572485] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-22T19:35:53.584430] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-22T19:35:53.584984] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-22T19:35:53.663356] [DEBUG] [LOCAL ] KODK: Trimmed 63348 records to 43711 (keeping 200 days of data) [2025-10-22T19:35:53.721069] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-22T19:35:54.147707] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:54.350664] [DEBUG] [LOCAL ] KODK: Primary data saved (43711 records). [2025-10-22T19:35:54.350837] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-22T19:35:54.350930] [INFO ] [MAIN ] Update Progress: 1211/2367 symbols completed. KODK took 35.0s. Estimated remaining: 2h 28m 45s. Rate: 7.8 symbols/min [2025-10-22T19:35:54.522905] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-22T19:35:54.583132] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:54.636243] [DEBUG] [LOCAL ] KOS: Loaded 53093 existing records from primary storage. [2025-10-22T19:35:54.636568] [INFO ] [MAIN ] KOS: Loaded 53093 existing records. [2025-10-22T19:35:54.821055] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:54.821327] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-22T19:35:54.821377] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-22T19:35:54.821584] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-22T19:35:54.821639] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-22T19:35:54.956601] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T19:35:55.211298] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:55.317619] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-22T19:35:55.470504] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T19:35:55.807591] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.89 seconds). [2025-10-22T19:35:55.822572] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-22T19:35:55.822892] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-22T19:35:56.042679] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T19:35:56.043542] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:35:56.043630] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:35:56.043746] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-22T19:35:56.043864] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-22T19:35:56.043909] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-22T19:35:56.043950] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-22T19:35:56.044027] [INFO ] [MAIN ] Update Progress: 1212/2367 symbols completed. KO took 37.1s. Estimated remaining: 2h 28m 32s. Rate: 7.8 symbols/min [2025-10-22T19:35:56.127588] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-22T19:35:56.222378] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:56.271209] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-22T19:35:56.271560] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-22T19:35:56.449576] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:56.449870] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-22T19:35:56.449925] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-22T19:35:56.450134] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-22T19:35:56.450190] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-22T19:35:56.736942] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T19:35:56.816209] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:56.917682] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-22T19:35:57.372103] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-22T19:35:57.717729] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-22T19:35:58.517710] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-22T19:35:58.707121] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T19:35:59.317618] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-22T19:35:59.359579] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T19:35:59.649878] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T19:36:00.117671] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-22T19:36:00.649227] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-22T19:36:00.917706] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-22T19:36:01.584576] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-22T19:36:01.585954] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-22T19:36:01.717702] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-22T19:36:02.517684] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-22T19:36:03.317683] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-22T19:36:03.602351] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T19:36:03.638562] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T19:36:04.117695] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-22T19:36:04.917630] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-22T19:36:05.034905] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T19:36:05.203602] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T19:36:05.206835] [INFO ] [REMOTE ] KOP: Full fetch complete (25439 records). [2025-10-22T19:36:05.207021] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-22T19:36:05.310030] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-22T19:36:05.567189] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-22T19:36:05.567264] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-22T19:36:05.567836] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-22T19:36:05.567900] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-22T19:36:05.568494] [DEBUG] [LOCAL ] KOP: Trimmed 25439 records to 17332 (keeping 200 days of data) [2025-10-22T19:36:05.670039] [DEBUG] [LOCAL ] KOP: Primary data saved (17332 records). [2025-10-22T19:36:05.670173] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-22T19:36:05.670248] [INFO ] [MAIN ] Update Progress: 1213/2367 symbols completed. KOP took 25.4s. Estimated remaining: 2h 28m 26s. Rate: 7.8 symbols/min [2025-10-22T19:36:05.722863] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-22T19:36:05.835871] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:05.875895] [DEBUG] [LOCAL ] KRC: Loaded 48149 existing records from primary storage. [2025-10-22T19:36:05.876184] [INFO ] [MAIN ] KRC: Loaded 48149 existing records. [2025-10-22T19:36:06.047460] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:06.047688] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-22T19:36:06.051187] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-22T19:36:06.051509] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-22T19:36:06.051565] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-22T19:36:06.395948] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:06.517633] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-22T19:36:06.882495] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-22T19:36:07.317617] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-22T19:36:07.831129] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T19:36:07.873934] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-22T19:36:08.117675] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-22T19:36:08.568978] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T19:36:08.917697] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-22T19:36:09.717701] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-22T19:36:10.408553] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T19:36:10.517632] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-22T19:36:10.879899] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T19:36:11.317685] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-22T19:36:11.979330] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-22T19:36:11.980786] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T19:36:11.985275] [INFO ] [REMOTE ] KORE: Full fetch complete (4009 records). [2025-10-22T19:36:11.990955] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-22T19:36:12.128322] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-22T19:36:12.354918] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-22T19:36:12.355022] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-22T19:36:12.355174] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-22T19:36:12.355234] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-22T19:36:12.355624] [DEBUG] [LOCAL ] KORE: Trimmed 4009 records to 2179 (keeping 200 days of data) [2025-10-22T19:36:12.367540] [DEBUG] [LOCAL ] KORE: Primary data saved (2179 records). [2025-10-22T19:36:12.367596] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-22T19:36:12.367690] [INFO ] [MAIN ] Update Progress: 1214/2367 symbols completed. KORE took 19.7s. Estimated remaining: 2h 28m 17s. Rate: 7.8 symbols/min [2025-10-22T19:36:12.538931] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:12.571479] [DEBUG] [LOCAL ] KREF: Loaded 38066 existing records from primary storage. [2025-10-22T19:36:12.571775] [INFO ] [MAIN ] KREF: Loaded 38066 existing records. [2025-10-22T19:36:12.742615] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:12.742866] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-22T19:36:12.742913] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-22T19:36:12.743123] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-22T19:36:12.743160] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-22T19:36:12.924917] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-22T19:36:13.092742] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:13.722763] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-22T19:36:13.740596] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T19:36:14.517692] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-22T19:36:14.919023] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:36:15.052235] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-22T19:36:15.317639] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-22T19:36:16.122822] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-22T19:36:16.139953] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T19:36:16.917723] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-22T19:36:17.017878] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:36:17.717634] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-22T19:36:18.062119] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T19:36:18.517669] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-22T19:36:18.693290] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T19:36:19.023469] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T19:36:19.317667] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-22T19:36:19.962511] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T19:36:20.117607] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-22T19:36:20.669467] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T19:36:20.917765] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-22T19:36:21.717671] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-22T19:36:21.973783] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T19:36:22.400589] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T19:36:22.517676] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-22T19:36:23.150099] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:36:23.317700] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-22T19:36:23.910751] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T19:36:24.117682] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-22T19:36:24.761756] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T19:36:24.917718] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-22T19:36:25.725706] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-22T19:36:25.734944] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T19:36:26.517630] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-22T19:36:26.665480] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:36:27.204546] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T19:36:27.317674] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-22T19:36:27.825772] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T19:36:28.117716] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-22T19:36:28.307536] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T19:36:28.917679] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-22T19:36:29.717730] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-22T19:36:30.150330] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T19:36:30.300729] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T19:36:30.517720] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-22T19:36:31.317635] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-22T19:36:31.558514] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T19:36:31.568289] [INFO ] [REMOTE ] KOS: Full fetch complete (77024 records). [2025-10-22T19:36:31.568452] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-22T19:36:31.890955] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T19:36:31.990313] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-22T19:36:31.990396] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-22T19:36:31.991350] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-22T19:36:31.991412] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-22T19:36:31.992795] [DEBUG] [LOCAL ] KOS: Trimmed 77024 records to 53093 (keeping 200 days of data) [2025-10-22T19:36:32.145144] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-22T19:36:32.297761] [DEBUG] [LOCAL ] KOS: Primary data saved (53093 records). [2025-10-22T19:36:32.297901] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-22T19:36:32.298034] [INFO ] [MAIN ] Update Progress: 1215/2367 symbols completed. KOS took 37.9s. Estimated remaining: 2h 28m 21s. Rate: 7.8 symbols/min [2025-10-22T19:36:32.475337] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:32.517837] [DEBUG] [LOCAL ] KRG: Loaded 49291 existing records from primary storage. [2025-10-22T19:36:32.518145] [INFO ] [MAIN ] KRG: Loaded 49291 existing records. [2025-10-22T19:36:32.739330] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:32.739714] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-22T19:36:32.739774] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-22T19:36:32.739958] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-22T19:36:32.739996] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-22T19:36:32.937185] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-22T19:36:33.110263] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:36:33.141314] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:33.639185] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T19:36:33.717673] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-22T19:36:34.517726] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-22T19:36:35.038091] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T19:36:35.047353] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-22T19:36:35.047547] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-22T19:36:35.338860] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-22T19:36:35.357299] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T19:36:35.492741] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-22T19:36:35.492837] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-22T19:36:35.493886] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-22T19:36:35.493950] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-22T19:36:35.495457] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 53681 (keeping 200 days of data) [2025-10-22T19:36:35.831877] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-22T19:36:35.832078] [INFO ] [MAIN ] KR: Full history saved. [2025-10-22T19:36:35.832186] [INFO ] [MAIN ] Update Progress: 1216/2367 symbols completed. KR took 39.8s. Estimated remaining: 2h 28m 9s. Rate: 7.8 symbols/min [2025-10-22T19:36:36.013609] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:36.013845] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-22T19:36:36.013922] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-22T19:36:36.014087] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-22T19:36:36.014130] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-22T19:36:36.014173] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-22T19:36:36.014206] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-22T19:36:36.121760] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-22T19:36:36.375224] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:36.401616] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T19:36:36.917619] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-22T19:36:36.998998] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T19:36:37.005808] [INFO ] [REMOTE ] KREF: Full fetch complete (52979 records). [2025-10-22T19:36:37.005910] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-22T19:36:37.386715] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-22T19:36:37.386796] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-22T19:36:37.387596] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-22T19:36:37.387664] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-22T19:36:37.388765] [DEBUG] [LOCAL ] KREF: Trimmed 52979 records to 38061 (keeping 200 days of data) [2025-10-22T19:36:37.610560] [DEBUG] [LOCAL ] KREF: Primary data saved (38061 records). [2025-10-22T19:36:37.610711] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-22T19:36:37.611401] [INFO ] [MAIN ] Update Progress: 1217/2367 symbols completed. KREF took 25.2s. Estimated remaining: 2h 27m 56s. Rate: 7.8 symbols/min [2025-10-22T19:36:37.720855] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-22T19:36:37.811178] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:37.812959] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T19:36:37.847611] [DEBUG] [LOCAL ] KRO: Loaded 26642 existing records from primary storage. [2025-10-22T19:36:37.847913] [INFO ] [MAIN ] KRO: Loaded 26642 existing records. [2025-10-22T19:36:37.991150] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:36:38.027596] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:38.021531] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-22T19:36:38.028039] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:36:38.028181] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-22T19:36:38.028136] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-22T19:36:38.028306] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-22T19:36:38.028359] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:36:38.028535] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-22T19:36:38.028596] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-22T19:36:38.028635] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-22T19:36:38.028691] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-22T19:36:38.028857] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-22T19:36:38.028918] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-22T19:36:38.029051] [INFO ] [MAIN ] Update Progress: 1218/2367 symbols completed. KRMN took 2.2s. Estimated remaining: 2h 27m 41s. Rate: 7.8 symbols/min [2025-10-22T19:36:38.369318] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:38.526697] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-22T19:36:38.604015] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:38.648667] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T19:36:38.649460] [DEBUG] [LOCAL ] KRP: Loaded 36048 existing records from primary storage. [2025-10-22T19:36:38.661772] [INFO ] [MAIN ] KRP: Loaded 36048 existing records. [2025-10-22T19:36:38.879413] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:38.879772] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-22T19:36:38.879833] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-22T19:36:38.880132] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-22T19:36:38.880203] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-22T19:36:39.240029] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:39.317730] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-22T19:36:40.117632] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-22T19:36:40.289690] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T19:36:40.917636] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-22T19:36:40.978395] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:36:41.131404] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T19:36:41.717726] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-22T19:36:42.499125] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T19:36:42.517609] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-22T19:36:42.901041] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T19:36:42.909004] [INFO ] [REMOTE ] KRC: Full fetch complete (70056 records). [2025-10-22T19:36:42.909145] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-22T19:36:43.291865] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-22T19:36:43.291968] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-22T19:36:43.292876] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-22T19:36:43.292950] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-22T19:36:43.294279] [DEBUG] [LOCAL ] KRC: Trimmed 70056 records to 48094 (keeping 200 days of data) [2025-10-22T19:36:43.345723] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-22T19:36:43.579398] [DEBUG] [LOCAL ] KRC: Primary data saved (48094 records). [2025-10-22T19:36:43.579524] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-22T19:36:43.579601] [INFO ] [MAIN ] Update Progress: 1219/2367 symbols completed. KRC took 37.9s. Estimated remaining: 2h 27m 32s. Rate: 7.8 symbols/min [2025-10-22T19:36:43.747811] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:43.796672] [DEBUG] [LOCAL ] KSS: Loaded 53589 existing records from primary storage. [2025-10-22T19:36:43.796988] [INFO ] [MAIN ] KSS: Loaded 53589 existing records. [2025-10-22T19:36:43.985333] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:43.985789] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-22T19:36:43.985856] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-22T19:36:43.986177] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-22T19:36:43.986216] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-22T19:36:44.117893] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-22T19:36:44.324596] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T19:36:44.386157] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T19:36:44.427144] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:44.917682] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-22T19:36:45.485819] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T19:36:45.717625] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-22T19:36:45.989277] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T19:36:46.517774] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-22T19:36:47.317761] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-22T19:36:47.363956] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:36:48.117706] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-22T19:36:48.508304] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T19:36:48.657407] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T19:36:48.917732] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-22T19:36:49.607442] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T19:36:49.717612] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-22T19:36:50.522846] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-22T19:36:50.539264] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T19:36:51.123205] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T19:36:51.317688] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-22T19:36:52.117631] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-22T19:36:52.474850] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T19:36:52.917672] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-22T19:36:53.031232] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T19:36:53.540907] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T19:36:53.717705] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-22T19:36:54.017924] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T19:36:54.517718] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-22T19:36:55.078284] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T19:36:55.317638] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-22T19:36:56.105602] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T19:36:56.117613] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-22T19:36:56.453597] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:36:56.917703] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-22T19:36:57.717666] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-22T19:36:57.809475] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T19:36:58.261018] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T19:36:58.517633] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-22T19:36:58.914384] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T19:36:59.317708] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-22T19:37:00.117666] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-22T19:37:00.621015] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T19:37:00.768056] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:37:00.917670] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-22T19:37:01.530969] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:37:01.717768] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-22T19:37:02.517781] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-22T19:37:02.790470] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T19:37:02.803737] [INFO ] [REMOTE ] KRG: Full fetch complete (71413 records). [2025-10-22T19:37:02.803945] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-22T19:37:03.054230] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T19:37:03.338193] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-22T19:37:03.427861] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-22T19:37:03.427983] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-22T19:37:03.429587] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-22T19:37:03.429749] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-22T19:37:03.431778] [DEBUG] [LOCAL ] KRG: Trimmed 71413 records to 49271 (keeping 200 days of data) [2025-10-22T19:37:03.761072] [DEBUG] [LOCAL ] KRG: Primary data saved (49271 records). [2025-10-22T19:37:03.761210] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-22T19:37:03.761291] [INFO ] [MAIN ] Update Progress: 1220/2367 symbols completed. KRG took 31.5s. Estimated remaining: 2h 27m 36s. Rate: 7.8 symbols/min [2025-10-22T19:37:03.942088] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:03.981823] [DEBUG] [LOCAL ] KT: Loaded 45470 existing records from primary storage. [2025-10-22T19:37:03.982224] [INFO ] [MAIN ] KT: Loaded 45470 existing records. [2025-10-22T19:37:04.129051] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-22T19:37:04.156060] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T19:37:04.175799] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:04.181812] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-22T19:37:04.181869] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-22T19:37:04.181999] [INFO ] [REMOTE ] KRP: Full fetch complete (55024 records). [2025-10-22T19:37:04.182131] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-22T19:37:04.182276] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-22T19:37:04.182360] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-22T19:37:04.851613] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:04.926598] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-22T19:37:04.930605] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-22T19:37:04.930737] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-22T19:37:04.931566] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-22T19:37:04.931744] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-22T19:37:04.932972] [DEBUG] [LOCAL ] KRP: Trimmed 55024 records to 35928 (keeping 200 days of data) [2025-10-22T19:37:05.149341] [DEBUG] [LOCAL ] KRP: Primary data saved (35928 records). [2025-10-22T19:37:05.149476] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-22T19:37:05.149558] [INFO ] [MAIN ] Update Progress: 1221/2367 symbols completed. KRP took 27.1s. Estimated remaining: 2h 27m 22s. Rate: 7.8 symbols/min [2025-10-22T19:37:05.327638] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:05.365133] [DEBUG] [LOCAL ] KTB: Loaded 40377 existing records from primary storage. [2025-10-22T19:37:05.365462] [INFO ] [MAIN ] KTB: Loaded 40377 existing records. [2025-10-22T19:37:05.548322] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:05.548624] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-22T19:37:05.548812] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-22T19:37:05.549043] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-22T19:37:05.549111] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-22T19:37:05.922277] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-22T19:37:05.960908] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:05.961676] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-22T19:37:06.200130] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T19:37:06.205383] [INFO ] [REMOTE ] KRO: Full fetch complete (35322 records). [2025-10-22T19:37:06.205497] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-22T19:37:06.522964] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-22T19:37:06.600909] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-22T19:37:06.600994] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-22T19:37:06.601671] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-22T19:37:06.601734] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-22T19:37:06.602534] [DEBUG] [LOCAL ] KRO: Trimmed 35322 records to 26553 (keeping 200 days of data) [2025-10-22T19:37:06.753881] [DEBUG] [LOCAL ] KRO: Primary data saved (26553 records). [2025-10-22T19:37:06.754021] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-22T19:37:06.754104] [INFO ] [MAIN ] Update Progress: 1222/2367 symbols completed. KRO took 29.1s. Estimated remaining: 2h 27m 8s. Rate: 7.8 symbols/min [2025-10-22T19:37:06.924565] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:06.936802] [DEBUG] [LOCAL ] KTF: Loaded 11685 existing records from primary storage. [2025-10-22T19:37:06.937045] [INFO ] [MAIN ] KTF: Loaded 11685 existing records. [2025-10-22T19:37:07.120021] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:07.120490] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-22T19:37:07.120593] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-22T19:37:07.121027] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-22T19:37:07.121102] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-22T19:37:07.260174] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-22T19:37:07.322794] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-22T19:37:07.536897] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:07.904773] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T19:37:08.043777] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-22T19:37:08.117610] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-22T19:37:08.917724] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-22T19:37:09.023314] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T19:37:09.717667] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-22T19:37:10.041070] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T19:37:10.048173] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T19:37:10.517691] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-22T19:37:11.322737] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-22T19:37:11.336818] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T19:37:12.117690] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-22T19:37:12.181898] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T19:37:12.699411] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-22T19:37:12.917635] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-22T19:37:13.296431] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:37:13.717681] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-22T19:37:14.517723] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-22T19:37:15.130859] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T19:37:15.256235] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T19:37:15.317620] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-22T19:37:16.102546] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T19:37:16.117617] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-22T19:37:16.877838] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:37:16.917611] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-22T19:37:17.714096] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T19:37:17.723148] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-22T19:37:18.421439] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T19:37:18.517681] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-22T19:37:18.704147] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T19:37:19.317679] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-22T19:37:20.030811] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T19:37:20.117683] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-22T19:37:20.917963] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-22T19:37:20.920967] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T19:37:21.239463] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T19:37:21.717697] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-22T19:37:21.917268] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T19:37:22.517689] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-22T19:37:23.317678] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-22T19:37:23.706216] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T19:37:24.074501] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T19:37:24.096515] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T19:37:24.117681] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-22T19:37:24.917728] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-22T19:37:25.717635] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-22T19:37:25.773558] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T19:37:26.086266] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T19:37:26.517667] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-22T19:37:27.317618] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-22T19:37:27.800553] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T19:37:27.809438] [INFO ] [REMOTE ] KSS: Full fetch complete (77752 records). [2025-10-22T19:37:27.809555] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-22T19:37:28.126245] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-22T19:37:28.244008] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-22T19:37:28.243715] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T19:37:28.265562] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-22T19:37:28.270590] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:37:28.269751] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-22T19:37:28.278316] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-22T19:37:28.280418] [DEBUG] [LOCAL ] KSS: Trimmed 77752 records to 53589 (keeping 200 days of data) [2025-10-22T19:37:28.594594] [DEBUG] [LOCAL ] KSS: Primary data saved (53589 records). [2025-10-22T19:37:28.594821] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-22T19:37:28.594915] [INFO ] [MAIN ] Update Progress: 1223/2367 symbols completed. KSS took 45.0s. Estimated remaining: 2h 27m 14s. Rate: 7.8 symbols/min [2025-10-22T19:37:28.760455] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:28.807956] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-22T19:37:28.808273] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-22T19:37:28.922819] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-22T19:37:28.983666] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:28.983858] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-22T19:37:28.983904] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-22T19:37:28.984106] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-22T19:37:28.984160] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-22T19:37:29.331916] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:29.717780] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-22T19:37:29.781208] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:37:30.517625] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-22T19:37:30.649008] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T19:37:30.655060] [INFO ] [REMOTE ] KTB: Full fetch complete (58362 records). [2025-10-22T19:37:30.655163] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-22T19:37:31.046143] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-22T19:37:31.046220] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-22T19:37:31.047188] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-22T19:37:31.047257] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-22T19:37:31.048571] [DEBUG] [LOCAL ] KTB: Trimmed 58362 records to 40299 (keeping 200 days of data) [2025-10-22T19:37:31.317622] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-22T19:37:31.325803] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T19:37:31.324859] [DEBUG] [LOCAL ] KTB: Primary data saved (40299 records). [2025-10-22T19:37:31.336177] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-22T19:37:31.336933] [INFO ] [MAIN ] Update Progress: 1224/2367 symbols completed. KTB took 26.2s. Estimated remaining: 2h 27m 2s. Rate: 7.8 symbols/min [2025-10-22T19:37:31.503122] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:31.547052] [DEBUG] [LOCAL ] KVYO: Loaded 50885 existing records from primary storage. [2025-10-22T19:37:31.547361] [INFO ] [MAIN ] KVYO: Loaded 50885 existing records. [2025-10-22T19:37:31.734603] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:31.734836] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-22T19:37:31.734885] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-22T19:37:31.735270] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-22T19:37:31.735328] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-22T19:37:32.111348] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:32.117636] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-22T19:37:32.208482] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T19:37:32.216181] [INFO ] [REMOTE ] KT: Full fetch complete (66756 records). [2025-10-22T19:37:32.216322] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-22T19:37:32.348099] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T19:37:32.614590] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-22T19:37:32.614914] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-22T19:37:32.615810] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-22T19:37:32.615871] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-22T19:37:32.617185] [DEBUG] [LOCAL ] KT: Trimmed 66756 records to 45383 (keeping 200 days of data) [2025-10-22T19:37:32.879595] [DEBUG] [LOCAL ] KT: Primary data saved (45383 records). [2025-10-22T19:37:32.879759] [INFO ] [MAIN ] KT: Full history saved. [2025-10-22T19:37:32.879858] [INFO ] [MAIN ] Update Progress: 1225/2367 symbols completed. KT took 29.1s. Estimated remaining: 2h 26m 48s. Rate: 7.8 symbols/min [2025-10-22T19:37:32.923304] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-22T19:37:33.051171] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:33.085356] [DEBUG] [LOCAL ] KW: Loaded 40418 existing records from primary storage. [2025-10-22T19:37:33.085665] [INFO ] [MAIN ] KW: Loaded 40418 existing records. [2025-10-22T19:37:33.262679] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:33.262936] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-22T19:37:33.262983] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-22T19:37:33.263349] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-22T19:37:33.263404] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-22T19:37:33.609075] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:33.717697] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-22T19:37:33.966209] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T19:37:34.265564] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T19:37:34.517685] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-22T19:37:35.192621] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T19:37:35.317688] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-22T19:37:35.828633] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T19:37:36.117668] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-22T19:37:36.617730] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T19:37:36.917700] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-22T19:37:37.552777] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T19:37:37.717691] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-22T19:37:37.777789] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T19:37:38.462357] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T19:37:38.517715] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-22T19:37:39.317637] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-22T19:37:39.919310] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T19:37:40.117626] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-22T19:37:40.917710] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-22T19:37:41.021131] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:37:41.660103] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T19:37:41.662117] [INFO ] [REMOTE ] KTF: Full fetch complete (17303 records). [2025-10-22T19:37:41.662228] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-22T19:37:41.723340] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-22T19:37:41.788469] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T19:37:42.050715] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-22T19:37:42.050798] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-22T19:37:42.051107] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-22T19:37:42.051169] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-22T19:37:42.051692] [DEBUG] [LOCAL ] KTF: Trimmed 17303 records to 11658 (keeping 200 days of data) [2025-10-22T19:37:42.118257] [DEBUG] [LOCAL ] KTF: Primary data saved (11658 records). [2025-10-22T19:37:42.118372] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-22T19:37:42.118446] [INFO ] [MAIN ] Update Progress: 1226/2367 symbols completed. KTF took 35.4s. Estimated remaining: 2h 26m 42s. Rate: 7.8 symbols/min [2025-10-22T19:37:42.286685] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:42.304245] [DEBUG] [LOCAL ] KWR: Loaded 15865 existing records from primary storage. [2025-10-22T19:37:42.304476] [INFO ] [MAIN ] KWR: Loaded 15865 existing records. [2025-10-22T19:37:42.478880] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:42.479105] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-22T19:37:42.479152] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-22T19:37:42.479314] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-22T19:37:42.479352] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-22T19:37:42.522926] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-22T19:37:42.829882] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:43.317725] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-22T19:37:43.503942] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T19:37:44.117721] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-22T19:37:44.162014] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:37:44.602991] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T19:37:44.917726] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-22T19:37:45.642979] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T19:37:45.717705] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-22T19:37:46.517767] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-22T19:37:46.641725] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:37:47.136952] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:37:47.317730] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-22T19:37:48.021027] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:37:48.117610] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-22T19:37:48.917722] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-22T19:37:49.109094] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:37:49.594526] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T19:37:49.717634] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-22T19:37:50.517764] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-22T19:37:50.579406] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T19:37:51.317773] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-22T19:37:51.653241] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T19:37:51.698835] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T19:37:52.117728] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-22T19:37:52.886971] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T19:37:52.917618] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-22T19:37:53.507561] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T19:37:53.717768] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-22T19:37:54.517684] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-22T19:37:54.791864] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T19:37:54.858973] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-22T19:37:54.868639] [INFO ] [REMOTE ] KW: Full fetch complete (57306 records). [2025-10-22T19:37:54.868885] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-22T19:37:55.296478] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-22T19:37:55.296594] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-22T19:37:55.297505] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-22T19:37:55.297573] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-22T19:37:55.298950] [DEBUG] [LOCAL ] KW: Trimmed 57306 records to 40330 (keeping 200 days of data) [2025-10-22T19:37:55.352608] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-22T19:37:55.642989] [DEBUG] [LOCAL ] KW: Primary data saved (40330 records). [2025-10-22T19:37:55.643122] [INFO ] [MAIN ] KW: Full history saved. [2025-10-22T19:37:55.643203] [INFO ] [MAIN ] Update Progress: 1227/2367 symbols completed. KW took 22.8s. Estimated remaining: 2h 26m 39s. Rate: 7.8 symbols/min [2025-10-22T19:37:55.830627] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:55.863881] [DEBUG] [LOCAL ] KYN: Loaded 30292 existing records from primary storage. [2025-10-22T19:37:55.864181] [INFO ] [MAIN ] KYN: Loaded 30292 existing records. [2025-10-22T19:37:56.062240] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:56.062489] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-22T19:37:56.062547] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-22T19:37:56.062960] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-22T19:37:56.063016] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-22T19:37:56.120245] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-22T19:37:56.454035] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:56.487431] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T19:37:56.917639] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-22T19:37:57.191992] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T19:37:57.379611] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T19:37:57.717705] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-22T19:37:58.517674] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-22T19:37:58.561289] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T19:37:58.591639] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T19:37:58.600632] [INFO ] [REMOTE ] KVUE: Full fetch complete (77845 records). [2025-10-22T19:37:58.600799] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-22T19:37:58.988117] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-22T19:37:58.988204] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-22T19:37:58.989275] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-22T19:37:58.989341] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-22T19:37:58.990798] [DEBUG] [LOCAL ] KVUE: Trimmed 77845 records to 53667 (keeping 200 days of data) [2025-10-22T19:37:59.319541] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-22T19:37:59.319827] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-22T19:37:59.319933] [INFO ] [MAIN ] Update Progress: 1228/2367 symbols completed. KVUE took 30.7s. Estimated remaining: 2h 26m 28s. Rate: 7.8 symbols/min [2025-10-22T19:37:59.319359] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-22T19:37:59.491536] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:59.526268] [DEBUG] [LOCAL ] L: Loaded 41211 existing records from primary storage. [2025-10-22T19:37:59.526555] [INFO ] [MAIN ] L: Loaded 41211 existing records. [2025-10-22T19:37:59.700828] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:59.701582] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-22T19:37:59.701629] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-22T19:37:59.702108] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-22T19:37:59.702164] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-22T19:38:00.057970] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:00.117617] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-22T19:38:00.205898] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T19:38:00.711171] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T19:38:00.917730] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-22T19:38:01.426574] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T19:38:01.717731] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-22T19:38:02.517731] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-22T19:38:02.810218] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T19:38:02.819002] [INFO ] [REMOTE ] KVYO: Full fetch complete (72248 records). [2025-10-22T19:38:02.819123] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-22T19:38:03.202218] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-22T19:38:03.202315] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-22T19:38:03.203235] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-22T19:38:03.203375] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-22T19:38:03.223671] [DEBUG] [LOCAL ] KVYO: Trimmed 72248 records to 50891 (keeping 200 days of data) [2025-10-22T19:38:03.224919] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T19:38:03.318345] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-22T19:38:03.530266] [DEBUG] [LOCAL ] KVYO: Primary data saved (50891 records). [2025-10-22T19:38:03.541875] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-22T19:38:03.542743] [INFO ] [MAIN ] Update Progress: 1229/2367 symbols completed. KVYO took 32.2s. Estimated remaining: 2h 26m 17s. Rate: 7.8 symbols/min [2025-10-22T19:38:03.542528] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T19:38:03.723843] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:03.771806] [DEBUG] [LOCAL ] LAC: Loaded 52565 existing records from primary storage. [2025-10-22T19:38:03.772123] [INFO ] [MAIN ] LAC: Loaded 52565 existing records. [2025-10-22T19:38:03.948579] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:03.948820] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-22T19:38:03.948870] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-22T19:38:03.949070] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-22T19:38:03.949127] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-22T19:38:04.122921] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-22T19:38:04.306973] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:04.376165] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T19:38:04.917678] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-22T19:38:05.710346] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:38:05.718413] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-22T19:38:06.148137] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-22T19:38:06.517698] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-22T19:38:07.317626] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-22T19:38:07.766541] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-22T19:38:07.819597] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T19:38:08.043889] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:38:08.117672] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-22T19:38:08.917727] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-22T19:38:09.656276] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T19:38:09.717624] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-22T19:38:10.393362] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:38:10.517683] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-22T19:38:11.277709] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T19:38:11.317706] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-22T19:38:11.537507] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T19:38:12.117698] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-22T19:38:12.856636] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T19:38:12.917679] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-22T19:38:13.472253] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T19:38:13.717708] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-22T19:38:14.517635] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-22T19:38:14.568020] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T19:38:14.820967] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T19:38:15.317692] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-22T19:38:16.109236] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T19:38:16.117793] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-22T19:38:16.917682] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-22T19:38:17.367183] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T19:38:17.421777] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T19:38:17.717624] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-22T19:38:17.878921] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T19:38:18.517704] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-22T19:38:19.036302] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T19:38:19.317676] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-22T19:38:19.818011] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T19:38:20.117683] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-22T19:38:20.164066] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T19:38:20.917682] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-22T19:38:21.717677] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-22T19:38:21.882037] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T19:38:21.884315] [INFO ] [REMOTE ] KWR: Full fetch complete (23222 records). [2025-10-22T19:38:21.884389] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-22T19:38:22.245183] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-22T19:38:22.288685] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-22T19:38:22.288859] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-22T19:38:22.289404] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-22T19:38:22.289487] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-22T19:38:22.289727] [INFO ] [REMOTE ] L: Full fetch complete (59427 records). [2025-10-22T19:38:22.290048] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-22T19:38:22.290465] [DEBUG] [LOCAL ] KWR: Trimmed 23222 records to 15690 (keeping 200 days of data) [2025-10-22T19:38:22.525634] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-22T19:38:22.627288] [DEBUG] [LOCAL ] KWR: Primary data saved (15690 records). [2025-10-22T19:38:22.662768] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-22T19:38:22.682119] [INFO ] [MAIN ] Update Progress: 1230/2367 symbols completed. KWR took 40.6s. Estimated remaining: 2h 26m 20s. Rate: 7.8 symbols/min [2025-10-22T19:38:22.899015] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-22T19:38:22.899212] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-22T19:38:22.905805] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-22T19:38:22.926538] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-22T19:38:22.968993] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:22.988802] [DEBUG] [LOCAL ] L: Trimmed 59427 records to 41146 (keeping 200 days of data) [2025-10-22T19:38:22.990229] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T19:38:23.113322] [DEBUG] [LOCAL ] LAD: Loaded 23222 existing records from primary storage. [2025-10-22T19:38:23.125110] [INFO ] [MAIN ] LAD: Loaded 23222 existing records. [2025-10-22T19:38:23.322099] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-22T19:38:23.422177] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:23.425281] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-22T19:38:23.426364] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-22T19:38:23.434807] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-22T19:38:23.435572] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-22T19:38:23.553181] [DEBUG] [LOCAL ] L: Primary data saved (41146 records). [2025-10-22T19:38:23.555938] [INFO ] [MAIN ] L: Full history saved. [2025-10-22T19:38:23.556046] [INFO ] [MAIN ] Update Progress: 1231/2367 symbols completed. L took 24.2s. Estimated remaining: 2h 26m 6s. Rate: 7.8 symbols/min [2025-10-22T19:38:23.907347] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:23.991865] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:24.020519] [DEBUG] [LOCAL ] LADR: Loaded 39406 existing records from primary storage. [2025-10-22T19:38:24.020869] [INFO ] [MAIN ] LADR: Loaded 39406 existing records. [2025-10-22T19:38:24.119233] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-22T19:38:24.209389] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:24.210950] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-22T19:38:24.211027] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-22T19:38:24.211206] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-22T19:38:24.211246] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-22T19:38:24.587455] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:24.603550] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T19:38:24.638748] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T19:38:24.917638] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-22T19:38:25.717779] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-22T19:38:25.897972] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T19:38:26.517699] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-22T19:38:26.583136] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T19:38:27.137894] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T19:38:27.317631] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-22T19:38:27.774374] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T19:38:27.779895] [INFO ] [REMOTE ] KYN: Full fetch complete (44293 records). [2025-10-22T19:38:27.779997] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-22T19:38:28.121844] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-22T19:38:28.156513] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-22T19:38:28.156602] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-22T19:38:28.157908] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-22T19:38:28.158000] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-22T19:38:28.159138] [DEBUG] [LOCAL ] KYN: Trimmed 44293 records to 30129 (keeping 200 days of data) [2025-10-22T19:38:28.336384] [DEBUG] [LOCAL ] KYN: Primary data saved (30129 records). [2025-10-22T19:38:28.336528] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-22T19:38:28.336615] [INFO ] [MAIN ] Update Progress: 1232/2367 symbols completed. KYN took 32.7s. Estimated remaining: 2h 25m 55s. Rate: 7.8 symbols/min [2025-10-22T19:38:28.532370] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:28.537342] [DEBUG] [LOCAL ] LANV: Loaded 2794 existing records from primary storage. [2025-10-22T19:38:28.537498] [INFO ] [MAIN ] LANV: Loaded 2794 existing records. [2025-10-22T19:38:28.728172] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:28.728401] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-22T19:38:28.728487] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-22T19:38:28.728615] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-22T19:38:28.728686] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-22T19:38:28.923251] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-22T19:38:29.107862] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:29.302678] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-22T19:38:29.602051] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T19:38:29.717686] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-22T19:38:30.241960] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T19:38:30.292607] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T19:38:30.517689] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-22T19:38:31.317728] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-22T19:38:31.807794] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T19:38:32.117713] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-22T19:38:32.917770] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-22T19:38:33.301678] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T19:38:33.470900] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T19:38:33.717692] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-22T19:38:34.183932] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-22T19:38:34.353827] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T19:38:34.517687] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-22T19:38:35.317713] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-22T19:38:36.117678] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-22T19:38:36.513532] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T19:38:36.612813] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T19:38:36.917727] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-22T19:38:37.429610] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T19:38:37.717639] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-22T19:38:38.257421] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T19:38:38.517714] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-22T19:38:38.917343] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T19:38:39.317675] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-22T19:38:39.576975] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T19:38:39.746916] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-22T19:38:40.117691] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-22T19:38:40.917696] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-22T19:38:41.582813] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T19:38:41.717619] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-22T19:38:41.910673] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T19:38:42.517679] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-22T19:38:43.242477] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T19:38:43.317623] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-22T19:38:43.762436] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T19:38:44.117707] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-22T19:38:44.917693] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-22T19:38:45.228063] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T19:38:45.344958] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T19:38:45.717694] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-22T19:38:46.160084] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.84 seconds). [2025-10-22T19:38:46.168929] [INFO ] [REMOTE ] LAC: Full fetch complete (76143 records). [2025-10-22T19:38:46.169050] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-22T19:38:46.522360] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-22T19:38:46.561767] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-22T19:38:46.561845] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-22T19:38:46.562797] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-22T19:38:46.562861] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-22T19:38:46.564218] [DEBUG] [LOCAL ] LAC: Trimmed 76143 records to 52571 (keeping 200 days of data) [2025-10-22T19:38:46.856767] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T19:38:46.883452] [DEBUG] [LOCAL ] LAC: Primary data saved (52571 records). [2025-10-22T19:38:46.883593] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-22T19:38:46.883694] [INFO ] [MAIN ] Update Progress: 1233/2367 symbols completed. LAC took 43.3s. Estimated remaining: 2h 25m 58s. Rate: 7.8 symbols/min [2025-10-22T19:38:46.993433] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T19:38:47.056912] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:47.057073] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-22T19:38:47.057113] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-22T19:38:47.057225] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-22T19:38:47.057266] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-22T19:38:47.057307] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-22T19:38:47.057340] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-22T19:38:47.324997] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-22T19:38:47.409593] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:47.829885] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T19:38:48.117768] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-22T19:38:48.917776] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-22T19:38:49.461025] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-22T19:38:49.684838] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T19:38:49.717606] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-22T19:38:50.517690] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-22T19:38:50.843098] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T19:38:50.960007] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T19:38:51.317684] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-22T19:38:52.117708] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-22T19:38:52.570678] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T19:38:52.575032] [INFO ] [REMOTE ] LAD: Full fetch complete (35560 records). [2025-10-22T19:38:52.575116] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-22T19:38:52.935538] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-22T19:38:52.951470] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-22T19:38:52.951543] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-22T19:38:52.952281] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-22T19:38:52.952470] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-22T19:38:52.953406] [DEBUG] [LOCAL ] LAD: Trimmed 35560 records to 23290 (keeping 200 days of data) [2025-10-22T19:38:53.092778] [DEBUG] [LOCAL ] LAD: Primary data saved (23290 records). [2025-10-22T19:38:53.092904] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-22T19:38:53.092980] [INFO ] [MAIN ] Update Progress: 1234/2367 symbols completed. LAD took 30.4s. Estimated remaining: 2h 25m 49s. Rate: 7.8 symbols/min [2025-10-22T19:38:53.268164] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:53.282034] [DEBUG] [LOCAL ] LAW: Loaded 14777 existing records from primary storage. [2025-10-22T19:38:53.282254] [INFO ] [MAIN ] LAW: Loaded 14777 existing records. [2025-10-22T19:38:53.465240] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:53.465563] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-22T19:38:53.465739] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-22T19:38:53.466002] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-22T19:38:53.466059] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-22T19:38:53.725452] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-22T19:38:53.755011] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T19:38:53.762952] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:38:53.791127] [INFO ] [REMOTE ] LADR: Full fetch complete (55637 records). [2025-10-22T19:38:53.791370] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-22T19:38:53.982306] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:54.259573] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-22T19:38:54.259681] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-22T19:38:54.260564] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-22T19:38:54.260607] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-22T19:38:54.261796] [DEBUG] [LOCAL ] LADR: Trimmed 55637 records to 39334 (keeping 200 days of data) [2025-10-22T19:38:54.364291] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T19:38:54.366161] [INFO ] [REMOTE ] LANV: Full fetch complete (4237 records). [2025-10-22T19:38:54.367528] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-22T19:38:54.542414] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-22T19:38:54.869898] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-22T19:38:54.869693] [DEBUG] [LOCAL ] LADR: Primary data saved (39334 records). [2025-10-22T19:38:54.870105] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-22T19:38:54.870308] [INFO ] [MAIN ] Update Progress: 1235/2367 symbols completed. LADR took 31.3s. Estimated remaining: 2h 25m 35s. Rate: 7.8 symbols/min [2025-10-22T19:38:54.870197] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-22T19:38:54.882035] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-22T19:38:54.882234] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-22T19:38:54.940088] [DEBUG] [LOCAL ] LANV: Trimmed 4237 records to 2784 (keeping 200 days of data) [2025-10-22T19:38:54.987564] [DEBUG] [LOCAL ] LANV: Primary data saved (2784 records). [2025-10-22T19:38:54.987672] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-22T19:38:54.998390] [INFO ] [MAIN ] Update Progress: 1236/2367 symbols completed. LANV took 26.7s. Estimated remaining: 2h 25m 21s. Rate: 7.8 symbols/min [2025-10-22T19:38:55.157592] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:55.227965] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:55.268744] [DEBUG] [LOCAL ] LAZ: Loaded 44474 existing records from primary storage. [2025-10-22T19:38:55.269105] [INFO ] [MAIN ] LAZ: Loaded 44474 existing records. [2025-10-22T19:38:55.324738] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-22T19:38:55.382496] [DEBUG] [LOCAL ] LB: Loaded 37118 existing records from primary storage. [2025-10-22T19:38:55.383673] [INFO ] [MAIN ] LB: Loaded 37118 existing records. [2025-10-22T19:38:55.555537] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:55.575988] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-22T19:38:55.576588] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-22T19:38:55.582281] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-22T19:38:55.582337] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-22T19:38:55.764579] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:55.760258] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T19:38:55.767969] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-22T19:38:55.771476] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-22T19:38:55.777134] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-22T19:38:55.777216] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-22T19:38:56.118281] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-22T19:38:56.321884] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:56.400922] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:56.917665] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-22T19:38:56.976000] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T19:38:57.094840] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T19:38:57.717774] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-22T19:38:58.517775] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-22T19:38:58.729198] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T19:38:59.317669] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-22T19:38:59.368122] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:39:00.125848] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-22T19:39:00.129078] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T19:39:00.917783] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-22T19:39:00.974320] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T19:39:01.717786] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-22T19:39:02.524509] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-22T19:39:02.525561] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T19:39:03.317686] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-22T19:39:03.646171] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (4.33 seconds). [2025-10-22T19:39:04.125150] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-22T19:39:04.152302] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T19:39:04.296758] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T19:39:04.917716] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-22T19:39:05.336841] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (4.42 seconds). [2025-10-22T19:39:05.717628] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-22T19:39:05.819270] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T19:39:06.517775] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-22T19:39:06.963514] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-22T19:39:07.317675] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-22T19:39:07.357128] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T19:39:07.453522] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T19:39:08.117730] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-22T19:39:08.917690] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-22T19:39:08.980243] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T19:39:09.114128] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T19:39:09.717675] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-22T19:39:10.297268] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T19:39:10.517684] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-22T19:39:10.878385] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T19:39:11.317709] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-22T19:39:11.444188] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T19:39:12.117714] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-22T19:39:12.825495] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T19:39:12.917639] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-22T19:39:13.690266] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:39:13.717611] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-22T19:39:14.517675] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-22T19:39:15.317723] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-22T19:39:15.387980] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-22T19:39:15.513133] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T19:39:15.622908] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T19:39:15.626828] [INFO ] [REMOTE ] LAW: Full fetch complete (21158 records). [2025-10-22T19:39:15.626904] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-22T19:39:15.987090] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-22T19:39:15.987164] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-22T19:39:15.987588] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-22T19:39:15.987628] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-22T19:39:15.988243] [DEBUG] [LOCAL ] LAW: Trimmed 21158 records to 14897 (keeping 200 days of data) [2025-10-22T19:39:16.069285] [DEBUG] [LOCAL ] LAW: Primary data saved (14897 records). [2025-10-22T19:39:16.069417] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-22T19:39:16.069505] [INFO ] [MAIN ] Update Progress: 1237/2367 symbols completed. LAW took 23.0s. Estimated remaining: 2h 25m 25s. Rate: 7.8 symbols/min [2025-10-22T19:39:16.117703] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-22T19:39:16.599978] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T19:39:16.917711] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-22T19:39:17.717636] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-22T19:39:17.863424] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:39:18.417544] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T19:39:18.517670] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-22T19:39:19.197764] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T19:39:19.317674] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-22T19:39:19.993189] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T19:39:20.117722] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-22T19:39:20.917669] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-22T19:39:20.966982] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:39:21.189470] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T19:39:21.717706] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-22T19:39:22.517700] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-22T19:39:22.621793] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:39:22.628584] [INFO ] [REMOTE ] LAZ: Full fetch complete (65412 records). [2025-10-22T19:39:22.628745] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-22T19:39:23.014723] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-22T19:39:23.014826] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-22T19:39:23.015807] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-22T19:39:23.015916] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-22T19:39:23.017571] [DEBUG] [LOCAL ] LAZ: Trimmed 65412 records to 44442 (keeping 200 days of data) [2025-10-22T19:39:23.130802] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T19:39:23.311025] [DEBUG] [LOCAL ] LAZ: Primary data saved (44442 records). [2025-10-22T19:39:23.311151] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-22T19:39:23.311226] [INFO ] [MAIN ] Update Progress: 1238/2367 symbols completed. LAZ took 28.4s. Estimated remaining: 2h 25m 17s. Rate: 7.8 symbols/min [2025-10-22T19:39:23.317618] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-22T19:39:24.743738] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-22T19:39:24.752421] [INFO ] [REMOTE ] LAR: Full fetch complete (62465 records). [2025-10-22T19:39:24.752547] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-22T19:39:24.935903] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T19:39:24.976909] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-22T19:39:24.977992] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:39:24.978352] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-22T19:39:24.978432] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:39:24.979265] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-22T19:39:24.979329] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-22T19:39:24.979366] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-22T19:39:24.979405] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-22T19:39:24.979463] [INFO ] [MAIN ] Update Progress: 1239/2367 symbols completed. LAR took 38.1s. Estimated remaining: 2h 25m 4s. Rate: 7.8 symbols/min [2025-10-22T19:39:26.479371] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T19:39:26.486875] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-22T19:39:28.042811] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:39:28.049070] [INFO ] [REMOTE ] LB: Full fetch complete (55825 records). [2025-10-22T19:39:28.049182] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-22T19:39:28.433269] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-22T19:39:28.433601] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-22T19:39:28.434428] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-22T19:39:28.434484] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-22T19:39:28.435660] [DEBUG] [LOCAL ] LB: Trimmed 55825 records to 36982 (keeping 200 days of data) [2025-10-22T19:39:28.661563] [DEBUG] [LOCAL ] LB: Primary data saved (36982 records). [2025-10-22T19:39:28.661731] [INFO ] [MAIN ] LB: Full history saved. [2025-10-22T19:39:28.661816] [INFO ] [MAIN ] Update Progress: 1240/2367 symbols completed. LB took 33.7s. Estimated remaining: 2h 24m 52s. Rate: 7.8 symbols/min [2025-10-22T19:39:29.233893] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:29.271538] [DEBUG] [LOCAL ] LCII: No existing data file found in primary storage. [2025-10-22T19:39:29.305923] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:29.330775] [WARN ] [MAIN ] LCII: No existing data found, performing full refresh instead. [2025-10-22T19:39:29.396265] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:29.401994] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-22T19:39:29.405428] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-22T19:39:29.405140] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:29.405676] [DEBUG] [LOCAL ] LCII: No primary data file found to delete. [2025-10-22T19:39:29.405804] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-22T19:39:29.750566] [DEBUG] [LOCAL ] LDI: Loaded 45083 existing records from primary storage. [2025-10-22T19:39:29.761704] [DEBUG] [LOCAL ] LBRT: Loaded 53003 existing records from primary storage. [2025-10-22T19:39:29.774858] [INFO ] [MAIN ] LDI: Loaded 45083 existing records. [2025-10-22T19:39:29.774710] [INFO ] [MAIN ] LBRT: Loaded 53003 existing records. [2025-10-22T19:39:29.980227] [DEBUG] [LOCAL ] LC: Loaded 48247 existing records from primary storage. [2025-10-22T19:39:29.979541] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:30.021871] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-22T19:39:30.021556] [INFO ] [MAIN ] LC: Loaded 48247 existing records. [2025-10-22T19:39:30.300492] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:30.346843] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-22T19:39:30.346607] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:30.347003] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-22T19:39:30.347339] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-22T19:39:30.347435] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-22T19:39:30.347896] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-22T19:39:30.348085] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-22T19:39:30.353571] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-22T19:39:30.365056] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-22T19:39:30.576535] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:30.606633] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-22T19:39:30.623899] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-22T19:39:30.652217] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-22T19:39:30.665977] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-22T19:39:31.406420] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:31.442795] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:31.477788] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-22T19:39:31.474228] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-22T19:39:31.569684] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T19:39:31.578114] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-22T19:39:31.573173] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:31.579228] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-22T19:39:32.733452] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T19:39:32.738808] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-22T19:39:32.882306] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T19:39:32.888958] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-22T19:39:33.231810] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:39:33.242586] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-22T19:39:33.283485] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T19:39:33.293450] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-22T19:39:33.689154] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T19:39:33.697367] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-22T19:39:34.253707] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T19:39:34.260952] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-22T19:39:34.571465] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T19:39:34.586937] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-22T19:39:34.655534] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T19:39:34.699549] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T19:39:35.317717] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-22T19:39:35.601159] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:39:36.117624] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-22T19:39:36.280917] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T19:39:36.732190] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T19:39:36.917705] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-22T19:39:37.661471] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T19:39:37.717691] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-22T19:39:38.170090] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T19:39:38.517673] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-22T19:39:39.096727] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T19:39:39.317623] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-22T19:39:39.779096] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T19:39:40.117762] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-22T19:39:40.736623] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:39:40.917633] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-22T19:39:41.292369] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T19:39:41.717697] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-22T19:39:42.517730] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-22T19:39:42.603018] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:39:43.200576] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T19:39:43.317700] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-22T19:39:44.117765] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-22T19:39:44.286696] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T19:39:44.402283] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T19:39:44.917696] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-22T19:39:45.523052] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T19:39:45.717677] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-22T19:39:45.773377] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T19:39:45.777300] [INFO ] [REMOTE ] LCII: Full fetch complete (39024 records). [2025-10-22T19:39:45.777409] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-22T19:39:46.140042] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-22T19:39:46.140120] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-22T19:39:46.140805] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-22T19:39:46.140866] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-22T19:39:46.141639] [DEBUG] [LOCAL ] LCII: Trimmed 39024 records to 26860 (keeping 200 days of data) [2025-10-22T19:39:46.302090] [DEBUG] [LOCAL ] LCII: Primary data saved (26860 records). [2025-10-22T19:39:46.302218] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-22T19:39:46.302286] [INFO ] [MAIN ] Update Progress: 1241/2367 symbols completed. LCII took 17.6s. Estimated remaining: 2h 24m 54s. Rate: 7.8 symbols/min [2025-10-22T19:39:46.470058] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:46.509693] [DEBUG] [LOCAL ] LDOS: Loaded 44723 existing records from primary storage. [2025-10-22T19:39:46.509987] [INFO ] [MAIN ] LDOS: Loaded 44723 existing records. [2025-10-22T19:39:46.522974] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-22T19:39:46.684582] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:46.684846] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-22T19:39:46.684893] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-22T19:39:46.685317] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-22T19:39:46.685372] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-22T19:39:47.034486] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:47.211301] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:39:47.317699] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-22T19:39:48.117696] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-22T19:39:48.529597] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T19:39:48.917674] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-22T19:39:49.142438] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T19:39:49.717631] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-22T19:39:49.829261] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T19:39:50.509813] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T19:39:50.518526] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-22T19:39:51.317734] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-22T19:39:51.531462] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T19:39:52.117719] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-22T19:39:52.218357] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:39:52.917730] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-22T19:39:53.489282] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-22T19:39:53.717780] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-22T19:39:53.885322] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T19:39:54.487391] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T19:39:54.517637] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-22T19:39:55.317760] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-22T19:39:55.903776] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T19:39:55.913272] [INFO ] [REMOTE ] LDI: Full fetch complete (62225 records). [2025-10-22T19:39:55.913445] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-22T19:39:56.124595] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-22T19:39:56.356880] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-22T19:39:56.357028] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-22T19:39:56.358291] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-22T19:39:56.358383] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-22T19:39:56.389966] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:39:56.400510] [DEBUG] [LOCAL ] LDI: Trimmed 62225 records to 45123 (keeping 200 days of data) [2025-10-22T19:39:56.657009] [DEBUG] [LOCAL ] LDI: Primary data saved (45123 records). [2025-10-22T19:39:56.657170] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-22T19:39:56.657276] [INFO ] [MAIN ] Update Progress: 1242/2367 symbols completed. LDI took 28.0s. Estimated remaining: 2h 24m 48s. Rate: 7.8 symbols/min [2025-10-22T19:39:56.861807] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:56.894424] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T19:39:56.904156] [INFO ] [REMOTE ] LC: Full fetch complete (70705 records). [2025-10-22T19:39:56.909385] [DEBUG] [LOCAL ] LDP: Loaded 12691 existing records from primary storage. [2025-10-22T19:39:56.909741] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-22T19:39:56.910146] [INFO ] [MAIN ] LDP: Loaded 12691 existing records. [2025-10-22T19:39:56.923345] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-22T19:39:57.258413] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:57.291335] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-22T19:39:57.291482] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-22T19:39:57.295669] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-22T19:39:57.315087] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-22T19:39:57.741622] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-22T19:39:57.760911] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-22T19:39:57.784219] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-22T19:39:57.791458] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-22T19:39:57.838459] [DEBUG] [LOCAL ] LC: Trimmed 70705 records to 48255 (keeping 200 days of data) [2025-10-22T19:39:58.033105] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:58.034057] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-22T19:39:58.040150] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T19:39:58.255279] [DEBUG] [LOCAL ] LC: Primary data saved (48255 records). [2025-10-22T19:39:58.255498] [INFO ] [MAIN ] LC: Full history saved. [2025-10-22T19:39:58.255612] [INFO ] [MAIN ] Update Progress: 1243/2367 symbols completed. LC took 29.6s. Estimated remaining: 2h 24m 35s. Rate: 7.8 symbols/min [2025-10-22T19:39:58.436828] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:58.474212] [DEBUG] [LOCAL ] LEA: Loaded 41237 existing records from primary storage. [2025-10-22T19:39:58.474488] [INFO ] [MAIN ] LEA: Loaded 41237 existing records. [2025-10-22T19:39:58.539576] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-22T19:39:58.660977] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:58.661289] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-22T19:39:58.661390] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-22T19:39:58.661613] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-22T19:39:58.661753] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-22T19:39:58.972516] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-22T19:39:58.970330] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T19:39:59.093707] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:59.317682] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-22T19:40:00.117719] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-22T19:40:00.232428] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T19:40:00.917682] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-22T19:40:00.984546] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T19:40:01.010473] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T19:40:01.717729] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-22T19:40:02.517719] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-22T19:40:02.662891] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:40:02.790853] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T19:40:03.317683] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-22T19:40:04.117671] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-22T19:40:04.305606] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T19:40:04.340961] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T19:40:04.917663] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-22T19:40:05.533105] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T19:40:05.717633] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-22T19:40:05.844240] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-22T19:40:06.517723] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-22T19:40:07.317731] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-22T19:40:07.373355] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T19:40:08.117636] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-22T19:40:08.523266] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T19:40:08.917685] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-22T19:40:08.976995] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T19:40:09.031725] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T19:40:09.717674] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-22T19:40:10.517892] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-22T19:40:10.518832] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T19:40:10.538332] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-22T19:40:11.317696] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-22T19:40:12.097289] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T19:40:12.117624] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-22T19:40:12.205625] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T19:40:12.917729] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-22T19:40:13.715162] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T19:40:13.718361] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-22T19:40:13.761115] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T19:40:14.517679] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-22T19:40:15.317636] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-22T19:40:15.451203] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T19:40:15.453392] [INFO ] [REMOTE ] LDP: Full fetch complete (18722 records). [2025-10-22T19:40:15.453464] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-22T19:40:15.824544] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-22T19:40:15.824624] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-22T19:40:15.825118] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-22T19:40:15.825181] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-22T19:40:15.825730] [DEBUG] [LOCAL ] LDP: Trimmed 18722 records to 12503 (keeping 200 days of data) [2025-10-22T19:40:15.901073] [DEBUG] [LOCAL ] LDP: Primary data saved (12503 records). [2025-10-22T19:40:15.901210] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-22T19:40:15.901289] [INFO ] [MAIN ] Update Progress: 1244/2367 symbols completed. LDP took 19.2s. Estimated remaining: 2h 24m 36s. Rate: 7.8 symbols/min [2025-10-22T19:40:16.066381] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:16.107098] [DEBUG] [LOCAL ] LEG: Loaded 50008 existing records from primary storage. [2025-10-22T19:40:16.107428] [INFO ] [MAIN ] LEG: Loaded 50008 existing records. [2025-10-22T19:40:16.138308] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-22T19:40:16.290367] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:16.290586] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-22T19:40:16.290666] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-22T19:40:16.291032] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-22T19:40:16.291085] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-22T19:40:16.644156] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:16.903991] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T19:40:16.917597] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-22T19:40:17.634934] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (3.92 seconds). [2025-10-22T19:40:17.643552] [INFO ] [REMOTE ] LBRT: Full fetch complete (76523 records). [2025-10-22T19:40:17.643763] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-22T19:40:17.644492] [FATAL] [VALIDATOR ] LBRT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T19:40:17.644598] [FATAL] [MAIN ] LBRT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:40:17.644671] [WARN ] [MAIN ] LBRT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:40:17.644735] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-22T19:40:17.644797] [DEBUG] [LOCAL ] LBRT: No primary data file found to delete. [2025-10-22T19:40:17.644855] [INFO ] [LOCAL ] LBRT: Starting deletion of derivative data. [2025-10-22T19:40:17.645025] [DEBUG] [LOCAL ] LBRT: Deleted derivative data file. [2025-10-22T19:40:17.645120] [INFO ] [MAIN ] Update Progress: 1245/2367 symbols completed. LBRT took 49.0s. Estimated remaining: 2h 24m 23s. Rate: 7.8 symbols/min [2025-10-22T19:40:17.722796] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-22T19:40:17.825408] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:17.860049] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:40:17.907596] [DEBUG] [LOCAL ] LEN: Loaded 53200 existing records from primary storage. [2025-10-22T19:40:17.908069] [INFO ] [MAIN ] LEN: Loaded 53200 existing records. [2025-10-22T19:40:18.086321] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:18.086583] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-22T19:40:18.086662] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-22T19:40:18.086960] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-22T19:40:18.087015] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-22T19:40:18.446348] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:18.517672] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-22T19:40:18.656675] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T19:40:19.317636] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-22T19:40:19.480053] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T19:40:20.117625] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-22T19:40:20.275419] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T19:40:20.577161] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T19:40:20.917884] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-22T19:40:21.576383] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T19:40:21.583165] [INFO ] [REMOTE ] LDOS: Full fetch complete (66952 records). [2025-10-22T19:40:21.583298] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-22T19:40:21.722872] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-22T19:40:21.985595] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-22T19:40:21.985740] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-22T19:40:21.986735] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-22T19:40:21.986800] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-22T19:40:21.988189] [DEBUG] [LOCAL ] LDOS: Trimmed 66952 records to 44631 (keeping 200 days of data) [2025-10-22T19:40:22.273314] [DEBUG] [LOCAL ] LDOS: Primary data saved (44631 records). [2025-10-22T19:40:22.273583] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-22T19:40:22.273736] [INFO ] [MAIN ] Update Progress: 1246/2367 symbols completed. LDOS took 36.0s. Estimated remaining: 2h 24m 13s. Rate: 7.8 symbols/min [2025-10-22T19:40:22.442302] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:22.481121] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T19:40:22.503818] [DEBUG] [LOCAL ] LEO: Loaded 16799 existing records from primary storage. [2025-10-22T19:40:22.504107] [INFO ] [MAIN ] LEO: Loaded 16799 existing records. [2025-10-22T19:40:22.528468] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-22T19:40:22.730143] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:22.730508] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-22T19:40:22.730564] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-22T19:40:22.730910] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-22T19:40:22.730972] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-22T19:40:23.107698] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:23.317631] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-22T19:40:23.554313] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T19:40:24.117682] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-22T19:40:24.288852] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T19:40:24.897685] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T19:40:24.917622] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-22T19:40:24.970550] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:40:25.717696] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-22T19:40:26.049921] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:40:26.517678] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-22T19:40:27.317720] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-22T19:40:27.374092] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T19:40:27.380713] [INFO ] [REMOTE ] LEA: Full fetch complete (60513 records). [2025-10-22T19:40:27.380812] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-22T19:40:27.753773] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-22T19:40:27.753853] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-22T19:40:27.754691] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-22T19:40:27.754753] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-22T19:40:27.755932] [DEBUG] [LOCAL ] LEA: Trimmed 60513 records to 41127 (keeping 200 days of data) [2025-10-22T19:40:28.003070] [DEBUG] [LOCAL ] LEA: Primary data saved (41127 records). [2025-10-22T19:40:28.003189] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-22T19:40:28.003263] [INFO ] [MAIN ] Update Progress: 1247/2367 symbols completed. LEA took 29.7s. Estimated remaining: 2h 24m 3s. Rate: 7.8 symbols/min [2025-10-22T19:40:28.127885] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-22T19:40:28.178268] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:28.225941] [DEBUG] [LOCAL ] LEVI: Loaded 51823 existing records from primary storage. [2025-10-22T19:40:28.226236] [INFO ] [MAIN ] LEVI: Loaded 51823 existing records. [2025-10-22T19:40:28.404107] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:28.404565] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-22T19:40:28.404636] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-22T19:40:28.404943] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-22T19:40:28.405057] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-22T19:40:28.733272] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-22T19:40:28.826602] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:28.917673] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-22T19:40:29.223884] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T19:40:29.255954] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T19:40:29.717795] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-22T19:40:30.517675] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-22T19:40:30.790685] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T19:40:30.818204] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T19:40:31.317678] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-22T19:40:32.117719] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-22T19:40:32.357777] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T19:40:32.763896] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T19:40:32.917691] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-22T19:40:33.004631] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T19:40:33.717707] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-22T19:40:34.517701] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-22T19:40:34.562219] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T19:40:34.683238] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T19:40:35.317670] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-22T19:40:36.117720] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-22T19:40:36.381285] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T19:40:36.917727] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-22T19:40:36.947506] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T19:40:37.717677] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-22T19:40:37.751972] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T19:40:37.912309] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T19:40:38.517686] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-22T19:40:39.317768] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-22T19:40:39.746621] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T19:40:40.118866] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-22T19:40:40.124774] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T19:40:40.917712] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-22T19:40:41.027464] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T19:40:41.047322] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T19:40:41.717634] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-22T19:40:42.523681] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-22T19:40:42.529302] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T19:40:42.719561] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:40:43.317705] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-22T19:40:44.117693] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-22T19:40:44.395799] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T19:40:44.917692] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-22T19:40:45.307045] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T19:40:45.377860] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T19:40:45.569298] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-22T19:40:45.572347] [INFO ] [REMOTE ] LEO: Full fetch complete (26506 records). [2025-10-22T19:40:45.572432] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-22T19:40:45.726422] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-22T19:40:45.948022] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-22T19:40:45.948102] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-22T19:40:45.948666] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-22T19:40:45.948730] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-22T19:40:45.949417] [DEBUG] [LOCAL ] LEO: Trimmed 26506 records to 16855 (keeping 200 days of data) [2025-10-22T19:40:46.042328] [DEBUG] [LOCAL ] LEO: Primary data saved (16855 records). [2025-10-22T19:40:46.042451] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-22T19:40:46.042527] [INFO ] [MAIN ] Update Progress: 1248/2367 symbols completed. LEO took 23.8s. Estimated remaining: 2h 24m 5s. Rate: 7.8 symbols/min [2025-10-22T19:40:46.210675] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:46.228386] [DEBUG] [LOCAL ] LFT: Loaded 18162 existing records from primary storage. [2025-10-22T19:40:46.228613] [INFO ] [MAIN ] LFT: Loaded 18162 existing records. [2025-10-22T19:40:46.402605] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:46.402820] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-22T19:40:46.402867] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-22T19:40:46.403026] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-22T19:40:46.403064] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-22T19:40:46.522836] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-22T19:40:46.760254] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:47.317761] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-22T19:40:47.615079] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T19:40:48.117776] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-22T19:40:48.278052] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:40:48.917732] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-22T19:40:49.099281] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T19:40:49.702097] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-22T19:40:49.711139] [INFO ] [REMOTE ] LEN: Full fetch complete (77216 records). [2025-10-22T19:40:49.711306] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-22T19:40:49.723362] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-22T19:40:50.104203] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-22T19:40:50.104386] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-22T19:40:50.105726] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-22T19:40:50.105797] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-22T19:40:50.107476] [DEBUG] [LOCAL ] LEN: Trimmed 77216 records to 53196 (keeping 200 days of data) [2025-10-22T19:40:50.475769] [DEBUG] [LOCAL ] LEN: Primary data saved (53196 records). [2025-10-22T19:40:50.475979] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-22T19:40:50.476630] [INFO ] [MAIN ] Update Progress: 1249/2367 symbols completed. LEN took 32.8s. Estimated remaining: 2h 23m 54s. Rate: 7.8 symbols/min [2025-10-22T19:40:50.510738] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T19:40:50.531853] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-22T19:40:50.662534] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:50.670775] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T19:40:50.682294] [DEBUG] [LOCAL ] LGI: Loaded 10022 existing records from primary storage. [2025-10-22T19:40:50.682520] [INFO ] [MAIN ] LGI: Loaded 10022 existing records. [2025-10-22T19:40:50.855435] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:50.855632] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-22T19:40:50.855722] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-22T19:40:50.855937] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-22T19:40:50.855977] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-22T19:40:51.205884] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:51.317630] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-22T19:40:52.117674] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-22T19:40:52.247332] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:40:52.342293] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T19:40:52.917698] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-22T19:40:53.717635] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-22T19:40:53.812882] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T19:40:54.444125] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T19:40:54.517681] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-22T19:40:54.691272] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T19:40:54.699347] [INFO ] [REMOTE ] LEG: Full fetch complete (72814 records). [2025-10-22T19:40:54.699448] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-22T19:40:55.072684] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-22T19:40:55.072772] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-22T19:40:55.073593] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-22T19:40:55.073634] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-22T19:40:55.074966] [DEBUG] [LOCAL ] LEG: Trimmed 72814 records to 49950 (keeping 200 days of data) [2025-10-22T19:40:55.334420] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-22T19:40:55.370457] [DEBUG] [LOCAL ] LEG: Primary data saved (49950 records). [2025-10-22T19:40:55.371053] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-22T19:40:55.371176] [INFO ] [MAIN ] Update Progress: 1250/2367 symbols completed. LEG took 39.5s. Estimated remaining: 2h 23m 44s. Rate: 7.8 symbols/min [2025-10-22T19:40:55.533868] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T19:40:55.551149] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:55.590156] [DEBUG] [LOCAL ] LH: Loaded 37192 existing records from primary storage. [2025-10-22T19:40:55.590458] [INFO ] [MAIN ] LH: Loaded 37192 existing records. [2025-10-22T19:40:55.769168] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:55.769384] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-22T19:40:55.769432] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-22T19:40:55.769620] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-22T19:40:55.769712] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-22T19:40:56.119159] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:56.119244] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-22T19:40:56.157375] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T19:40:56.917726] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-22T19:40:57.717732] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-22T19:40:57.767532] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T19:40:58.413206] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T19:40:58.517610] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-22T19:40:58.776601] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T19:40:59.317699] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-22T19:41:00.021475] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:41:00.120791] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-22T19:41:00.124399] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T19:41:00.917696] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-22T19:41:01.717720] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-22T19:41:01.817678] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T19:41:02.087248] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T19:41:02.517657] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-22T19:41:02.665862] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T19:41:03.317683] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-22T19:41:04.117714] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-22T19:41:04.173613] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T19:41:04.895669] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T19:41:04.917612] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-22T19:41:05.087302] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T19:41:05.097462] [INFO ] [REMOTE ] LEVI: Full fetch complete (74996 records). [2025-10-22T19:41:05.097793] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-22T19:41:05.498879] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-22T19:41:05.498992] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-22T19:41:05.500045] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-22T19:41:05.500114] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-22T19:41:05.501631] [DEBUG] [LOCAL ] LEVI: Trimmed 74996 records to 51827 (keeping 200 days of data) [2025-10-22T19:41:05.720724] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-22T19:41:05.721261] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T19:41:05.840674] [DEBUG] [LOCAL ] LEVI: Primary data saved (51827 records). [2025-10-22T19:41:05.840838] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-22T19:41:05.840924] [INFO ] [MAIN ] Update Progress: 1251/2367 symbols completed. LEVI took 37.8s. Estimated remaining: 2h 23m 39s. Rate: 7.8 symbols/min [2025-10-22T19:41:06.011616] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:06.054931] [DEBUG] [LOCAL ] LHX: Loaded 48528 existing records from primary storage. [2025-10-22T19:41:06.055262] [INFO ] [MAIN ] LHX: Loaded 48528 existing records. [2025-10-22T19:41:06.226088] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:06.226339] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-22T19:41:06.226398] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-22T19:41:06.226860] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-22T19:41:06.226917] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-22T19:41:06.519561] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-22T19:41:06.580172] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:06.904639] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T19:41:07.317698] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-22T19:41:08.120690] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-22T19:41:08.126087] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T19:41:08.917735] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-22T19:41:09.020819] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T19:41:09.208956] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:41:09.717675] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-22T19:41:10.447800] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:41:10.517684] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-22T19:41:10.814449] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:41:11.317717] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-22T19:41:12.117682] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-22T19:41:12.539585] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T19:41:12.557390] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T19:41:12.917677] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-22T19:41:13.634388] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-22T19:41:13.717715] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-22T19:41:13.788472] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T19:41:14.517702] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-22T19:41:15.317704] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-22T19:41:15.383442] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T19:41:16.117701] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-22T19:41:16.186535] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T19:41:16.329276] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T19:41:16.331675] [INFO ] [REMOTE ] LGI: Full fetch complete (14448 records). [2025-10-22T19:41:16.331757] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-22T19:41:16.693307] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-22T19:41:16.693412] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-22T19:41:16.693784] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-22T19:41:16.693843] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-22T19:41:16.694341] [DEBUG] [LOCAL ] LGI: Trimmed 14448 records to 9951 (keeping 200 days of data) [2025-10-22T19:41:16.756267] [DEBUG] [LOCAL ] LGI: Primary data saved (9951 records). [2025-10-22T19:41:16.756403] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-22T19:41:16.756482] [INFO ] [MAIN ] Update Progress: 1252/2367 symbols completed. LGI took 26.3s. Estimated remaining: 2h 23m 34s. Rate: 7.8 symbols/min [2025-10-22T19:41:16.923263] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:16.922280] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-22T19:41:16.950055] [DEBUG] [LOCAL ] LII: Loaded 27758 existing records from primary storage. [2025-10-22T19:41:16.950453] [INFO ] [MAIN ] LII: Loaded 27758 existing records. [2025-10-22T19:41:17.126909] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:17.136348] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-22T19:41:17.136771] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:41:17.140486] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-22T19:41:17.141145] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-22T19:41:17.141202] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-22T19:41:17.506175] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:17.717681] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-22T19:41:18.337069] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:41:18.517679] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-22T19:41:18.714605] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T19:41:19.317668] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-22T19:41:19.978392] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T19:41:20.009711] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-22T19:41:20.012480] [INFO ] [REMOTE ] LFT: Full fetch complete (23785 records). [2025-10-22T19:41:20.012553] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-22T19:41:20.122722] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-22T19:41:20.370066] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-22T19:41:20.370145] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-22T19:41:20.370613] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-22T19:41:20.370679] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-22T19:41:20.371305] [DEBUG] [LOCAL ] LFT: Trimmed 23785 records to 18119 (keeping 200 days of data) [2025-10-22T19:41:20.473287] [DEBUG] [LOCAL ] LFT: Primary data saved (18119 records). [2025-10-22T19:41:20.473419] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-22T19:41:20.473498] [INFO ] [MAIN ] Update Progress: 1253/2367 symbols completed. LFT took 34.4s. Estimated remaining: 2h 23m 22s. Rate: 7.8 symbols/min [2025-10-22T19:41:20.639290] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:20.678176] [DEBUG] [LOCAL ] LION: Loaded 46849 existing records from primary storage. [2025-10-22T19:41:20.678460] [INFO ] [MAIN ] LION: Loaded 46849 existing records. [2025-10-22T19:41:20.877013] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:20.877240] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-22T19:41:20.877286] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-22T19:41:20.877560] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-22T19:41:20.877617] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-22T19:41:20.922735] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-22T19:41:21.221737] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:21.515911] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T19:41:21.717630] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-22T19:41:22.101181] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:41:22.517729] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-22T19:41:23.317697] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-22T19:41:23.592381] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T19:41:23.630244] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T19:41:24.117693] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-22T19:41:24.689370] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T19:41:24.917673] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-22T19:41:25.717763] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-22T19:41:25.825874] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T19:41:25.831804] [INFO ] [REMOTE ] LH: Full fetch complete (54871 records). [2025-10-22T19:41:25.831977] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-22T19:41:26.218240] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-22T19:41:26.218443] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-22T19:41:26.219503] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-22T19:41:26.219710] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-22T19:41:26.220999] [DEBUG] [LOCAL ] LH: Trimmed 54871 records to 37024 (keeping 200 days of data) [2025-10-22T19:41:26.472724] [DEBUG] [LOCAL ] LH: Primary data saved (37024 records). [2025-10-22T19:41:26.496441] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T19:41:26.496634] [INFO ] [MAIN ] LH: Full history saved. [2025-10-22T19:41:26.503859] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T19:41:26.503962] [INFO ] [MAIN ] Update Progress: 1254/2367 symbols completed. LH took 31.1s. Estimated remaining: 2h 23m 13s. Rate: 7.8 symbols/min [2025-10-22T19:41:26.522147] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-22T19:41:26.679762] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:26.685748] [DEBUG] [LOCAL ] LITB: Loaded 3861 existing records from primary storage. [2025-10-22T19:41:26.685925] [INFO ] [MAIN ] LITB: Loaded 3861 existing records. [2025-10-22T19:41:26.857955] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:26.858126] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-22T19:41:26.858172] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-22T19:41:26.858286] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-22T19:41:26.858323] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-22T19:41:27.199957] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:27.317611] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-22T19:41:27.663140] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T19:41:28.079580] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T19:41:28.117779] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-22T19:41:28.580476] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T19:41:28.917724] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-22T19:41:29.717634] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-22T19:41:30.233400] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T19:41:30.517731] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-22T19:41:30.628541] [DEBUG] [REMOTE ] LITB: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-22T19:41:30.628907] [WARN ] [REMOTE ] LITB: No data returned for month 2025-03 [2025-10-22T19:41:30.628996] [FATAL] [REMOTE ] LITB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:41:30.629068] [FATAL] [MAIN ] LITB: Failed to fetch primary data. [2025-10-22T19:41:30.629130] [WARN ] [MAIN ] LITB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:41:30.629201] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-22T19:41:30.629266] [DEBUG] [LOCAL ] LITB: No primary data file found to delete. [2025-10-22T19:41:30.629300] [INFO ] [LOCAL ] LITB: Starting deletion of derivative data. [2025-10-22T19:41:30.629430] [DEBUG] [LOCAL ] LITB: Deleted derivative data file. [2025-10-22T19:41:30.629511] [INFO ] [MAIN ] Update Progress: 1255/2367 symbols completed. LITB took 4.1s. Estimated remaining: 2h 23m 2s. Rate: 7.8 symbols/min [2025-10-22T19:41:30.799265] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:30.846991] [DEBUG] [LOCAL ] LLY: Loaded 53192 existing records from primary storage. [2025-10-22T19:41:30.847286] [INFO ] [MAIN ] LLY: Loaded 53192 existing records. [2025-10-22T19:41:31.024452] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:31.024810] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-22T19:41:31.024878] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-22T19:41:31.025157] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-22T19:41:31.025241] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-22T19:41:31.140740] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:41:31.318187] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-22T19:41:31.395713] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:32.117698] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-22T19:41:32.917637] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-22T19:41:33.044444] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T19:41:33.339072] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T19:41:33.717669] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-22T19:41:34.517776] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-22T19:41:35.288945] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-22T19:41:35.317605] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-22T19:41:35.655937] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T19:41:35.882415] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T19:41:36.117729] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-22T19:41:36.917637] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-22T19:41:37.311389] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T19:41:37.470237] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-22T19:41:37.717717] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-22T19:41:38.517709] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-22T19:41:38.568955] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T19:41:38.980708] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T19:41:39.317683] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-22T19:41:40.117812] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-22T19:41:40.868901] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-22T19:41:40.917693] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-22T19:41:41.015993] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T19:41:41.717637] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-22T19:41:41.961564] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T19:41:42.312487] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T19:41:42.317601] [INFO ] [REMOTE ] LII: Full fetch complete (41902 records). [2025-10-22T19:41:42.317721] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-22T19:41:42.523710] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-22T19:41:42.689179] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-22T19:41:42.689258] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-22T19:41:42.689963] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-22T19:41:42.690024] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-22T19:41:42.690834] [DEBUG] [LOCAL ] LII: Trimmed 41902 records to 27810 (keeping 200 days of data) [2025-10-22T19:41:42.861279] [DEBUG] [LOCAL ] LII: Primary data saved (27810 records). [2025-10-22T19:41:42.861402] [INFO ] [MAIN ] LII: Full history saved. [2025-10-22T19:41:42.861478] [INFO ] [MAIN ] Update Progress: 1256/2367 symbols completed. LII took 26.1s. Estimated remaining: 2h 22m 59s. Rate: 7.8 symbols/min [2025-10-22T19:41:43.027620] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:43.075575] [DEBUG] [LOCAL ] LMND: Loaded 52124 existing records from primary storage. [2025-10-22T19:41:43.075929] [INFO ] [MAIN ] LMND: Loaded 52124 existing records. [2025-10-22T19:41:43.253832] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:43.254057] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-22T19:41:43.254141] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-22T19:41:43.254516] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-22T19:41:43.254555] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-22T19:41:43.322111] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-22T19:41:43.634353] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:43.636539] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T19:41:44.117681] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-22T19:41:44.413706] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T19:41:44.917693] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-22T19:41:45.717699] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-22T19:41:45.867223] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-22T19:41:46.097165] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T19:41:46.517698] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-22T19:41:46.633535] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:41:47.048233] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T19:41:47.317703] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-22T19:41:48.076321] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:41:48.117674] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-22T19:41:48.917632] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-22T19:41:49.144719] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T19:41:49.152335] [INFO ] [REMOTE ] LHX: Full fetch complete (70811 records). [2025-10-22T19:41:49.152450] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-22T19:41:49.535406] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-22T19:41:49.535485] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-22T19:41:49.536414] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-22T19:41:49.536477] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-22T19:41:49.537954] [DEBUG] [LOCAL ] LHX: Trimmed 70811 records to 48471 (keeping 200 days of data) [2025-10-22T19:41:49.722951] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-22T19:41:49.838237] [DEBUG] [LOCAL ] LHX: Primary data saved (48471 records). [2025-10-22T19:41:49.838417] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-22T19:41:49.838543] [INFO ] [MAIN ] Update Progress: 1257/2367 symbols completed. LHX took 44.0s. Estimated remaining: 2h 22m 50s. Rate: 7.8 symbols/min [2025-10-22T19:41:50.016780] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:50.059716] [DEBUG] [LOCAL ] LMT: Loaded 49628 existing records from primary storage. [2025-10-22T19:41:50.060033] [INFO ] [MAIN ] LMT: Loaded 49628 existing records. [2025-10-22T19:41:50.236170] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:50.236449] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-22T19:41:50.236531] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-22T19:41:50.236769] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-22T19:41:50.236936] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-22T19:41:50.472905] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:41:50.551983] [INFO ] [REMOTE ] LION: Full fetch complete (57992 records). [2025-10-22T19:41:50.573202] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-22T19:41:50.632196] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:50.632762] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-22T19:41:51.046814] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-22T19:41:51.046918] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-22T19:41:51.047896] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-22T19:41:51.047998] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-22T19:41:51.076919] [DEBUG] [LOCAL ] LION: Trimmed 57992 records to 46933 (keeping 200 days of data) [2025-10-22T19:41:51.078669] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-10-22T19:41:51.325402] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-22T19:41:51.350795] [DEBUG] [LOCAL ] LION: Primary data saved (46933 records). [2025-10-22T19:41:51.350916] [INFO ] [MAIN ] LION: Full history saved. [2025-10-22T19:41:51.351022] [INFO ] [MAIN ] Update Progress: 1258/2367 symbols completed. LION took 30.9s. Estimated remaining: 2h 22m 37s. Rate: 7.8 symbols/min [2025-10-22T19:41:51.528463] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:51.601065] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T19:41:51.612846] [DEBUG] [LOCAL ] LNC: Loaded 51488 existing records from primary storage. [2025-10-22T19:41:51.614093] [INFO ] [MAIN ] LNC: Loaded 51488 existing records. [2025-10-22T19:41:51.789891] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:51.790090] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-22T19:41:51.790136] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-22T19:41:51.790344] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-22T19:41:51.790398] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-22T19:41:52.122835] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-22T19:41:52.158859] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:52.670435] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T19:41:52.917681] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-22T19:41:53.717681] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-22T19:41:53.942570] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-22T19:41:54.052805] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T19:41:54.517721] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-22T19:41:54.596395] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:41:55.317788] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-22T19:41:55.735986] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-22T19:41:56.117719] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-22T19:41:56.917708] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-22T19:41:56.983252] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T19:41:57.128704] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-22T19:41:57.717705] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-22T19:41:58.279314] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-22T19:41:58.522960] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-22T19:41:58.535461] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T19:41:59.317623] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-22T19:41:59.498287] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T19:42:00.117637] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-22T19:42:00.917770] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-22T19:42:01.447155] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-10-22T19:42:01.707940] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-22T19:42:01.718432] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-22T19:42:02.248707] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T19:42:02.517633] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-22T19:42:02.844545] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T19:42:03.317688] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-22T19:42:04.117638] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-22T19:42:04.411686] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-22T19:42:04.731518] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-22T19:42:04.917617] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-22T19:42:05.189930] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T19:42:05.717685] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-22T19:42:06.270819] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T19:42:06.517725] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-22T19:42:06.671663] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:42:07.317667] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-22T19:42:07.411868] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T19:42:07.437575] [INFO ] [REMOTE ] LLY: Full fetch complete (77209 records). [2025-10-22T19:42:07.447966] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-22T19:42:07.450375] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T19:42:07.899551] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-22T19:42:07.899720] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-22T19:42:07.900942] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-22T19:42:07.901008] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-22T19:42:07.902754] [DEBUG] [LOCAL ] LLY: Trimmed 77209 records to 53191 (keeping 200 days of data) [2025-10-22T19:42:08.119819] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-22T19:42:08.242492] [DEBUG] [LOCAL ] LLY: Primary data saved (53191 records). [2025-10-22T19:42:08.242633] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-22T19:42:08.242753] [INFO ] [MAIN ] Update Progress: 1259/2367 symbols completed. LLY took 37.6s. Estimated remaining: 2h 22m 37s. Rate: 7.8 symbols/min [2025-10-22T19:42:08.411014] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:08.416776] [DEBUG] [LOCAL ] LND: Loaded 4930 existing records from primary storage. [2025-10-22T19:42:08.416943] [INFO ] [MAIN ] LND: Loaded 4930 existing records. [2025-10-22T19:42:08.591243] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:08.591522] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-22T19:42:08.591571] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-22T19:42:08.591754] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-22T19:42:08.591814] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-22T19:42:08.925511] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-22T19:42:08.959023] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:09.461090] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-22T19:42:09.717711] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-22T19:42:10.418533] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-22T19:42:10.517734] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-22T19:42:10.643270] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T19:42:10.896737] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T19:42:11.317765] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-22T19:42:12.117675] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-22T19:42:12.923704] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-22T19:42:12.940555] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-22T19:42:13.612508] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T19:42:13.621765] [INFO ] [REMOTE ] LMND: Full fetch complete (75467 records). [2025-10-22T19:42:13.622014] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-22T19:42:13.702279] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T19:42:13.728861] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-22T19:42:13.944026] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T19:42:14.055632] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-22T19:42:14.055736] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-22T19:42:14.056677] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-22T19:42:14.056740] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-22T19:42:14.058153] [DEBUG] [LOCAL ] LMND: Trimmed 75467 records to 52122 (keeping 200 days of data) [2025-10-22T19:42:14.364824] [DEBUG] [LOCAL ] LMND: Primary data saved (52122 records). [2025-10-22T19:42:14.364971] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-22T19:42:14.365578] [INFO ] [MAIN ] Update Progress: 1260/2367 symbols completed. LMND took 31.5s. Estimated remaining: 2h 22m 28s. Rate: 7.8 symbols/min [2025-10-22T19:42:14.531529] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-22T19:42:14.534062] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:14.582002] [DEBUG] [LOCAL ] LNG: Loaded 51114 existing records from primary storage. [2025-10-22T19:42:14.582381] [INFO ] [MAIN ] LNG: Loaded 51114 existing records. [2025-10-22T19:42:14.754303] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:14.754476] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-22T19:42:14.754521] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-22T19:42:14.754813] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-22T19:42:14.754875] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-22T19:42:15.105523] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:15.149777] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T19:42:15.317609] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-22T19:42:15.733998] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T19:42:16.117688] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-22T19:42:16.917768] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-22T19:42:16.927096] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T19:42:17.717714] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-22T19:42:17.799972] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-22T19:42:18.498356] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T19:42:18.517621] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-22T19:42:18.867675] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T19:42:18.885105] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T19:42:19.317637] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-22T19:42:20.117722] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-22T19:42:20.917670] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-22T19:42:21.199748] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T19:42:21.717724] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-22T19:42:22.140328] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T19:42:22.389839] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-22T19:42:22.517708] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-22T19:42:22.941770] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T19:42:22.950356] [INFO ] [REMOTE ] LNC: Full fetch complete (74585 records). [2025-10-22T19:42:22.950513] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-22T19:42:23.335395] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-22T19:42:23.361134] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-22T19:42:23.361225] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-22T19:42:23.362235] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-22T19:42:23.362306] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-22T19:42:23.363955] [DEBUG] [LOCAL ] LNC: Trimmed 74585 records to 51466 (keeping 200 days of data) [2025-10-22T19:42:23.685552] [DEBUG] [LOCAL ] LNC: Primary data saved (51466 records). [2025-10-22T19:42:23.685704] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-22T19:42:23.685794] [INFO ] [MAIN ] Update Progress: 1261/2367 symbols completed. LNC took 32.3s. Estimated remaining: 2h 22m 22s. Rate: 7.8 symbols/min [2025-10-22T19:42:23.874776] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:23.888429] [DEBUG] [LOCAL ] LNN: Loaded 11431 existing records from primary storage. [2025-10-22T19:42:23.888639] [INFO ] [MAIN ] LNN: Loaded 11431 existing records. [2025-10-22T19:42:24.078417] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T19:42:24.078145] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:24.080439] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-22T19:42:24.080835] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-22T19:42:24.081028] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-22T19:42:24.081069] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-22T19:42:24.122867] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-22T19:42:24.433608] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:24.762344] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T19:42:24.917638] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-22T19:42:24.963339] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-22T19:42:24.971524] [INFO ] [REMOTE ] LMT: Full fetch complete (72581 records). [2025-10-22T19:42:24.971693] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-22T19:42:25.379555] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-22T19:42:25.379633] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-22T19:42:25.380563] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-22T19:42:25.380612] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-22T19:42:25.381880] [DEBUG] [LOCAL ] LMT: Trimmed 72581 records to 49623 (keeping 200 days of data) [2025-10-22T19:42:25.678222] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T19:42:25.682548] [INFO ] [REMOTE ] LND: Full fetch complete (7819 records). [2025-10-22T19:42:25.684454] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-22T19:42:25.722526] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-22T19:42:25.783601] [DEBUG] [LOCAL ] LMT: Primary data saved (49623 records). [2025-10-22T19:42:25.802840] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-22T19:42:25.813954] [INFO ] [MAIN ] Update Progress: 1262/2367 symbols completed. LMT took 36.0s. Estimated remaining: 2h 22m 9s. Rate: 7.8 symbols/min [2025-10-22T19:42:26.176693] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:26.259041] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-22T19:42:26.259125] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-22T19:42:26.259308] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-22T19:42:26.259347] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-22T19:42:26.259839] [DEBUG] [LOCAL ] LND: Trimmed 7819 records to 4960 (keeping 200 days of data) [2025-10-22T19:42:26.297218] [DEBUG] [LOCAL ] LND: Primary data saved (4960 records). [2025-10-22T19:42:26.297402] [INFO ] [MAIN ] LND: Full history saved. [2025-10-22T19:42:26.297495] [INFO ] [MAIN ] Update Progress: 1263/2367 symbols completed. LND took 18.1s. Estimated remaining: 2h 21m 55s. Rate: 7.8 symbols/min [2025-10-22T19:42:26.420419] [DEBUG] [LOCAL ] LOAR: Loaded 42020 existing records from primary storage. [2025-10-22T19:42:26.436106] [INFO ] [MAIN ] LOAR: Loaded 42020 existing records. [2025-10-22T19:42:26.558440] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-22T19:42:26.560149] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:26.683160] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:26.683419] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-22T19:42:26.683469] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-22T19:42:26.683723] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-22T19:42:26.683790] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-22T19:42:26.800633] [DEBUG] [LOCAL ] LOB: Loaded 26778 existing records from primary storage. [2025-10-22T19:42:26.811625] [INFO ] [MAIN ] LOB: Loaded 26778 existing records. [2025-10-22T19:42:27.006585] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T19:42:27.193259] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:27.203730] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-22T19:42:27.208876] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-22T19:42:27.237861] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-22T19:42:27.246416] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-22T19:42:27.300416] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:27.325693] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-22T19:42:27.625128] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:28.117699] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-22T19:42:28.488372] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T19:42:28.635213] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T19:42:28.790736] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-22T19:42:28.917734] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-22T19:42:29.717718] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-22T19:42:29.987187] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T19:42:30.517685] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-22T19:42:30.587913] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T19:42:31.317722] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-22T19:42:32.117728] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-22T19:42:32.463267] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T19:42:32.479554] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T19:42:32.917721] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-22T19:42:33.071762] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T19:42:33.717685] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-22T19:42:34.175605] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T19:42:34.517662] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-22T19:42:34.954099] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T19:42:35.317685] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-22T19:42:36.117677] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-22T19:42:36.336282] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T19:42:36.747384] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:42:36.917629] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-22T19:42:37.511425] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T19:42:37.717620] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-22T19:42:38.004481] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T19:42:38.517722] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-22T19:42:39.326837] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-22T19:42:39.333042] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T19:42:39.378154] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T19:42:40.117695] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-22T19:42:40.918332] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-22T19:42:40.919872] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T19:42:41.116145] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:42:41.717623] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-22T19:42:42.138308] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T19:42:42.517697] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-22T19:42:42.974752] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T19:42:43.317690] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-22T19:42:43.927815] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T19:42:44.117674] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-22T19:42:44.546718] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T19:42:44.917720] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-22T19:42:45.609878] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:42:45.717727] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-22T19:42:46.517686] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-22T19:42:46.808269] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T19:42:47.317675] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-22T19:42:47.423094] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-22T19:42:47.592049] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T19:42:48.117634] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-22T19:42:48.346152] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T19:42:48.917683] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-22T19:42:49.640169] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T19:42:49.640476] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T19:42:49.717695] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-22T19:42:50.517713] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-22T19:42:50.608639] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:42:51.317692] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-22T19:42:52.117735] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-22T19:42:52.358088] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T19:42:52.517917] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T19:42:52.917699] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-22T19:42:53.253592] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T19:42:53.717719] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-22T19:42:54.517718] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-22T19:42:54.804882] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T19:42:54.814448] [INFO ] [REMOTE ] LNG: Full fetch complete (74682 records). [2025-10-22T19:42:54.814747] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-22T19:42:54.957717] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T19:42:54.985168] [INFO ] [REMOTE ] LNN: Full fetch complete (16156 records). [2025-10-22T19:42:55.014254] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-22T19:42:55.321734] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-22T19:42:55.519812] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-22T19:42:55.532562] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-22T19:42:55.534307] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-22T19:42:55.540406] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-22T19:42:55.584352] [DEBUG] [LOCAL ] LNG: Trimmed 74682 records to 51063 (keeping 200 days of data) [2025-10-22T19:42:55.724498] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-22T19:42:55.750663] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-22T19:42:55.753060] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-22T19:42:55.753139] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-22T19:42:55.760808] [DEBUG] [LOCAL ] LNN: Trimmed 16156 records to 11504 (keeping 200 days of data) [2025-10-22T19:42:55.956489] [DEBUG] [LOCAL ] LNN: Primary data saved (11504 records). [2025-10-22T19:42:55.960975] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-22T19:42:55.961144] [INFO ] [MAIN ] Update Progress: 1264/2367 symbols completed. LNN took 32.3s. Estimated remaining: 2h 22m 7s. Rate: 7.8 symbols/min [2025-10-22T19:42:56.184314] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T19:42:56.223120] [INFO ] [REMOTE ] LOAR: Full fetch complete (56001 records). [2025-10-22T19:42:56.253083] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-22T19:42:56.258823] [DEBUG] [LOCAL ] LNG: Primary data saved (51063 records). [2025-10-22T19:42:56.256609] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:56.259203] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-22T19:42:56.260138] [INFO ] [MAIN ] Update Progress: 1265/2367 symbols completed. LNG took 41.9s. Estimated remaining: 2h 21m 53s. Rate: 7.8 symbols/min [2025-10-22T19:42:56.470904] [DEBUG] [LOCAL ] LOCL: Loaded 3714 existing records from primary storage. [2025-10-22T19:42:56.532812] [INFO ] [MAIN ] LOCL: Loaded 3714 existing records. [2025-10-22T19:42:56.706264] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:57.038094] [DEBUG] [LOCAL ] LOMA: Loaded 32809 existing records from primary storage. [2025-10-22T19:42:56.988692] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:57.055638] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-22T19:42:57.061219] [INFO ] [MAIN ] LOMA: Loaded 32809 existing records. [2025-10-22T19:42:57.055822] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-22T19:42:57.074689] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T19:42:57.089219] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-22T19:42:57.099007] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-22T19:42:57.117944] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-22T19:42:57.129118] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-22T19:42:57.147049] [INFO ] [REMOTE ] LOB: Full fetch complete (38625 records). [2025-10-22T19:42:57.153487] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-22T19:42:57.169219] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-22T19:42:57.181285] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-22T19:42:57.381873] [DEBUG] [LOCAL ] LOAR: Trimmed 56001 records to 42026 (keeping 200 days of data) [2025-10-22T19:42:57.545921] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:57.592576] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-22T19:42:57.693620] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-22T19:42:57.757701] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-22T19:42:57.813473] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-22T19:42:58.260383] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:58.278305] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-22T19:42:58.637545] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-22T19:42:58.666869] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-22T19:42:58.679924] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-22T19:42:58.682507] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-22T19:42:58.728896] [DEBUG] [LOCAL ] LOB: Trimmed 38625 records to 26644 (keeping 200 days of data) [2025-10-22T19:42:58.772307] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:58.773141] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-22T19:42:58.928809] [DEBUG] [LOCAL ] LOAR: Primary data saved (42026 records). [2025-10-22T19:42:58.937483] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-22T19:42:58.943048] [INFO ] [MAIN ] Update Progress: 1266/2367 symbols completed. LOAR took 33.1s. Estimated remaining: 2h 21m 40s. Rate: 7.8 symbols/min [2025-10-22T19:42:59.087458] [DEBUG] [LOCAL ] LOB: Primary data saved (26644 records). [2025-10-22T19:42:59.099733] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-22T19:42:59.110365] [INFO ] [MAIN ] Update Progress: 1267/2367 symbols completed. LOB took 32.8s. Estimated remaining: 2h 21m 26s. Rate: 7.8 symbols/min [2025-10-22T19:42:59.223966] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:59.249788] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T19:42:59.272245] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-22T19:42:59.369468] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:59.409356] [DEBUG] [LOCAL ] LOW: Loaded 52978 existing records from primary storage. [2025-10-22T19:42:59.423512] [INFO ] [MAIN ] LOW: Loaded 52978 existing records. [2025-10-22T19:42:59.562938] [DEBUG] [LOCAL ] LPG: Loaded 39396 existing records from primary storage. [2025-10-22T19:42:59.585397] [INFO ] [MAIN ] LPG: Loaded 39396 existing records. [2025-10-22T19:42:59.649818] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:59.684721] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-22T19:42:59.696359] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-22T19:42:59.723025] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-22T19:42:59.748255] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-22T19:42:59.753877] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T19:42:59.813298] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-22T19:42:59.860951] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:59.912063] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-22T19:42:59.924025] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-22T19:42:59.924868] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-22T19:42:59.945739] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-22T19:43:00.251038] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-22T19:43:00.302790] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-22T19:43:00.573684] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:00.583503] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T19:43:00.589415] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-22T19:43:00.675866] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:00.917721] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-22T19:43:01.310297] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T19:43:01.717722] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-22T19:43:02.162782] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T19:43:02.513336] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T19:43:02.521954] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-22T19:43:02.578178] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T19:43:03.024173] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-22T19:43:03.317770] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-22T19:43:04.117779] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-22T19:43:04.677341] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T19:43:04.917724] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-22T19:43:05.717628] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-22T19:43:05.978785] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T19:43:06.482677] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:43:06.517633] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-22T19:43:06.975321] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T19:43:07.317679] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-22T19:43:08.071786] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T19:43:08.117615] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-22T19:43:08.589703] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T19:43:08.917682] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-22T19:43:09.722835] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-22T19:43:09.742473] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T19:43:09.868600] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T19:43:10.073530] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-22T19:43:10.517680] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-22T19:43:11.317685] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-22T19:43:12.117639] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-22T19:43:12.469128] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T19:43:12.843886] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:43:12.917734] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-22T19:43:13.314929] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T19:43:13.717676] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-22T19:43:14.402929] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:43:14.517620] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-22T19:43:14.952678] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T19:43:15.004352] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T19:43:15.317685] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-22T19:43:16.117688] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-22T19:43:16.917716] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-22T19:43:17.295530] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T19:43:17.466402] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T19:43:17.717694] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-22T19:43:18.105810] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T19:43:18.517679] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-22T19:43:19.099584] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-22T19:43:19.317630] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-22T19:43:19.437855] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:43:20.117693] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-22T19:43:20.697807] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T19:43:20.698933] [INFO ] [REMOTE ] LOCL: Full fetch complete (4547 records). [2025-10-22T19:43:20.699004] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-22T19:43:20.928028] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-22T19:43:21.090470] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-22T19:43:21.090606] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-22T19:43:21.091040] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-22T19:43:21.092579] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T19:43:21.091518] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-22T19:43:21.102724] [DEBUG] [LOCAL ] LOCL: Trimmed 4547 records to 3504 (keeping 200 days of data) [2025-10-22T19:43:21.121877] [DEBUG] [LOCAL ] LOCL: Primary data saved (3504 records). [2025-10-22T19:43:21.121943] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-22T19:43:21.122017] [INFO ] [MAIN ] Update Progress: 1268/2367 symbols completed. LOCL took 25.2s. Estimated remaining: 2h 21m 31s. Rate: 7.8 symbols/min [2025-10-22T19:43:21.286872] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:43:21.312544] [DEBUG] [LOCAL ] LPL: Loaded 28918 existing records from primary storage. [2025-10-22T19:43:21.312834] [INFO ] [MAIN ] LPL: Loaded 28918 existing records. [2025-10-22T19:43:21.483694] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:43:21.483899] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-22T19:43:21.483946] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-22T19:43:21.484197] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-22T19:43:21.484239] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-22T19:43:21.722778] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-22T19:43:21.833090] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:22.484513] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T19:43:22.517621] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-22T19:43:23.317676] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-22T19:43:23.565013] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T19:43:23.908595] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T19:43:24.117727] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-22T19:43:24.428007] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T19:43:24.437819] [INFO ] [REMOTE ] LOMA: Full fetch complete (47770 records). [2025-10-22T19:43:24.438036] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-22T19:43:24.922882] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-22T19:43:25.008255] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-22T19:43:25.008374] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-22T19:43:25.009601] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-22T19:43:25.009713] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-22T19:43:25.011183] [DEBUG] [LOCAL ] LOMA: Trimmed 47770 records to 32716 (keeping 200 days of data) [2025-10-22T19:43:25.235314] [DEBUG] [LOCAL ] LOMA: Primary data saved (32716 records). [2025-10-22T19:43:25.235443] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-22T19:43:25.235521] [INFO ] [MAIN ] Update Progress: 1269/2367 symbols completed. LOMA took 29.0s. Estimated remaining: 2h 21m 20s. Rate: 7.8 symbols/min [2025-10-22T19:43:25.400239] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:43:25.437028] [DEBUG] [LOCAL ] LPX: Loaded 40110 existing records from primary storage. [2025-10-22T19:43:25.437303] [INFO ] [MAIN ] LPX: Loaded 40110 existing records. [2025-10-22T19:43:25.613413] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:43:25.613731] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-22T19:43:25.613861] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-22T19:43:25.619188] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-22T19:43:25.628345] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-22T19:43:25.660707] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T19:43:25.724449] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-22T19:43:25.714305] [INFO ] [REMOTE ] LPG: Full fetch complete (58856 records). [2025-10-22T19:43:25.731839] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-22T19:43:26.373941] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:26.419049] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-22T19:43:26.419150] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-22T19:43:26.420067] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-22T19:43:26.420132] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-22T19:43:26.421389] [DEBUG] [LOCAL ] LPG: Trimmed 58856 records to 39248 (keeping 200 days of data) [2025-10-22T19:43:26.517678] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-22T19:43:26.663894] [DEBUG] [LOCAL ] LPG: Primary data saved (39248 records). [2025-10-22T19:43:26.664070] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-22T19:43:26.665096] [INFO ] [MAIN ] Update Progress: 1270/2367 symbols completed. LPG took 27.5s. Estimated remaining: 2h 21m 7s. Rate: 7.8 symbols/min [2025-10-22T19:43:26.837064] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:43:26.874938] [DEBUG] [LOCAL ] LRN: Loaded 39446 existing records from primary storage. [2025-10-22T19:43:26.875216] [INFO ] [MAIN ] LRN: Loaded 39446 existing records. [2025-10-22T19:43:26.987135] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T19:43:27.085716] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:43:27.086145] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-22T19:43:27.086427] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-22T19:43:27.097423] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-22T19:43:27.112718] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-22T19:43:27.180043] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-22T19:43:27.330838] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-22T19:43:27.512964] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:28.029298] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T19:43:28.117766] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-22T19:43:28.917800] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-22T19:43:29.466145] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-22T19:43:29.639094] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T19:43:29.717732] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-22T19:43:30.524543] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-22T19:43:30.541436] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:43:31.317814] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-22T19:43:31.541098] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T19:43:32.105315] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T19:43:32.117599] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-22T19:43:32.158735] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T19:43:32.917705] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-22T19:43:33.602271] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:43:33.717673] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-22T19:43:33.992028] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T19:43:34.517788] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-22T19:43:35.317678] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-22T19:43:35.696732] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T19:43:35.706138] [INFO ] [REMOTE ] LOW: Full fetch complete (76721 records). [2025-10-22T19:43:35.706318] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-22T19:43:36.123348] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-22T19:43:36.127204] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-22T19:43:36.128703] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-22T19:43:36.129935] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-22T19:43:36.130075] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-22T19:43:36.155409] [DEBUG] [LOCAL ] LOW: Trimmed 76721 records to 52970 (keeping 200 days of data) [2025-10-22T19:43:36.157016] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:43:36.505579] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T19:43:36.528242] [DEBUG] [LOCAL ] LOW: Primary data saved (52970 records). [2025-10-22T19:43:36.528397] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-22T19:43:36.528481] [INFO ] [MAIN ] Update Progress: 1271/2367 symbols completed. LOW took 37.6s. Estimated remaining: 2h 21m 1s. Rate: 7.8 symbols/min [2025-10-22T19:43:36.702771] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:43:36.742871] [DEBUG] [LOCAL ] LSPD: Loaded 42387 existing records from primary storage. [2025-10-22T19:43:36.743203] [INFO ] [MAIN ] LSPD: Loaded 42387 existing records. [2025-10-22T19:43:36.918714] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-22T19:43:36.922221] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:43:36.922622] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-22T19:43:36.922730] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-22T19:43:36.923876] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-22T19:43:36.923942] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-22T19:43:37.272783] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:37.410195] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T19:43:37.717697] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-22T19:43:38.444174] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T19:43:38.517735] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-22T19:43:38.702782] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T19:43:39.317719] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-22T19:43:39.657409] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T19:43:40.117678] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-22T19:43:40.727060] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T19:43:40.917706] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-22T19:43:41.629408] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T19:43:41.717716] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-22T19:43:42.462528] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T19:43:42.517614] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-22T19:43:43.255559] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T19:43:43.317669] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-22T19:43:43.859899] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:43:44.117726] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-22T19:43:44.849053] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T19:43:44.917669] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-22T19:43:45.224980] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T19:43:45.717687] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-22T19:43:46.517673] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-22T19:43:46.625909] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T19:43:46.632898] [INFO ] [REMOTE ] LPX: Full fetch complete (58761 records). [2025-10-22T19:43:46.633035] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-22T19:43:47.015927] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-22T19:43:47.016107] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-22T19:43:47.017068] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-22T19:43:47.017168] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-22T19:43:47.018881] [DEBUG] [LOCAL ] LPX: Trimmed 58761 records to 40055 (keeping 200 days of data) [2025-10-22T19:43:47.147007] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:43:47.294844] [DEBUG] [LOCAL ] LPX: Primary data saved (40055 records). [2025-10-22T19:43:47.294953] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-22T19:43:47.295471] [INFO ] [MAIN ] Update Progress: 1272/2367 symbols completed. LPX took 22.1s. Estimated remaining: 2h 20m 56s. Rate: 7.8 symbols/min [2025-10-22T19:43:47.327360] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-22T19:43:47.464889] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:43:47.495436] [DEBUG] [LOCAL ] LTC: Loaded 30677 existing records from primary storage. [2025-10-22T19:43:47.495712] [INFO ] [MAIN ] LTC: Loaded 30677 existing records. [2025-10-22T19:43:47.672317] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:43:47.672498] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-22T19:43:47.672545] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-22T19:43:47.672755] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-22T19:43:47.672815] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-22T19:43:48.018259] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:48.114556] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T19:43:48.118252] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-22T19:43:48.180748] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T19:43:48.917675] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-22T19:43:49.717630] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-22T19:43:49.815200] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T19:43:50.425830] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T19:43:50.517637] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-22T19:43:51.052634] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T19:43:51.317692] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-22T19:43:51.975358] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:43:52.117678] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-22T19:43:52.817944] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:43:52.917689] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-22T19:43:52.971610] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T19:43:53.717677] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-22T19:43:54.393028] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T19:43:54.517720] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-22T19:43:54.814039] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T19:43:55.317719] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-22T19:43:55.863310] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T19:43:56.117726] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-22T19:43:56.787867] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T19:43:56.917780] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-22T19:43:57.528595] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:43:57.717667] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-22T19:43:58.303853] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T19:43:58.517691] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-22T19:43:59.159450] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T19:43:59.317620] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-22T19:43:59.758804] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-22T19:44:00.117668] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-22T19:44:00.917664] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-22T19:44:01.033048] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T19:44:01.040323] [INFO ] [REMOTE ] LSPD: Full fetch complete (62344 records). [2025-10-22T19:44:01.040440] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-22T19:44:01.420516] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-22T19:44:01.420620] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-22T19:44:01.421702] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-22T19:44:01.421778] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-22T19:44:01.423224] [DEBUG] [LOCAL ] LSPD: Trimmed 62344 records to 42329 (keeping 200 days of data) [2025-10-22T19:44:01.669915] [DEBUG] [LOCAL ] LSPD: Primary data saved (42329 records). [2025-10-22T19:44:01.670084] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-22T19:44:01.670186] [INFO ] [MAIN ] Update Progress: 1273/2367 symbols completed. LSPD took 25.1s. Estimated remaining: 2h 20m 54s. Rate: 7.8 symbols/min [2025-10-22T19:44:01.719686] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-22T19:44:01.870928] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:44:01.873267] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:01.929579] [DEBUG] [LOCAL ] LTH: Loaded 51653 existing records from primary storage. [2025-10-22T19:44:01.929913] [INFO ] [MAIN ] LTH: Loaded 51653 existing records. [2025-10-22T19:44:02.111141] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:02.111436] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-22T19:44:02.111491] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-22T19:44:02.111768] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-22T19:44:02.111916] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-22T19:44:02.237026] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T19:44:02.485031] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:02.517611] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-22T19:44:03.037373] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T19:44:03.317720] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-22T19:44:04.117710] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-22T19:44:04.329155] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T19:44:04.815839] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T19:44:04.917681] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-22T19:44:05.717733] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-22T19:44:05.861733] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:44:05.868680] [INFO ] [REMOTE ] LPL: Full fetch complete (37613 records). [2025-10-22T19:44:05.868782] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-22T19:44:06.256276] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-22T19:44:06.256352] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-22T19:44:06.257039] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-22T19:44:06.257102] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-22T19:44:06.257933] [DEBUG] [LOCAL ] LPL: Trimmed 37613 records to 28986 (keeping 200 days of data) [2025-10-22T19:44:06.416177] [DEBUG] [LOCAL ] LPL: Primary data saved (28986 records). [2025-10-22T19:44:06.416320] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-22T19:44:06.416406] [INFO ] [MAIN ] Update Progress: 1274/2367 symbols completed. LPL took 45.3s. Estimated remaining: 2h 20m 44s. Rate: 7.8 symbols/min [2025-10-22T19:44:06.525980] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-22T19:44:06.600938] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:06.629341] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:44:06.656523] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T19:44:06.690714] [DEBUG] [LOCAL ] LTM: Loaded 39164 existing records from primary storage. [2025-10-22T19:44:06.691046] [INFO ] [MAIN ] LTM: Loaded 39164 existing records. [2025-10-22T19:44:06.866670] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:06.866877] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-22T19:44:06.866925] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-22T19:44:06.867103] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-22T19:44:06.867143] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-22T19:44:07.214503] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:07.317734] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-22T19:44:08.117715] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-22T19:44:08.141371] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T19:44:08.408965] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T19:44:08.917775] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-22T19:44:09.717682] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-22T19:44:09.972621] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T19:44:10.242182] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T19:44:10.517774] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-22T19:44:11.054110] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T19:44:11.059887] [INFO ] [REMOTE ] LRN: Full fetch complete (58279 records). [2025-10-22T19:44:11.060003] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-22T19:44:11.322897] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-22T19:44:11.440848] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-22T19:44:11.440924] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-22T19:44:11.441742] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-22T19:44:11.441804] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-22T19:44:11.442970] [DEBUG] [LOCAL ] LRN: Trimmed 58279 records to 39335 (keeping 200 days of data) [2025-10-22T19:44:11.680357] [DEBUG] [LOCAL ] LRN: Primary data saved (39335 records). [2025-10-22T19:44:11.680517] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-22T19:44:11.680598] [INFO ] [MAIN ] Update Progress: 1275/2367 symbols completed. LRN took 45.0s. Estimated remaining: 2h 20m 34s. Rate: 7.8 symbols/min [2025-10-22T19:44:11.853571] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:11.895030] [DEBUG] [LOCAL ] LU: Loaded 49218 existing records from primary storage. [2025-10-22T19:44:11.895329] [INFO ] [MAIN ] LU: Loaded 49218 existing records. [2025-10-22T19:44:12.069325] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:12.069716] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-22T19:44:12.069772] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-22T19:44:12.069972] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-22T19:44:12.070032] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-22T19:44:12.124358] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-22T19:44:12.439266] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:12.468127] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T19:44:12.547015] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T19:44:12.917769] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-22T19:44:13.641422] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T19:44:13.646966] [INFO ] [REMOTE ] LTC: Full fetch complete (43903 records). [2025-10-22T19:44:13.647062] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-22T19:44:13.724064] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-22T19:44:14.030148] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-22T19:44:14.030289] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-22T19:44:14.031212] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-22T19:44:14.031339] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-22T19:44:14.032378] [DEBUG] [LOCAL ] LTC: Trimmed 43903 records to 30631 (keeping 200 days of data) [2025-10-22T19:44:14.227269] [DEBUG] [LOCAL ] LTC: Primary data saved (30631 records). [2025-10-22T19:44:14.227482] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-22T19:44:14.227572] [INFO ] [MAIN ] Update Progress: 1276/2367 symbols completed. LTC took 26.9s. Estimated remaining: 2h 20m 22s. Rate: 7.8 symbols/min [2025-10-22T19:44:14.351831] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T19:44:14.428125] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:14.448845] [DEBUG] [LOCAL ] LUCK: Loaded 23955 existing records from primary storage. [2025-10-22T19:44:14.449105] [INFO ] [MAIN ] LUCK: Loaded 23955 existing records. [2025-10-22T19:44:14.523727] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-22T19:44:14.631874] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:14.632068] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-22T19:44:14.632122] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-22T19:44:14.632292] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-22T19:44:14.632329] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-22T19:44:14.986287] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:15.317693] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-22T19:44:15.491174] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T19:44:15.879613] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T19:44:16.117674] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-22T19:44:16.917636] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-22T19:44:17.182185] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T19:44:17.717674] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-22T19:44:17.812305] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T19:44:18.517628] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-22T19:44:18.597901] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T19:44:19.317682] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-22T19:44:19.410565] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T19:44:19.847396] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T19:44:20.117707] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-22T19:44:20.866478] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T19:44:20.917711] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-22T19:44:21.366418] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T19:44:21.717730] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-22T19:44:22.373379] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T19:44:22.517781] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-22T19:44:23.052617] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T19:44:23.317709] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-22T19:44:23.834611] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T19:44:24.117728] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-22T19:44:24.696420] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T19:44:24.917691] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-22T19:44:25.476450] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T19:44:25.717707] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-22T19:44:26.396546] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T19:44:26.518207] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-22T19:44:26.555589] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T19:44:27.317679] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-22T19:44:28.117635] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-22T19:44:28.330095] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T19:44:28.338380] [INFO ] [REMOTE ] LTH: Full fetch complete (74776 records). [2025-10-22T19:44:28.338514] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-22T19:44:28.732974] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-22T19:44:28.733116] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-22T19:44:28.734232] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-22T19:44:28.734377] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-22T19:44:28.735942] [DEBUG] [LOCAL ] LTH: Trimmed 74776 records to 51635 (keeping 200 days of data) [2025-10-22T19:44:28.919274] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-22T19:44:28.981461] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T19:44:29.089017] [DEBUG] [LOCAL ] LTH: Primary data saved (51635 records). [2025-10-22T19:44:29.089162] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-22T19:44:29.089243] [INFO ] [MAIN ] Update Progress: 1277/2367 symbols completed. LTH took 27.4s. Estimated remaining: 2h 20m 20s. Rate: 7.8 symbols/min [2025-10-22T19:44:29.535934] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T19:44:29.717696] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-22T19:44:30.144288] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T19:44:30.517723] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-22T19:44:31.317768] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-22T19:44:31.371720] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T19:44:32.117740] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-22T19:44:32.270670] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:44:32.561421] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T19:44:32.917687] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-22T19:44:33.540245] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:44:33.717679] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-22T19:44:33.855113] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T19:44:34.517790] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-22T19:44:35.317709] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-22T19:44:35.359416] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T19:44:35.417097] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-22T19:44:36.117847] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-22T19:44:36.917681] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-22T19:44:37.123444] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T19:44:37.131919] [INFO ] [REMOTE ] LTM: Full fetch complete (51331 records). [2025-10-22T19:44:37.132042] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-22T19:44:37.543886] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-22T19:44:37.544128] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-22T19:44:37.545009] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-22T19:44:37.545092] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-22T19:44:37.603036] [DEBUG] [LOCAL ] LTM: Trimmed 51331 records to 39222 (keeping 200 days of data) [2025-10-22T19:44:37.604197] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:44:37.717779] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-22T19:44:37.842523] [DEBUG] [LOCAL ] LTM: Primary data saved (39222 records). [2025-10-22T19:44:37.842692] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-22T19:44:37.842789] [INFO ] [MAIN ] Update Progress: 1278/2367 symbols completed. LTM took 31.4s. Estimated remaining: 2h 20m 13s. Rate: 7.8 symbols/min [2025-10-22T19:44:38.176557] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T19:44:38.180218] [INFO ] [REMOTE ] LUCK: Full fetch complete (39381 records). [2025-10-22T19:44:38.180317] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-22T19:44:38.547571] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-22T19:44:38.547686] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-22T19:44:38.548481] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-22T19:44:38.548541] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-22T19:44:38.549489] [DEBUG] [LOCAL ] LUCK: Trimmed 39381 records to 23877 (keeping 200 days of data) [2025-10-22T19:44:38.689087] [DEBUG] [LOCAL ] LUCK: Primary data saved (23877 records). [2025-10-22T19:44:38.689224] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-22T19:44:38.689304] [INFO ] [MAIN ] Update Progress: 1279/2367 symbols completed. LUCK took 24.5s. Estimated remaining: 2h 19m 60s. Rate: 7.8 symbols/min [2025-10-22T19:44:39.389862] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:44:39.399724] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-22T19:44:41.034470] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T19:44:41.045059] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-22T19:44:42.942084] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T19:44:42.950589] [INFO ] [REMOTE ] LU: Full fetch complete (70982 records). [2025-10-22T19:44:42.950810] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-22T19:44:43.336091] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-22T19:44:43.336188] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-22T19:44:43.337143] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-22T19:44:43.337204] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-22T19:44:43.338620] [DEBUG] [LOCAL ] LU: Trimmed 70982 records to 49220 (keeping 200 days of data) [2025-10-22T19:44:43.606301] [DEBUG] [LOCAL ] LU: Primary data saved (49220 records). [2025-10-22T19:44:43.606450] [INFO ] [MAIN ] LU: Full history saved. [2025-10-22T19:44:43.606535] [INFO ] [MAIN ] Update Progress: 1280/2367 symbols completed. LU took 31.9s. Estimated remaining: 2h 19m 49s. Rate: 7.8 symbols/min [2025-10-22T19:44:44.316745] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:44.366498] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:44.388405] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:44.384798] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:44.388569] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-22T19:44:44.389835] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-22T19:44:44.390341] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-22T19:44:44.390506] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-22T19:44:44.390698] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-22T19:44:44.390752] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-22T19:44:44.791731] [DEBUG] [LOCAL ] LUMN: Loaded 53645 existing records from primary storage. [2025-10-22T19:44:44.794325] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-22T19:44:44.800683] [INFO ] [MAIN ] LUMN: Loaded 53645 existing records. [2025-10-22T19:44:44.793392] [DEBUG] [LOCAL ] LVS: Loaded 53570 existing records from primary storage. [2025-10-22T19:44:44.833853] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-22T19:44:44.833619] [INFO ] [MAIN ] LVS: Loaded 53570 existing records. [2025-10-22T19:44:45.038075] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:45.094971] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-22T19:44:45.442763] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:44:45.446546] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:45.492448] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-22T19:44:45.492047] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-22T19:44:45.496405] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-22T19:44:45.500020] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:44:45.491818] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:45.499874] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:45.500663] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-22T19:44:45.500486] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-22T19:44:45.501099] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-22T19:44:45.500926] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-22T19:44:45.500859] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-22T19:44:45.500792] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-22T19:44:45.501607] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:44:45.501502] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-22T19:44:45.507103] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-22T19:44:45.526857] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-22T19:44:45.544030] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-22T19:44:45.554728] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-22T19:44:45.544130] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-22T19:44:45.567509] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-22T19:44:45.549415] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-22T19:44:45.581765] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-22T19:44:45.644950] [INFO ] [MAIN ] Update Progress: 1281/2367 symbols completed. LUXE took 2.0s. Estimated remaining: 2h 19m 37s. Rate: 7.8 symbols/min [2025-10-22T19:44:46.472874] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:46.764699] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:46.879846] [DEBUG] [LOCAL ] LVWR: Loaded 18596 existing records from primary storage. [2025-10-22T19:44:46.852606] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-22T19:44:46.890608] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:46.886986] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:46.883052] [INFO ] [MAIN ] LVWR: Loaded 18596 existing records. [2025-10-22T19:44:46.891205] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-22T19:44:46.903012] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-22T19:44:47.080684] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:47.080930] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-22T19:44:47.080997] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-22T19:44:47.081178] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-22T19:44:47.081237] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-22T19:44:47.451107] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:47.451492] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-22T19:44:48.182438] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T19:44:48.184212] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-22T19:44:48.522943] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T19:44:48.533971] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-22T19:44:48.571016] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-22T19:44:48.573041] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-22T19:44:48.613546] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T19:44:48.625834] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-22T19:44:48.859398] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T19:44:48.870037] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-22T19:44:48.971502] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T19:44:48.973176] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-22T19:44:49.562077] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-22T19:44:49.564625] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-22T19:44:50.333278] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T19:44:50.343601] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-22T19:44:50.514839] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T19:44:50.525384] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-22T19:44:50.655951] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T19:44:50.720478] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-22T19:44:51.317731] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-22T19:44:52.104906] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T19:44:52.117600] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-22T19:44:52.392674] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:44:52.917715] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-22T19:44:52.977549] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T19:44:53.680713] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:44:53.717618] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-22T19:44:54.517727] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-22T19:44:54.905029] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T19:44:55.241554] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-22T19:44:55.317615] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-22T19:44:55.503093] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:44:56.117685] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-22T19:44:56.917718] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-22T19:44:57.195544] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T19:44:57.717688] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-22T19:44:57.743963] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T19:44:57.888455] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T19:44:58.517728] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-22T19:44:59.317770] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-22T19:44:59.821048] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-22T19:45:00.122950] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T19:45:00.122829] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-22T19:45:00.328751] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T19:45:00.917705] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-22T19:45:01.717720] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-22T19:45:02.293211] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T19:45:02.517635] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-22T19:45:02.935532] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T19:45:03.317734] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-22T19:45:03.827860] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T19:45:04.117777] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-22T19:45:04.213130] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:45:04.929848] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-22T19:45:04.936044] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:45:05.717713] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-22T19:45:05.993498] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T19:45:05.996026] [INFO ] [REMOTE ] LVWR: Full fetch complete (20797 records). [2025-10-22T19:45:05.996103] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-22T19:45:06.335461] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T19:45:06.420119] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-22T19:45:06.420207] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-22T19:45:06.420725] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-22T19:45:06.420790] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-22T19:45:06.421497] [DEBUG] [LOCAL ] LVWR: Trimmed 20797 records to 18636 (keeping 200 days of data) [2025-10-22T19:45:06.517996] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-22T19:45:06.536204] [DEBUG] [LOCAL ] LVWR: Primary data saved (18636 records). [2025-10-22T19:45:06.536396] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-22T19:45:06.536494] [INFO ] [MAIN ] Update Progress: 1282/2367 symbols completed. LVWR took 20.8s. Estimated remaining: 2h 19m 40s. Rate: 7.8 symbols/min [2025-10-22T19:45:06.721296] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:06.768230] [DEBUG] [LOCAL ] LW: Loaded 51180 existing records from primary storage. [2025-10-22T19:45:06.768530] [INFO ] [MAIN ] LW: Loaded 51180 existing records. [2025-10-22T19:45:06.950811] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:06.951027] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-22T19:45:06.951074] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-22T19:45:06.951325] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-22T19:45:06.951382] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-22T19:45:07.308459] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:07.317614] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-22T19:45:07.697679] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T19:45:08.117708] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-22T19:45:08.620154] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T19:45:08.917694] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-22T19:45:09.082348] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T19:45:09.717692] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-22T19:45:09.931133] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T19:45:10.517727] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-22T19:45:10.797248] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T19:45:11.317686] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-22T19:45:11.426546] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:45:12.117702] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-22T19:45:12.547344] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T19:45:12.917682] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-22T19:45:13.434883] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T19:45:13.443767] [INFO ] [REMOTE ] LVS: Full fetch complete (77724 records). [2025-10-22T19:45:13.443888] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-22T19:45:13.721553] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-22T19:45:13.848895] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-22T19:45:13.849049] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-22T19:45:13.850344] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-22T19:45:13.850535] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-22T19:45:13.852299] [DEBUG] [LOCAL ] LVS: Trimmed 77724 records to 53569 (keeping 200 days of data) [2025-10-22T19:45:13.995423] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T19:45:14.220977] [DEBUG] [LOCAL ] LVS: Primary data saved (53569 records). [2025-10-22T19:45:14.221124] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-22T19:45:14.221239] [INFO ] [MAIN ] Update Progress: 1283/2367 symbols completed. LVS took 30.6s. Estimated remaining: 2h 19m 33s. Rate: 7.8 symbols/min [2025-10-22T19:45:14.393077] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:14.409761] [DEBUG] [LOCAL ] LXFR: Loaded 16437 existing records from primary storage. [2025-10-22T19:45:14.409991] [INFO ] [MAIN ] LXFR: Loaded 16437 existing records. [2025-10-22T19:45:14.522707] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-22T19:45:14.585097] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:14.585274] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-22T19:45:14.585321] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-22T19:45:14.585494] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-22T19:45:14.585548] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-22T19:45:14.936944] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:15.286270] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-22T19:45:15.295107] [INFO ] [REMOTE ] LUMN: Full fetch complete (77778 records). [2025-10-22T19:45:15.295235] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-22T19:45:15.328284] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-22T19:45:15.695331] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-22T19:45:15.695436] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-22T19:45:15.696470] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-22T19:45:15.696553] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-22T19:45:15.698166] [DEBUG] [LOCAL ] LUMN: Trimmed 77778 records to 53645 (keeping 200 days of data) [2025-10-22T19:45:15.967526] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-22T19:45:16.061195] [DEBUG] [LOCAL ] LUMN: Primary data saved (53645 records). [2025-10-22T19:45:16.061334] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-22T19:45:16.061415] [INFO ] [MAIN ] Update Progress: 1284/2367 symbols completed. LUMN took 32.5s. Estimated remaining: 2h 19m 20s. Rate: 7.8 symbols/min [2025-10-22T19:45:16.124594] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-22T19:45:16.235503] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:16.280249] [DEBUG] [LOCAL ] LXP: Loaded 50786 existing records from primary storage. [2025-10-22T19:45:16.280535] [INFO ] [MAIN ] LXP: Loaded 50786 existing records. [2025-10-22T19:45:16.458000] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:16.458484] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-22T19:45:16.458600] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-22T19:45:16.458929] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-22T19:45:16.459067] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-22T19:45:16.572681] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T19:45:16.844624] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-22T19:45:16.873706] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:16.917605] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-22T19:45:17.717670] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-22T19:45:18.284616] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-22T19:45:18.293872] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-22T19:45:18.294004] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-22T19:45:18.526677] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-22T19:45:18.707961] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-22T19:45:18.708150] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-22T19:45:18.709286] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-22T19:45:18.709448] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-22T19:45:18.711206] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 53689 (keeping 200 days of data) [2025-10-22T19:45:18.834996] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T19:45:19.116756] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T19:45:19.139631] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-22T19:45:19.140446] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-22T19:45:19.140541] [INFO ] [MAIN ] Update Progress: 1285/2367 symbols completed. LUV took 35.5s. Estimated remaining: 2h 19m 8s. Rate: 7.8 symbols/min [2025-10-22T19:45:19.331592] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-22T19:45:19.335038] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:19.368191] [DEBUG] [LOCAL ] LXU: Loaded 31582 existing records from primary storage. [2025-10-22T19:45:19.368465] [INFO ] [MAIN ] LXU: Loaded 31582 existing records. [2025-10-22T19:45:19.566686] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:19.566899] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-22T19:45:19.566946] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-22T19:45:19.567208] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-22T19:45:19.567246] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-22T19:45:19.698154] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:45:19.972971] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:20.117674] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-22T19:45:20.917697] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-22T19:45:20.982623] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T19:45:21.123813] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T19:45:21.717690] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-22T19:45:22.421417] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:45:22.517631] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-22T19:45:23.317687] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-22T19:45:23.368016] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T19:45:24.122457] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-22T19:45:24.144525] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:45:24.835280] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T19:45:24.917628] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-22T19:45:25.185397] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T19:45:25.717722] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-22T19:45:26.517640] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-22T19:45:26.637581] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T19:45:26.886756] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:45:27.317685] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-22T19:45:27.944961] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:45:28.117686] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-22T19:45:28.646221] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T19:45:28.917693] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-22T19:45:29.224063] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T19:45:29.717728] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-22T19:45:30.242845] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T19:45:30.517678] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-22T19:45:30.653784] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T19:45:31.317728] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-22T19:45:31.797185] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T19:45:32.117687] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-22T19:45:32.917765] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-22T19:45:33.007360] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T19:45:33.235500] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T19:45:33.717634] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-22T19:45:34.191148] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T19:45:34.517625] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-22T19:45:34.682727] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T19:45:35.317673] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-22T19:45:35.978093] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T19:45:36.117671] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-22T19:45:36.917725] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-22T19:45:37.010512] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T19:45:37.339252] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T19:45:37.717682] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-22T19:45:38.517674] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-22T19:45:38.616175] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:45:38.626241] [INFO ] [REMOTE ] LW: Full fetch complete (74787 records). [2025-10-22T19:45:38.626487] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-22T19:45:39.014631] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-22T19:45:39.014753] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-22T19:45:39.015780] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-22T19:45:39.015848] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-22T19:45:39.017310] [DEBUG] [LOCAL ] LW: Trimmed 74787 records to 51164 (keeping 200 days of data) [2025-10-22T19:45:39.318628] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-22T19:45:39.318508] [DEBUG] [LOCAL ] LW: Primary data saved (51164 records). [2025-10-22T19:45:39.320502] [INFO ] [MAIN ] LW: Full history saved. [2025-10-22T19:45:39.321359] [INFO ] [MAIN ] Update Progress: 1286/2367 symbols completed. LW took 32.8s. Estimated remaining: 2h 19m 11s. Rate: 7.8 symbols/min [2025-10-22T19:45:39.493697] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:39.530695] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-22T19:45:39.541968] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:45:39.593231] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-22T19:45:39.593583] [INFO ] [MAIN ] LYB: Loaded 53621 existing records. [2025-10-22T19:45:39.765800] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:39.766069] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-22T19:45:39.766129] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-22T19:45:39.766320] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-22T19:45:39.766410] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-22T19:45:40.121024] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-22T19:45:40.164131] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:40.181491] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T19:45:40.917784] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-22T19:45:41.717769] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-22T19:45:41.887713] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:45:42.517771] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-22T19:45:42.698932] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T19:45:42.727857] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T19:45:42.731091] [INFO ] [REMOTE ] LXFR: Full fetch complete (24664 records). [2025-10-22T19:45:42.731326] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-22T19:45:43.101075] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-22T19:45:43.101153] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-22T19:45:43.101604] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-22T19:45:43.101671] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-22T19:45:43.102440] [DEBUG] [LOCAL ] LXFR: Trimmed 24664 records to 16413 (keeping 200 days of data) [2025-10-22T19:45:43.200800] [DEBUG] [LOCAL ] LXFR: Primary data saved (16413 records). [2025-10-22T19:45:43.200930] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-22T19:45:43.201011] [INFO ] [MAIN ] Update Progress: 1287/2367 symbols completed. LXFR took 29.0s. Estimated remaining: 2h 19m 0s. Rate: 7.8 symbols/min [2025-10-22T19:45:43.322836] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-22T19:45:43.376757] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:43.423455] [DEBUG] [LOCAL ] LYG: Loaded 52661 existing records from primary storage. [2025-10-22T19:45:43.423816] [INFO ] [MAIN ] LYG: Loaded 52661 existing records. [2025-10-22T19:45:43.599234] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:43.599413] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-22T19:45:43.599470] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-22T19:45:43.599662] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-22T19:45:43.599720] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-22T19:45:43.967309] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:44.117721] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-22T19:45:44.277610] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:45:44.658107] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T19:45:44.663223] [INFO ] [REMOTE ] LXU: Full fetch complete (45284 records). [2025-10-22T19:45:44.663368] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-22T19:45:44.924074] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-22T19:45:45.057211] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-22T19:45:45.057299] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-22T19:45:45.058225] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-22T19:45:45.058293] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-22T19:45:45.059449] [DEBUG] [LOCAL ] LXU: Trimmed 45284 records to 31461 (keeping 200 days of data) [2025-10-22T19:45:45.246034] [DEBUG] [LOCAL ] LXU: Primary data saved (31461 records). [2025-10-22T19:45:45.246182] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-22T19:45:45.246267] [INFO ] [MAIN ] Update Progress: 1288/2367 symbols completed. LXU took 26.1s. Estimated remaining: 2h 18m 48s. Rate: 7.8 symbols/min [2025-10-22T19:45:45.425562] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:45.475086] [DEBUG] [LOCAL ] LYV: Loaded 51013 existing records from primary storage. [2025-10-22T19:45:45.475417] [INFO ] [MAIN ] LYV: Loaded 51013 existing records. [2025-10-22T19:45:45.658703] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:45.659066] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-22T19:45:45.659320] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-22T19:45:45.659604] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-22T19:45:45.659689] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-22T19:45:45.723209] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-22T19:45:46.068138] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:46.071016] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T19:45:46.517789] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-22T19:45:46.566479] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T19:45:47.118154] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T19:45:47.317805] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-22T19:45:48.117698] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-22T19:45:48.247504] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:45:48.917688] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-22T19:45:49.200035] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T19:45:49.717682] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-22T19:45:49.794037] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:45:50.517708] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-22T19:45:50.749815] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T19:45:51.317629] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-22T19:45:51.583608] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T19:45:52.120764] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-22T19:45:52.123859] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T19:45:52.814528] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T19:45:52.917704] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-22T19:45:53.717759] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-22T19:45:53.958331] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T19:45:54.517694] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-22T19:45:54.674635] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T19:45:55.317636] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-22T19:45:55.523885] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T19:45:55.532300] [INFO ] [REMOTE ] LXP: Full fetch complete (72854 records). [2025-10-22T19:45:55.532441] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-22T19:45:55.916237] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-22T19:45:55.916348] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-22T19:45:55.917320] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-22T19:45:55.917384] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-22T19:45:55.918833] [DEBUG] [LOCAL ] LXP: Trimmed 72854 records to 50756 (keeping 200 days of data) [2025-10-22T19:45:56.119396] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-22T19:45:56.217500] [DEBUG] [LOCAL ] LXP: Primary data saved (50756 records). [2025-10-22T19:45:56.217637] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-22T19:45:56.217784] [INFO ] [MAIN ] Update Progress: 1289/2367 symbols completed. LXP took 40.2s. Estimated remaining: 2h 18m 43s. Rate: 7.8 symbols/min [2025-10-22T19:45:56.388147] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:56.420174] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T19:45:56.459112] [DEBUG] [LOCAL ] LZB: Loaded 35070 existing records from primary storage. [2025-10-22T19:45:56.459396] [INFO ] [MAIN ] LZB: Loaded 35070 existing records. [2025-10-22T19:45:56.632198] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:56.632393] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-22T19:45:56.632440] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-22T19:45:56.632671] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-22T19:45:56.632729] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-22T19:45:56.918191] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-22T19:45:56.990063] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:57.028120] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:45:57.717629] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-22T19:45:57.883291] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T19:45:58.517689] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-22T19:45:58.707326] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:45:59.073890] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T19:45:59.317673] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-22T19:46:00.117675] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-22T19:46:00.415253] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T19:46:00.750705] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T19:46:00.917616] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-22T19:46:01.717673] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-22T19:46:02.035838] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T19:46:02.517725] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-22T19:46:02.867290] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T19:46:03.203836] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T19:46:03.317631] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-22T19:46:04.117675] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-22T19:46:04.308549] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:46:04.917672] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-22T19:46:05.058611] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T19:46:05.717689] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-22T19:46:06.157681] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T19:46:06.393637] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:46:06.517612] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-22T19:46:07.229785] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:46:07.317615] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-22T19:46:07.856667] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T19:46:08.117688] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-22T19:46:08.917690] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-22T19:46:09.199272] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T19:46:09.208062] [INFO ] [REMOTE ] LYG: Full fetch complete (76225 records). [2025-10-22T19:46:09.208209] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-22T19:46:09.594753] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-22T19:46:09.594832] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-22T19:46:09.595925] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-22T19:46:09.595989] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-22T19:46:09.597487] [DEBUG] [LOCAL ] LYG: Trimmed 76225 records to 52652 (keeping 200 days of data) [2025-10-22T19:46:09.762124] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-22T19:46:09.903885] [DEBUG] [LOCAL ] LYG: Primary data saved (52652 records). [2025-10-22T19:46:09.904062] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-22T19:46:09.904147] [INFO ] [MAIN ] Update Progress: 1290/2367 symbols completed. LYG took 26.7s. Estimated remaining: 2h 18m 40s. Rate: 7.8 symbols/min [2025-10-22T19:46:10.085862] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:10.101725] [DEBUG] [LOCAL ] LZM: Loaded 14736 existing records from primary storage. [2025-10-22T19:46:10.101947] [INFO ] [MAIN ] LZM: Loaded 14736 existing records. [2025-10-22T19:46:10.291903] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:10.292487] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-22T19:46:10.292633] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-22T19:46:10.293303] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-22T19:46:10.313371] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-22T19:46:10.374463] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-22T19:46:10.454638] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T19:46:10.454858] [INFO ] [REMOTE ] LYB: Full fetch complete (77635 records). [2025-10-22T19:46:10.465789] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-22T19:46:10.527677] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-22T19:46:10.946549] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:11.169408] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-22T19:46:11.169673] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-22T19:46:11.170983] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-22T19:46:11.171106] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-22T19:46:11.195629] [DEBUG] [LOCAL ] LYB: Trimmed 77635 records to 53621 (keeping 200 days of data) [2025-10-22T19:46:11.196694] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T19:46:11.317638] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-22T19:46:11.550223] [DEBUG] [LOCAL ] LYB: Primary data saved (53621 records). [2025-10-22T19:46:11.550364] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-22T19:46:11.551190] [INFO ] [MAIN ] Update Progress: 1291/2367 symbols completed. LYB took 32.2s. Estimated remaining: 2h 18m 27s. Rate: 7.8 symbols/min [2025-10-22T19:46:11.740402] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:11.795968] [DEBUG] [LOCAL ] M: Loaded 53544 existing records from primary storage. [2025-10-22T19:46:11.796378] [INFO ] [MAIN ] M: Loaded 53544 existing records. [2025-10-22T19:46:11.998367] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:11.998745] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-22T19:46:11.998899] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-22T19:46:11.999100] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-22T19:46:11.999141] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-22T19:46:12.122099] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T19:46:12.121122] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-22T19:46:12.408968] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:12.472352] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:46:12.917667] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-22T19:46:13.244185] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T19:46:13.644224] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T19:46:13.717618] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-22T19:46:14.517721] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-22T19:46:14.652163] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T19:46:15.317734] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-22T19:46:16.117719] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-22T19:46:16.401148] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T19:46:16.457025] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T19:46:16.917727] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-22T19:46:17.639242] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T19:46:17.717683] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-22T19:46:17.754251] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T19:46:18.517709] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-22T19:46:19.082357] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T19:46:19.317763] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-22T19:46:20.117688] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-22T19:46:20.332142] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T19:46:20.917627] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-22T19:46:21.000268] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:46:21.569536] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T19:46:21.575541] [INFO ] [REMOTE ] LZB: Full fetch complete (51116 records). [2025-10-22T19:46:21.575767] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-22T19:46:21.725613] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-22T19:46:21.967182] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-22T19:46:21.967278] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-22T19:46:21.968175] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-22T19:46:21.968241] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-22T19:46:21.969328] [DEBUG] [LOCAL ] LZB: Trimmed 51116 records to 35036 (keeping 200 days of data) [2025-10-22T19:46:22.178115] [DEBUG] [LOCAL ] LZB: Primary data saved (35036 records). [2025-10-22T19:46:22.178256] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-22T19:46:22.178335] [INFO ] [MAIN ] Update Progress: 1292/2367 symbols completed. LZB took 26.0s. Estimated remaining: 2h 18m 22s. Rate: 7.8 symbols/min [2025-10-22T19:46:22.343874] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:22.391085] [DEBUG] [LOCAL ] MA: Loaded 52465 existing records from primary storage. [2025-10-22T19:46:22.391396] [INFO ] [MAIN ] MA: Loaded 52465 existing records. [2025-10-22T19:46:22.522155] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-22T19:46:22.590506] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:22.590800] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-22T19:46:22.590947] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-22T19:46:22.591245] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-22T19:46:22.591369] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-22T19:46:22.941138] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T19:46:23.015788] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:23.317674] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-22T19:46:23.364548] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T19:46:23.672063] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T19:46:24.117682] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-22T19:46:24.917698] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-22T19:46:25.383374] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T19:46:25.717627] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-22T19:46:25.726130] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T19:46:26.007843] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T19:46:26.517697] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-22T19:46:27.290101] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T19:46:27.317926] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-22T19:46:27.320209] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-22T19:46:28.117700] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-22T19:46:28.917630] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-22T19:46:29.252433] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T19:46:29.484048] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T19:46:29.717683] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-22T19:46:30.517704] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-22T19:46:30.829362] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T19:46:30.837921] [INFO ] [REMOTE ] LYV: Full fetch complete (74152 records). [2025-10-22T19:46:30.838067] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-22T19:46:31.223337] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-22T19:46:31.223428] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-22T19:46:31.224398] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-22T19:46:31.224466] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-22T19:46:31.225942] [DEBUG] [LOCAL ] LYV: Trimmed 74152 records to 51001 (keeping 200 days of data) [2025-10-22T19:46:31.320115] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-22T19:46:31.540845] [DEBUG] [LOCAL ] LYV: Primary data saved (51001 records). [2025-10-22T19:46:31.540992] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-22T19:46:31.541073] [INFO ] [MAIN ] Update Progress: 1293/2367 symbols completed. LYV took 46.3s. Estimated remaining: 2h 18m 15s. Rate: 7.8 symbols/min [2025-10-22T19:46:31.715498] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:31.760184] [DEBUG] [LOCAL ] MAA: Loaded 42974 existing records from primary storage. [2025-10-22T19:46:31.760602] [INFO ] [MAIN ] MAA: Loaded 42974 existing records. [2025-10-22T19:46:31.977613] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:31.991097] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-22T19:46:31.991198] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-22T19:46:31.994435] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-22T19:46:31.994769] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-22T19:46:31.996163] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T19:46:32.144757] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-22T19:46:32.442617] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:32.455508] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T19:46:32.502740] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:46:32.917684] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-22T19:46:33.717672] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-22T19:46:34.070949] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T19:46:34.075090] [INFO ] [REMOTE ] LZM: Full fetch complete (19900 records). [2025-10-22T19:46:34.075173] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-22T19:46:34.451761] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-22T19:46:34.451953] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-22T19:46:34.452476] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-22T19:46:34.452577] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-22T19:46:34.453433] [DEBUG] [LOCAL ] LZM: Trimmed 19900 records to 14818 (keeping 200 days of data) [2025-10-22T19:46:34.521145] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-22T19:46:34.552057] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-22T19:46:34.577590] [DEBUG] [LOCAL ] LZM: Primary data saved (14818 records). [2025-10-22T19:46:34.577726] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-22T19:46:34.577851] [INFO ] [MAIN ] Update Progress: 1294/2367 symbols completed. LZM took 24.7s. Estimated remaining: 2h 18m 4s. Rate: 7.8 symbols/min [2025-10-22T19:46:34.743532] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:34.787161] [DEBUG] [LOCAL ] MAC: Loaded 49653 existing records from primary storage. [2025-10-22T19:46:34.787513] [INFO ] [MAIN ] MAC: Loaded 49653 existing records. [2025-10-22T19:46:34.974379] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:34.974620] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-22T19:46:34.974701] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-22T19:46:34.975149] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-22T19:46:34.975204] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-22T19:46:35.322718] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-22T19:46:35.326466] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:36.117707] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-22T19:46:36.174002] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-22T19:46:36.340452] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T19:46:36.917680] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-22T19:46:37.471579] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T19:46:37.562094] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T19:46:37.717684] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-22T19:46:38.183019] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T19:46:38.517695] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-22T19:46:39.317629] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-22T19:46:39.601604] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T19:46:40.117670] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-22T19:46:40.172217] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:46:40.887385] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T19:46:40.917636] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-22T19:46:41.717731] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-22T19:46:42.191962] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T19:46:42.200847] [INFO ] [REMOTE ] M: Full fetch complete (77658 records). [2025-10-22T19:46:42.201007] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-22T19:46:42.520131] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-22T19:46:42.600131] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-22T19:46:42.600327] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-22T19:46:42.601357] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-22T19:46:42.601432] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-22T19:46:42.603315] [DEBUG] [LOCAL ] M: Trimmed 77658 records to 53544 (keeping 200 days of data) [2025-10-22T19:46:42.864877] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T19:46:42.985765] [DEBUG] [LOCAL ] M: Primary data saved (53544 records). [2025-10-22T19:46:42.986064] [INFO ] [MAIN ] M: Full history saved. [2025-10-22T19:46:42.986995] [INFO ] [MAIN ] Update Progress: 1295/2367 symbols completed. M took 31.4s. Estimated remaining: 2h 17m 57s. Rate: 7.8 symbols/min [2025-10-22T19:46:43.167183] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:43.197426] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:46:43.240473] [DEBUG] [LOCAL ] MAGN: Loaded 36252 existing records from primary storage. [2025-10-22T19:46:43.240791] [INFO ] [MAIN ] MAGN: Loaded 36252 existing records. [2025-10-22T19:46:43.322785] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-22T19:46:43.437581] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:43.437919] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-22T19:46:43.437993] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-22T19:46:43.438675] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-22T19:46:43.438742] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-22T19:46:43.828104] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:44.117626] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-22T19:46:44.584319] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T19:46:44.668939] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T19:46:44.917693] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-22T19:46:45.717721] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-22T19:46:45.794719] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T19:46:46.338825] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T19:46:46.517715] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-22T19:46:47.105320] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T19:46:47.317684] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-22T19:46:48.117727] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-22T19:46:48.251442] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T19:46:48.398815] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T19:46:48.917719] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-22T19:46:49.717715] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-22T19:46:50.289207] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T19:46:50.525048] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-22T19:46:50.549568] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:46:51.056309] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:46:51.317685] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-22T19:46:52.117671] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-22T19:46:52.523022] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T19:46:52.922795] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-22T19:46:52.939272] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:46:53.717668] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-22T19:46:53.867405] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T19:46:54.430737] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T19:46:54.517662] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-22T19:46:55.317729] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-22T19:46:55.491739] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T19:46:56.123458] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-22T19:46:56.138395] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T19:46:56.551170] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T19:46:56.917731] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-22T19:46:57.717731] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-22T19:46:58.508344] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-22T19:46:58.516973] [INFO ] [REMOTE ] MA: Full fetch complete (76405 records). [2025-10-22T19:46:58.517110] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-22T19:46:58.548808] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-22T19:46:58.949844] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-22T19:46:58.950214] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-22T19:46:58.951365] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-22T19:46:58.951959] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-22T19:46:58.953669] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T19:46:58.965882] [DEBUG] [LOCAL ] MA: Trimmed 76405 records to 52451 (keeping 200 days of data) [2025-10-22T19:46:59.312484] [DEBUG] [LOCAL ] MA: Primary data saved (52451 records). [2025-10-22T19:46:59.312632] [INFO ] [MAIN ] MA: Full history saved. [2025-10-22T19:46:59.312750] [INFO ] [MAIN ] Update Progress: 1296/2367 symbols completed. MA took 37.1s. Estimated remaining: 2h 17m 56s. Rate: 7.8 symbols/min [2025-10-22T19:46:59.343779] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-22T19:46:59.523754] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:59.526101] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T19:46:59.575016] [DEBUG] [LOCAL ] MAIN: Loaded 41978 existing records from primary storage. [2025-10-22T19:46:59.575296] [INFO ] [MAIN ] MAIN: Loaded 41978 existing records. [2025-10-22T19:46:59.760841] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:59.761320] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-22T19:46:59.761390] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-22T19:46:59.761793] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-22T19:46:59.761895] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-22T19:46:59.942840] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T19:47:00.131725] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-22T19:47:00.177540] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:00.917723] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-22T19:47:01.354668] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-22T19:47:01.362784] [INFO ] [REMOTE ] MAC: Full fetch complete (71565 records). [2025-10-22T19:47:01.362926] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-22T19:47:01.728422] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-22T19:47:01.805347] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-22T19:47:01.805715] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-22T19:47:01.808174] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-22T19:47:01.806980] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T19:47:01.808358] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-22T19:47:01.818996] [DEBUG] [LOCAL ] MAC: Trimmed 71565 records to 49610 (keeping 200 days of data) [2025-10-22T19:47:02.123745] [DEBUG] [LOCAL ] MAC: Primary data saved (49610 records). [2025-10-22T19:47:02.123884] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-22T19:47:02.123960] [INFO ] [MAIN ] Update Progress: 1297/2367 symbols completed. MAC took 27.5s. Estimated remaining: 2h 17m 44s. Rate: 7.8 symbols/min [2025-10-22T19:47:02.295604] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:02.335045] [DEBUG] [LOCAL ] MAN: Loaded 44311 existing records from primary storage. [2025-10-22T19:47:02.335334] [INFO ] [MAIN ] MAN: Loaded 44311 existing records. [2025-10-22T19:47:02.516138] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:02.516564] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-22T19:47:02.516632] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-22T19:47:02.517005] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-22T19:47:02.517115] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-22T19:47:02.528346] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-22T19:47:02.607734] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T19:47:02.649104] [INFO ] [REMOTE ] MAA: Full fetch complete (61877 records). [2025-10-22T19:47:02.655039] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-22T19:47:03.192957] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:03.316899] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-22T19:47:03.317058] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-22T19:47:03.318126] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-22T19:47:03.318268] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-22T19:47:03.318194] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-22T19:47:03.320246] [DEBUG] [LOCAL ] MAA: Trimmed 61877 records to 43002 (keeping 200 days of data) [2025-10-22T19:47:03.573509] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T19:47:03.624322] [DEBUG] [LOCAL ] MAA: Primary data saved (43002 records). [2025-10-22T19:47:03.624452] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-22T19:47:03.624533] [INFO ] [MAIN ] Update Progress: 1298/2367 symbols completed. MAA took 32.1s. Estimated remaining: 2h 17m 31s. Rate: 7.8 symbols/min [2025-10-22T19:47:03.792008] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:03.819416] [DEBUG] [LOCAL ] MANU: Loaded 27249 existing records from primary storage. [2025-10-22T19:47:03.819692] [INFO ] [MAIN ] MANU: Loaded 27249 existing records. [2025-10-22T19:47:03.995533] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:03.995752] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-22T19:47:03.995803] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-22T19:47:03.996002] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-22T19:47:03.996057] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-22T19:47:04.144399] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-22T19:47:04.307378] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T19:47:04.397722] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:04.917728] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-22T19:47:04.948488] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:47:05.717672] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-22T19:47:05.865517] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T19:47:06.318437] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T19:47:06.517632] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-22T19:47:06.728212] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T19:47:07.317675] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-22T19:47:07.855595] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T19:47:08.117673] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-22T19:47:08.908239] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:47:08.921790] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-22T19:47:09.717631] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-22T19:47:09.839055] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T19:47:09.846179] [INFO ] [REMOTE ] MAGN: Full fetch complete (51867 records). [2025-10-22T19:47:09.846284] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-22T19:47:10.169116] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T19:47:10.245492] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-22T19:47:10.245580] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-22T19:47:10.246383] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-22T19:47:10.246444] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-22T19:47:10.247464] [DEBUG] [LOCAL ] MAGN: Trimmed 51867 records to 36149 (keeping 200 days of data) [2025-10-22T19:47:10.457912] [DEBUG] [LOCAL ] MAGN: Primary data saved (36149 records). [2025-10-22T19:47:10.458075] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-22T19:47:10.458173] [INFO ] [MAIN ] Update Progress: 1299/2367 symbols completed. MAGN took 27.5s. Estimated remaining: 2h 17m 23s. Rate: 7.8 symbols/min [2025-10-22T19:47:10.522784] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-22T19:47:10.628692] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:10.682197] [DEBUG] [LOCAL ] MAS: Loaded 52251 existing records from primary storage. [2025-10-22T19:47:10.682503] [INFO ] [MAIN ] MAS: Loaded 52251 existing records. [2025-10-22T19:47:10.858096] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:10.858326] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-22T19:47:10.858381] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-22T19:47:10.858591] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-22T19:47:10.858698] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-22T19:47:11.222067] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:11.317618] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-22T19:47:11.413044] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:47:11.476545] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T19:47:12.117673] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-22T19:47:12.917628] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-22T19:47:13.038254] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T19:47:13.429402] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T19:47:13.717697] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-22T19:47:14.517673] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-22T19:47:14.565329] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T19:47:15.317627] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-22T19:47:15.575918] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T19:47:15.713436] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T19:47:16.117692] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-22T19:47:16.583766] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T19:47:16.917637] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-22T19:47:17.181736] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T19:47:17.717682] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-22T19:47:18.341705] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T19:47:18.517632] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-22T19:47:19.259442] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T19:47:19.317608] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-22T19:47:19.983617] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T19:47:20.117693] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-22T19:47:20.917627] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-22T19:47:20.998959] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T19:47:21.717713] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-22T19:47:21.820016] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:47:22.517737] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-22T19:47:22.573816] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T19:47:22.931094] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T19:47:23.317623] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-22T19:47:24.117713] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-22T19:47:24.230940] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:47:24.619172] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T19:47:24.917715] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-22T19:47:25.689017] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T19:47:25.717637] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-22T19:47:26.517709] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-22T19:47:26.595981] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T19:47:27.232444] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:47:27.254303] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T19:47:27.317670] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-22T19:47:28.117779] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-22T19:47:28.723413] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T19:47:28.917720] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-22T19:47:29.717725] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-22T19:47:29.997513] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T19:47:30.517636] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-22T19:47:30.627780] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T19:47:31.317678] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-22T19:47:31.464292] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T19:47:31.475199] [INFO ] [REMOTE ] MAN: Full fetch complete (62855 records). [2025-10-22T19:47:31.475351] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-22T19:47:31.949207] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-22T19:47:31.949296] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-22T19:47:31.950335] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-22T19:47:31.950402] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-22T19:47:31.951739] [DEBUG] [LOCAL ] MAN: Trimmed 62855 records to 44306 (keeping 200 days of data) [2025-10-22T19:47:32.125992] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-22T19:47:32.228911] [DEBUG] [LOCAL ] MAN: Primary data saved (44306 records). [2025-10-22T19:47:32.229180] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-22T19:47:32.229327] [INFO ] [MAIN ] Update Progress: 1300/2367 symbols completed. MAN took 30.1s. Estimated remaining: 2h 17m 27s. Rate: 7.8 symbols/min [2025-10-22T19:47:32.441932] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:32.443466] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T19:47:32.484539] [DEBUG] [LOCAL ] MATV: Loaded 35183 existing records from primary storage. [2025-10-22T19:47:32.484925] [INFO ] [MAIN ] MATV: Loaded 35183 existing records. [2025-10-22T19:47:32.663216] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:32.663428] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-22T19:47:32.663492] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-22T19:47:32.663883] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-22T19:47:32.663939] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-22T19:47:32.918206] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-22T19:47:33.035259] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:33.064831] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T19:47:33.612195] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:47:33.617765] [INFO ] [REMOTE ] MANU: Full fetch complete (39418 records). [2025-10-22T19:47:33.617869] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-22T19:47:33.726260] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-22T19:47:34.024021] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-22T19:47:34.024106] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-22T19:47:34.024853] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-22T19:47:34.024916] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-22T19:47:34.025819] [DEBUG] [LOCAL ] MANU: Trimmed 39418 records to 27190 (keeping 200 days of data) [2025-10-22T19:47:34.174493] [DEBUG] [LOCAL ] MANU: Primary data saved (27190 records). [2025-10-22T19:47:34.174627] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-22T19:47:34.174738] [INFO ] [MAIN ] Update Progress: 1301/2367 symbols completed. MANU took 30.6s. Estimated remaining: 2h 17m 14s. Rate: 7.8 symbols/min [2025-10-22T19:47:34.361196] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:34.391167] [DEBUG] [LOCAL ] MATX: Loaded 31987 existing records from primary storage. [2025-10-22T19:47:34.391496] [INFO ] [MAIN ] MATX: Loaded 31987 existing records. [2025-10-22T19:47:34.527968] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-22T19:47:34.569898] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:34.570063] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-22T19:47:34.570110] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-22T19:47:34.570347] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-22T19:47:34.570384] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-22T19:47:34.906925] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T19:47:34.970001] [INFO ] [REMOTE ] MAIN: Full fetch complete (60414 records). [2025-10-22T19:47:34.976767] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:34.977439] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-22T19:47:35.248979] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T19:47:35.318607] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-22T19:47:35.413539] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-22T19:47:35.413616] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-22T19:47:35.414616] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-22T19:47:35.414702] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-22T19:47:35.415903] [DEBUG] [LOCAL ] MAIN: Trimmed 60414 records to 41940 (keeping 200 days of data) [2025-10-22T19:47:35.668294] [DEBUG] [LOCAL ] MAIN: Primary data saved (41940 records). [2025-10-22T19:47:35.668422] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-22T19:47:35.668501] [INFO ] [MAIN ] Update Progress: 1302/2367 symbols completed. MAIN took 36.4s. Estimated remaining: 2h 17m 1s. Rate: 7.8 symbols/min [2025-10-22T19:47:35.839150] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:35.867379] [DEBUG] [LOCAL ] MAX: Loaded 30845 existing records from primary storage. [2025-10-22T19:47:35.867660] [INFO ] [MAIN ] MAX: Loaded 30845 existing records. [2025-10-22T19:47:36.048147] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:36.048425] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-22T19:47:36.048475] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-22T19:47:36.048708] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-22T19:47:36.048763] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-22T19:47:36.118742] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-22T19:47:36.434411] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:36.469912] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:47:36.497191] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T19:47:36.917687] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-22T19:47:37.538728] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T19:47:37.717624] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-22T19:47:38.194346] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T19:47:38.517668] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-22T19:47:39.303626] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:47:39.317603] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-22T19:47:39.771434] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T19:47:40.117684] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-22T19:47:40.876304] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:47:40.917680] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-22T19:47:41.717693] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-22T19:47:41.801699] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:47:42.366283] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T19:47:42.517705] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-22T19:47:43.122483] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T19:47:43.317778] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-22T19:47:43.990639] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T19:47:44.117770] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-22T19:47:44.646502] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T19:47:44.917756] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-22T19:47:45.717701] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-22T19:47:45.911420] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T19:47:45.920750] [INFO ] [REMOTE ] MAS: Full fetch complete (75407 records). [2025-10-22T19:47:45.920927] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-22T19:47:46.359845] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-22T19:47:46.359959] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-22T19:47:46.361177] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-22T19:47:46.361608] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-22T19:47:46.386460] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T19:47:46.386670] [DEBUG] [LOCAL ] MAS: Trimmed 75407 records to 52226 (keeping 200 days of data) [2025-10-22T19:47:46.517806] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-22T19:47:46.739064] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T19:47:46.754063] [DEBUG] [LOCAL ] MAS: Primary data saved (52226 records). [2025-10-22T19:47:46.754164] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-22T19:47:46.754691] [INFO ] [MAIN ] Update Progress: 1303/2367 symbols completed. MAS took 36.3s. Estimated remaining: 2h 16m 57s. Rate: 7.8 symbols/min [2025-10-22T19:47:46.920272] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:46.960894] [DEBUG] [LOCAL ] MBC: Loaded 43908 existing records from primary storage. [2025-10-22T19:47:46.961196] [INFO ] [MAIN ] MBC: Loaded 43908 existing records. [2025-10-22T19:47:47.132109] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:47.132321] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-22T19:47:47.132388] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-22T19:47:47.132624] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-22T19:47:47.132706] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-22T19:47:47.322787] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-22T19:47:47.478883] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:47.766820] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T19:47:48.117711] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-22T19:47:48.835089] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T19:47:48.890112] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T19:47:48.917674] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-22T19:47:49.717696] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-22T19:47:50.041255] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T19:47:50.517622] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-22T19:47:51.091243] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T19:47:51.317669] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-22T19:47:52.002165] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T19:47:52.117684] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-22T19:47:52.520182] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T19:47:52.917688] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-22T19:47:53.509543] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T19:47:53.717764] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-22T19:47:54.424604] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T19:47:54.517708] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-22T19:47:54.885636] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-22T19:47:55.317700] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-22T19:47:56.117637] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-22T19:47:56.874003] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T19:47:56.917638] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-22T19:47:57.278246] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T19:47:57.559808] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (3.04 seconds). [2025-10-22T19:47:57.717684] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-22T19:47:58.243310] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T19:47:58.517721] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-22T19:47:58.904333] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T19:47:59.317735] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-22T19:47:59.468314] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T19:48:00.117719] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-22T19:48:00.788385] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T19:48:00.917679] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-22T19:48:01.524745] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T19:48:01.529901] [INFO ] [REMOTE ] MATV: Full fetch complete (52146 records). [2025-10-22T19:48:01.530033] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-22T19:48:01.722829] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-22T19:48:01.913118] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-22T19:48:01.913207] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-22T19:48:01.914053] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-22T19:48:01.914119] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-22T19:48:01.915311] [DEBUG] [LOCAL ] MATV: Trimmed 52146 records to 35045 (keeping 200 days of data) [2025-10-22T19:48:02.124751] [DEBUG] [LOCAL ] MATV: Primary data saved (35045 records). [2025-10-22T19:48:02.124924] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-22T19:48:02.125062] [INFO ] [MAIN ] Update Progress: 1304/2367 symbols completed. MATV took 29.9s. Estimated remaining: 2h 16m 55s. Rate: 7.8 symbols/min [2025-10-22T19:48:02.299778] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:02.321897] [DEBUG] [LOCAL ] MBI: Loaded 24151 existing records from primary storage. [2025-10-22T19:48:02.322163] [INFO ] [MAIN ] MBI: Loaded 24151 existing records. [2025-10-22T19:48:02.507510] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:02.507928] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-22T19:48:02.508018] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-22T19:48:02.508216] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-22T19:48:02.508313] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-22T19:48:02.522814] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-22T19:48:02.638290] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T19:48:02.936005] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:03.317726] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-22T19:48:03.979559] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T19:48:04.117683] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-22T19:48:04.399584] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-22T19:48:04.546413] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T19:48:04.917691] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-22T19:48:05.468433] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T19:48:05.717674] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-22T19:48:06.492163] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T19:48:06.517620] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-22T19:48:06.833278] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T19:48:07.317673] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-22T19:48:08.117728] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-22T19:48:08.620740] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T19:48:08.917623] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-22T19:48:09.348882] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-22T19:48:09.376681] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T19:48:09.717691] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-22T19:48:10.391001] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T19:48:10.396326] [INFO ] [REMOTE ] MATX: Full fetch complete (43870 records). [2025-10-22T19:48:10.396418] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-22T19:48:10.532112] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-22T19:48:10.766562] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-22T19:48:10.766637] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-22T19:48:10.767415] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-22T19:48:10.767459] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-22T19:48:10.768331] [DEBUG] [LOCAL ] MATX: Trimmed 43870 records to 31898 (keeping 200 days of data) [2025-10-22T19:48:10.959211] [DEBUG] [LOCAL ] MATX: Primary data saved (31898 records). [2025-10-22T19:48:10.959339] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-22T19:48:10.959416] [INFO ] [MAIN ] Update Progress: 1305/2367 symbols completed. MATX took 36.8s. Estimated remaining: 2h 16m 48s. Rate: 7.8 symbols/min [2025-10-22T19:48:11.126245] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:11.164454] [DEBUG] [LOCAL ] MC: Loaded 43725 existing records from primary storage. [2025-10-22T19:48:11.164766] [INFO ] [MAIN ] MC: Loaded 43725 existing records. [2025-10-22T19:48:11.348901] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:11.348966] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-22T19:48:11.350105] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-22T19:48:11.350159] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-22T19:48:11.350417] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-22T19:48:11.350473] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-22T19:48:11.656016] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T19:48:11.742161] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:11.742255] [INFO ] [REMOTE ] MBC: Full fetch complete (63145 records). [2025-10-22T19:48:11.742427] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-22T19:48:11.949232] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T19:48:12.130853] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-22T19:48:12.187197] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-22T19:48:12.187288] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-22T19:48:12.188327] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-22T19:48:12.188394] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-22T19:48:12.189817] [DEBUG] [LOCAL ] MBC: Trimmed 63145 records to 43879 (keeping 200 days of data) [2025-10-22T19:48:12.439786] [DEBUG] [LOCAL ] MBC: Primary data saved (43879 records). [2025-10-22T19:48:12.439922] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-22T19:48:12.440431] [INFO ] [MAIN ] Update Progress: 1306/2367 symbols completed. MBC took 25.7s. Estimated remaining: 2h 16m 35s. Rate: 7.8 symbols/min [2025-10-22T19:48:12.608936] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:12.622501] [DEBUG] [LOCAL ] MCB: Loaded 11340 existing records from primary storage. [2025-10-22T19:48:12.622789] [INFO ] [MAIN ] MCB: Loaded 11340 existing records. [2025-10-22T19:48:12.801515] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:12.801750] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-22T19:48:12.801822] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-22T19:48:12.801995] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-22T19:48:12.802051] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-22T19:48:12.923201] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-22T19:48:13.072948] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T19:48:13.105799] [INFO ] [REMOTE ] MAX: Full fetch complete (45195 records). [2025-10-22T19:48:13.119999] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T19:48:13.119524] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-22T19:48:13.303238] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:13.567623] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-22T19:48:13.567727] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-22T19:48:13.568482] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-22T19:48:13.568529] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-22T19:48:13.569420] [DEBUG] [LOCAL ] MAX: Trimmed 45195 records to 30725 (keeping 200 days of data) [2025-10-22T19:48:13.722573] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-22T19:48:13.741427] [DEBUG] [LOCAL ] MAX: Primary data saved (30725 records). [2025-10-22T19:48:13.741506] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-22T19:48:13.741620] [INFO ] [MAIN ] Update Progress: 1307/2367 symbols completed. MAX took 38.1s. Estimated remaining: 2h 16m 22s. Rate: 7.8 symbols/min [2025-10-22T19:48:13.905142] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:13.905313] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-22T19:48:13.905350] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-22T19:48:13.905455] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-22T19:48:13.905495] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-22T19:48:13.905535] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-22T19:48:13.905567] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-22T19:48:14.252377] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:14.434179] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T19:48:14.517608] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-22T19:48:14.602286] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T19:48:15.317695] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-22T19:48:16.014575] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-22T19:48:16.117729] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-22T19:48:16.832838] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-22T19:48:16.917625] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-22T19:48:17.717716] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-22T19:48:18.105906] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T19:48:18.517719] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-22T19:48:18.600630] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T19:48:18.642462] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T19:48:19.216276] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T19:48:19.317702] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-22T19:48:20.117629] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-22T19:48:20.426505] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T19:48:20.917689] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-22T19:48:21.717690] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-22T19:48:22.059937] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T19:48:22.517631] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-22T19:48:22.609906] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:48:22.829381] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T19:48:23.317731] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-22T19:48:23.797804] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T19:48:24.117672] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-22T19:48:24.917672] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-22T19:48:25.623472] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-22T19:48:25.704338] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:48:25.717601] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-22T19:48:25.990731] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T19:48:26.517690] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-22T19:48:26.533258] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T19:48:27.317678] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-22T19:48:27.778016] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T19:48:27.782130] [INFO ] [REMOTE ] MBI: Full fetch complete (35927 records). [2025-10-22T19:48:27.782213] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-22T19:48:28.126784] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-22T19:48:28.167127] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-22T19:48:28.167204] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-22T19:48:28.167979] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-22T19:48:28.168042] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-22T19:48:28.168902] [DEBUG] [LOCAL ] MBI: Trimmed 35927 records to 23968 (keeping 200 days of data) [2025-10-22T19:48:28.296724] [DEBUG] [LOCAL ] MBI: Primary data saved (23968 records). [2025-10-22T19:48:28.296837] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-22T19:48:28.296911] [INFO ] [MAIN ] Update Progress: 1308/2367 symbols completed. MBI took 26.2s. Estimated remaining: 2h 16m 20s. Rate: 7.8 symbols/min [2025-10-22T19:48:28.469187] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:28.477082] [DEBUG] [LOCAL ] MCI: Loaded 6222 existing records from primary storage. [2025-10-22T19:48:28.477254] [INFO ] [MAIN ] MCI: Loaded 6222 existing records. [2025-10-22T19:48:28.666875] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:28.667955] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-22T19:48:28.668049] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-22T19:48:28.669989] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-22T19:48:28.670064] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-22T19:48:28.917917] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-22T19:48:28.990151] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T19:48:29.078111] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:29.121347] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T19:48:29.717634] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-22T19:48:30.517774] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-22T19:48:30.545620] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T19:48:31.151259] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-22T19:48:31.317672] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-22T19:48:31.530407] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T19:48:32.117686] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-22T19:48:32.132073] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T19:48:32.917689] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-22T19:48:33.087532] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T19:48:33.717674] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-22T19:48:33.871014] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T19:48:33.873882] [INFO ] [REMOTE ] MCB: Full fetch complete (16680 records). [2025-10-22T19:48:33.874013] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-22T19:48:34.236991] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-22T19:48:34.237084] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-22T19:48:34.237431] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-22T19:48:34.237470] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-22T19:48:34.238008] [DEBUG] [LOCAL ] MCB: Trimmed 16680 records to 11254 (keeping 200 days of data) [2025-10-22T19:48:34.308249] [DEBUG] [LOCAL ] MCB: Primary data saved (11254 records). [2025-10-22T19:48:34.308376] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-22T19:48:34.308452] [INFO ] [MAIN ] Update Progress: 1309/2367 symbols completed. MCB took 21.9s. Estimated remaining: 2h 16m 11s. Rate: 7.8 symbols/min [2025-10-22T19:48:34.480792] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:34.507419] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T19:48:34.522037] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-22T19:48:34.523975] [DEBUG] [LOCAL ] MCK: Loaded 38187 existing records from primary storage. [2025-10-22T19:48:34.524280] [INFO ] [MAIN ] MCK: Loaded 38187 existing records. [2025-10-22T19:48:34.700275] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:34.700489] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-22T19:48:34.700543] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-22T19:48:34.700772] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-22T19:48:34.700833] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-22T19:48:35.056828] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:35.317669] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-22T19:48:36.117695] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-22T19:48:36.189057] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T19:48:36.713218] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-22T19:48:36.917694] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-22T19:48:36.976839] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:48:37.717701] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-22T19:48:38.517674] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-22T19:48:39.165243] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-22T19:48:39.317636] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-22T19:48:39.342860] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T19:48:40.114776] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T19:48:40.123265] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-22T19:48:40.884307] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T19:48:40.917718] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-22T19:48:41.345249] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-22T19:48:41.717679] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-22T19:48:42.406528] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T19:48:42.517693] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-22T19:48:43.062844] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T19:48:43.317694] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-22T19:48:44.117671] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-22T19:48:44.315600] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T19:48:44.323460] [INFO ] [REMOTE ] MC: Full fetch complete (63158 records). [2025-10-22T19:48:44.323604] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-22T19:48:44.726334] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-22T19:48:44.726469] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-22T19:48:44.727429] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-22T19:48:44.727530] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-22T19:48:44.728870] [DEBUG] [LOCAL ] MC: Trimmed 63158 records to 43670 (keeping 200 days of data) [2025-10-22T19:48:44.932600] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-22T19:48:44.988907] [DEBUG] [LOCAL ] MC: Primary data saved (43670 records). [2025-10-22T19:48:44.989032] [INFO ] [MAIN ] MC: Full history saved. [2025-10-22T19:48:44.989110] [INFO ] [MAIN ] Update Progress: 1310/2367 symbols completed. MC took 34.0s. Estimated remaining: 2h 16m 6s. Rate: 7.8 symbols/min [2025-10-22T19:48:45.162960] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:45.163258] [DEBUG] [LOCAL ] MCN: No existing data file found in primary storage. [2025-10-22T19:48:45.163357] [WARN ] [MAIN ] MCN: No existing data found, performing full refresh instead. [2025-10-22T19:48:45.163609] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-22T19:48:45.163710] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-22T19:48:45.163773] [DEBUG] [LOCAL ] MCN: No primary data file found to delete. [2025-10-22T19:48:45.163809] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-22T19:48:45.304982] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T19:48:45.552007] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:45.664910] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T19:48:45.717616] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-22T19:48:46.324165] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T19:48:46.414563] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-22T19:48:46.517709] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-22T19:48:47.317682] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-22T19:48:48.117678] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-22T19:48:48.731706] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-22T19:48:48.825830] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-22T19:48:48.870888] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T19:48:48.917617] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-22T19:48:49.717713] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-22T19:48:50.322201] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T19:48:50.450699] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T19:48:50.517625] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-22T19:48:51.317690] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-22T19:48:52.020938] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T19:48:52.050503] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T19:48:52.117675] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-22T19:48:52.917691] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-22T19:48:53.665613] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T19:48:53.667125] [INFO ] [REMOTE ] MCI: Full fetch complete (9780 records). [2025-10-22T19:48:53.667193] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-22T19:48:53.731513] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-22T19:48:54.029127] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T19:48:54.105455] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-22T19:48:54.105542] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-22T19:48:54.105873] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-22T19:48:54.105940] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-22T19:48:54.106462] [DEBUG] [LOCAL ] MCI: Trimmed 9780 records to 6182 (keeping 200 days of data) [2025-10-22T19:48:54.152601] [DEBUG] [LOCAL ] MCI: Primary data saved (6182 records). [2025-10-22T19:48:54.152849] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-22T19:48:54.152947] [INFO ] [MAIN ] Update Progress: 1311/2367 symbols completed. MCI took 25.9s. Estimated remaining: 2h 15m 59s. Rate: 7.8 symbols/min [2025-10-22T19:48:54.320458] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:54.353835] [DEBUG] [LOCAL ] MCO: Loaded 39453 existing records from primary storage. [2025-10-22T19:48:54.354130] [INFO ] [MAIN ] MCO: Loaded 39453 existing records. [2025-10-22T19:48:54.525484] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-22T19:48:54.530306] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:54.531758] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-22T19:48:54.531809] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-22T19:48:54.532207] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-22T19:48:54.532247] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-22T19:48:54.883985] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:55.317678] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-22T19:48:55.327022] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T19:48:55.848679] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T19:48:56.117690] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-22T19:48:56.792509] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T19:48:56.842287] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T19:48:56.917630] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-22T19:48:57.717723] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-22T19:48:57.750430] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T19:48:58.517693] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-22T19:48:59.212854] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T19:48:59.317628] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-22T19:49:00.122814] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-22T19:49:00.138198] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:49:00.893094] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T19:49:00.899632] [INFO ] [REMOTE ] MCK: Full fetch complete (56604 records). [2025-10-22T19:49:00.899903] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-22T19:49:00.926095] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-22T19:49:01.323338] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-22T19:49:01.323472] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-22T19:49:01.324855] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-22T19:49:01.324955] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-22T19:49:01.326921] [DEBUG] [LOCAL ] MCK: Trimmed 56604 records to 38009 (keeping 200 days of data) [2025-10-22T19:49:01.586934] [DEBUG] [LOCAL ] MCK: Primary data saved (38009 records). [2025-10-22T19:49:01.587143] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-22T19:49:01.587977] [INFO ] [MAIN ] Update Progress: 1312/2367 symbols completed. MCK took 27.3s. Estimated remaining: 2h 15m 51s. Rate: 7.8 symbols/min [2025-10-22T19:49:01.721691] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-22T19:49:01.790320] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:01.806001] [DEBUG] [LOCAL ] MCR: Loaded 8854 existing records from primary storage. [2025-10-22T19:49:01.806485] [INFO ] [MAIN ] MCR: Loaded 8854 existing records. [2025-10-22T19:49:02.018735] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:02.019213] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-22T19:49:02.019267] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-22T19:49:02.019500] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-22T19:49:02.019559] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-22T19:49:02.400129] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:02.411078] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T19:49:02.449894] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-22T19:49:02.517679] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-22T19:49:02.683789] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T19:49:03.317684] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-22T19:49:03.353102] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T19:49:04.117695] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-22T19:49:04.917628] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-22T19:49:05.052048] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T19:49:05.062052] [INFO ] [REMOTE ] MCD: Full fetch complete (77131 records). [2025-10-22T19:49:05.062239] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-22T19:49:05.275961] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T19:49:05.276909] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:49:05.277049] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:49:05.277253] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-22T19:49:05.277319] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-22T19:49:05.286895] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-22T19:49:05.286977] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-22T19:49:05.287048] [INFO ] [MAIN ] Update Progress: 1313/2367 symbols completed. MCD took 51.5s. Estimated remaining: 2h 15m 40s. Rate: 7.8 symbols/min [2025-10-22T19:49:05.380580] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T19:49:05.484238] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:05.502807] [DEBUG] [LOCAL ] MCS: Loaded 21229 existing records from primary storage. [2025-10-22T19:49:05.503036] [INFO ] [MAIN ] MCS: Loaded 21229 existing records. [2025-10-22T19:49:05.680532] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:05.680869] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-22T19:49:05.680922] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-22T19:49:05.681122] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-22T19:49:05.681162] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-22T19:49:05.723061] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-22T19:49:05.793901] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T19:49:06.049968] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:06.517686] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-22T19:49:07.317632] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-22T19:49:07.514027] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:49:07.640559] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T19:49:08.111861] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T19:49:08.117714] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-22T19:49:08.917692] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-22T19:49:09.616236] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:49:09.650868] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T19:49:09.717684] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-22T19:49:10.517687] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-22T19:49:10.531517] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T19:49:11.246350] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T19:49:11.317629] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-22T19:49:12.117628] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-22T19:49:12.191404] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T19:49:12.917672] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-22T19:49:13.560802] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T19:49:13.630111] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T19:49:13.717629] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-22T19:49:14.395129] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T19:49:14.517676] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-22T19:49:15.317668] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-22T19:49:15.334382] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T19:49:16.117723] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-22T19:49:16.918756] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T19:49:16.917718] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-22T19:49:17.299886] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T19:49:17.717679] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-22T19:49:18.517724] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-22T19:49:18.552799] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T19:49:18.554364] [INFO ] [REMOTE ] MCN: Full fetch complete (11557 records). [2025-10-22T19:49:18.554430] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-22T19:49:18.912297] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-22T19:49:18.912412] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-22T19:49:18.912727] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-22T19:49:18.912814] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-22T19:49:18.913434] [DEBUG] [LOCAL ] MCN: Trimmed 11557 records to 7984 (keeping 200 days of data) [2025-10-22T19:49:18.959502] [DEBUG] [LOCAL ] MCN: Primary data saved (7984 records). [2025-10-22T19:49:18.959793] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-22T19:49:18.959901] [INFO ] [MAIN ] Update Progress: 1314/2367 symbols completed. MCN took 34.0s. Estimated remaining: 2h 15m 37s. Rate: 7.8 symbols/min [2025-10-22T19:49:19.152114] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T19:49:19.155169] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:19.184566] [DEBUG] [LOCAL ] MCY: Loaded 23711 existing records from primary storage. [2025-10-22T19:49:19.184850] [INFO ] [MAIN ] MCY: Loaded 23711 existing records. [2025-10-22T19:49:19.322846] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-22T19:49:19.359334] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:19.359815] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-22T19:49:19.359885] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-22T19:49:19.360079] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-22T19:49:19.360136] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-22T19:49:19.692622] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T19:49:19.738256] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:20.117700] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-22T19:49:20.202903] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T19:49:20.917680] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-22T19:49:21.621597] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T19:49:21.710479] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T19:49:21.717608] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-22T19:49:22.517710] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-22T19:49:23.317772] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-22T19:49:23.571506] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T19:49:23.579079] [INFO ] [REMOTE ] MCO: Full fetch complete (58332 records). [2025-10-22T19:49:23.579178] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-22T19:49:23.959512] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-22T19:49:23.959758] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-22T19:49:23.960688] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-22T19:49:23.960848] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-22T19:49:23.982314] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T19:49:23.990455] [DEBUG] [LOCAL ] MCO: Trimmed 58332 records to 39425 (keeping 200 days of data) [2025-10-22T19:49:24.118355] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-22T19:49:24.187048] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T19:49:24.249693] [DEBUG] [LOCAL ] MCO: Primary data saved (39425 records). [2025-10-22T19:49:24.249839] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-22T19:49:24.249923] [INFO ] [MAIN ] Update Progress: 1315/2367 symbols completed. MCO took 30.1s. Estimated remaining: 2h 15m 28s. Rate: 7.8 symbols/min [2025-10-22T19:49:24.412356] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:24.446808] [DEBUG] [LOCAL ] MD: Loaded 38586 existing records from primary storage. [2025-10-22T19:49:24.447075] [INFO ] [MAIN ] MD: Loaded 38586 existing records. [2025-10-22T19:49:24.617373] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:24.617530] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-22T19:49:24.617577] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-22T19:49:24.617849] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-22T19:49:24.617904] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-22T19:49:24.922934] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-22T19:49:24.961801] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:25.595605] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:49:25.717765] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-22T19:49:26.030521] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T19:49:26.517737] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-22T19:49:26.984632] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T19:49:27.317762] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-22T19:49:27.882019] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T19:49:28.057245] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T19:49:28.117622] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-22T19:49:28.917708] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-22T19:49:29.142831] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T19:49:29.717687] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-22T19:49:30.250689] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T19:49:30.517698] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-22T19:49:30.844185] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T19:49:31.317733] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-22T19:49:31.725160] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T19:49:32.010070] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T19:49:32.117701] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-22T19:49:32.917802] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-22T19:49:33.323967] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:49:33.717724] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-22T19:49:34.424101] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T19:49:34.446324] [INFO ] [REMOTE ] MCR: Full fetch complete (13517 records). [2025-10-22T19:49:34.447836] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T19:49:34.447916] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-22T19:49:34.522887] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-22T19:49:34.820726] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-22T19:49:34.820805] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-22T19:49:34.821109] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-22T19:49:34.821148] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-22T19:49:34.821585] [DEBUG] [LOCAL ] MCR: Trimmed 13517 records to 8866 (keeping 200 days of data) [2025-10-22T19:49:34.871369] [DEBUG] [LOCAL ] MCR: Primary data saved (8866 records). [2025-10-22T19:49:34.871476] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-22T19:49:34.871551] [INFO ] [MAIN ] Update Progress: 1316/2367 symbols completed. MCR took 33.3s. Estimated remaining: 2h 15m 22s. Rate: 7.8 symbols/min [2025-10-22T19:49:35.037397] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:35.044441] [DEBUG] [LOCAL ] MDST: Loaded 6139 existing records from primary storage. [2025-10-22T19:49:35.044627] [INFO ] [MAIN ] MDST: Loaded 6139 existing records. [2025-10-22T19:49:35.218458] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:35.218731] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-22T19:49:35.218788] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-22T19:49:35.218950] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-22T19:49:35.219006] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-22T19:49:35.322924] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-22T19:49:35.577448] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:35.675408] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T19:49:36.117712] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-22T19:49:36.855369] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T19:49:36.917683] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-22T19:49:37.211775] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T19:49:37.717673] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-22T19:49:38.220087] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T19:49:38.517719] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-22T19:49:38.825621] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T19:49:39.258865] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-22T19:49:39.317617] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-22T19:49:39.769729] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T19:49:40.117734] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-22T19:49:40.917713] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-22T19:49:41.490478] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T19:49:41.518976] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T19:49:41.717659] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-22T19:49:42.153918] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-22T19:49:42.517692] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-22T19:49:43.317711] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-22T19:49:43.590101] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T19:49:44.117685] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-22T19:49:44.501427] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T19:49:44.917615] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-22T19:49:45.318990] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T19:49:45.323495] [INFO ] [REMOTE ] MCY: Full fetch complete (40808 records). [2025-10-22T19:49:45.323751] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-22T19:49:45.698380] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-22T19:49:45.698469] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-22T19:49:45.699288] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-22T19:49:45.699353] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-22T19:49:45.700337] [DEBUG] [LOCAL ] MCY: Trimmed 40808 records to 23567 (keeping 200 days of data) [2025-10-22T19:49:45.754325] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-22T19:49:45.851460] [DEBUG] [LOCAL ] MCY: Primary data saved (23567 records). [2025-10-22T19:49:45.851603] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-22T19:49:45.851716] [INFO ] [MAIN ] Update Progress: 1317/2367 symbols completed. MCY took 26.9s. Estimated remaining: 2h 15m 17s. Rate: 7.8 symbols/min [2025-10-22T19:49:46.469108] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T19:49:46.517612] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-22T19:49:47.095006] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T19:49:47.099254] [INFO ] [REMOTE ] MCS: Full fetch complete (30664 records). [2025-10-22T19:49:47.099327] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-22T19:49:47.342077] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-22T19:49:47.462431] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-22T19:49:47.462508] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-22T19:49:47.463223] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-22T19:49:47.463285] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-22T19:49:47.464116] [DEBUG] [LOCAL ] MCS: Trimmed 30664 records to 21186 (keeping 200 days of data) [2025-10-22T19:49:47.588194] [DEBUG] [LOCAL ] MCS: Primary data saved (21186 records). [2025-10-22T19:49:47.588312] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-22T19:49:47.588384] [INFO ] [MAIN ] Update Progress: 1318/2367 symbols completed. MCS took 42.3s. Estimated remaining: 2h 15m 5s. Rate: 7.8 symbols/min [2025-10-22T19:49:47.934026] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T19:49:48.024557] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T19:49:48.117702] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-22T19:49:48.917736] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-22T19:49:49.491374] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T19:49:49.548954] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T19:49:49.555694] [INFO ] [REMOTE ] MD: Full fetch complete (55277 records). [2025-10-22T19:49:49.555826] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-22T19:49:49.722767] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-22T19:49:49.963004] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-22T19:49:49.963086] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-22T19:49:49.963897] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-22T19:49:49.963959] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-22T19:49:49.965097] [DEBUG] [LOCAL ] MD: Trimmed 55277 records to 38572 (keeping 200 days of data) [2025-10-22T19:49:50.185873] [DEBUG] [LOCAL ] MD: Primary data saved (38572 records). [2025-10-22T19:49:50.186013] [INFO ] [MAIN ] MD: Full history saved. [2025-10-22T19:49:50.186090] [INFO ] [MAIN ] Update Progress: 1319/2367 symbols completed. MD took 25.9s. Estimated remaining: 2h 14m 53s. Rate: 7.8 symbols/min [2025-10-22T19:49:50.453834] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T19:49:50.517716] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-22T19:49:51.247665] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T19:49:51.317632] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-22T19:49:52.147122] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T19:49:52.149788] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-22T19:49:53.088378] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T19:49:53.090268] [INFO ] [REMOTE ] MDST: Full fetch complete (8841 records). [2025-10-22T19:49:53.090335] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-22T19:49:53.445016] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-22T19:49:53.445095] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-22T19:49:53.445311] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-22T19:49:53.445349] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-22T19:49:53.445817] [DEBUG] [LOCAL ] MDST: Trimmed 8841 records to 6110 (keeping 200 days of data) [2025-10-22T19:49:53.482059] [DEBUG] [LOCAL ] MDST: Primary data saved (6110 records). [2025-10-22T19:49:53.482187] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-22T19:49:53.482311] [INFO ] [MAIN ] Update Progress: 1320/2367 symbols completed. MDST took 18.6s. Estimated remaining: 2h 14m 42s. Rate: 7.8 symbols/min [2025-10-22T19:49:54.130923] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:54.194809] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:54.193108] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:54.189097] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:54.206791] [DEBUG] [LOCAL ] MDV: Loaded 8346 existing records from primary storage. [2025-10-22T19:49:54.207297] [INFO ] [MAIN ] MDV: Loaded 8346 existing records. [2025-10-22T19:49:54.292868] [DEBUG] [LOCAL ] MEC: Loaded 16796 existing records from primary storage. [2025-10-22T19:49:54.293120] [INFO ] [MAIN ] MEC: Loaded 16796 existing records. [2025-10-22T19:49:54.527766] [DEBUG] [LOCAL ] MDU: Loaded 48021 existing records from primary storage. [2025-10-22T19:49:54.553459] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:54.564945] [INFO ] [MAIN ] MDU: Loaded 48021 existing records. [2025-10-22T19:49:54.575943] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-22T19:49:54.698267] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:54.694862] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-22T19:49:54.727886] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-22T19:49:54.734267] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-22T19:49:54.744764] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-22T19:49:54.728744] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-22T19:49:54.760843] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-22T19:49:54.784056] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-22T19:49:54.766593] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-22T19:49:54.794357] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-22T19:49:55.043602] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:55.206247] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-22T19:49:55.355088] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-22T19:49:55.507547] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:55.527628] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-22T19:49:55.551833] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-22T19:49:55.562468] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-22T19:49:55.557226] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-22T19:49:55.669550] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-22T19:49:55.703854] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-22T19:49:55.943588] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:56.022044] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-22T19:49:56.043609] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:56.076486] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-22T19:49:56.500466] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:56.532146] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-22T19:49:56.563612] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:56.563989] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-22T19:49:56.690067] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-22T19:49:56.691920] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-22T19:49:57.184779] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T19:49:57.188127] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-22T19:49:57.327182] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T19:49:57.717692] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-22T19:49:57.736639] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-22T19:49:58.300337] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T19:49:58.331253] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T19:49:58.336022] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T19:49:58.517689] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-22T19:49:59.317727] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-22T19:50:00.127570] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-22T19:50:00.136288] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:50:00.175701] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T19:50:00.917724] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-22T19:50:01.717694] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-22T19:50:01.725875] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T19:50:01.833850] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:50:02.517673] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-22T19:50:03.317676] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-22T19:50:03.462212] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T19:50:03.510231] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T19:50:04.117685] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-22T19:50:04.917769] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-22T19:50:05.335036] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T19:50:05.717626] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-22T19:50:05.757891] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T19:50:05.884547] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T19:50:06.517689] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-22T19:50:07.317708] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-22T19:50:07.376485] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T19:50:07.627522] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T19:50:08.117674] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-22T19:50:08.917636] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-22T19:50:09.074509] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T19:50:09.717626] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-22T19:50:09.919947] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T19:50:10.164874] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T19:50:10.517735] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-22T19:50:11.116589] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T19:50:11.317637] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-22T19:50:12.117623] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-22T19:50:12.370588] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T19:50:12.766061] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T19:50:12.800951] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T19:50:12.917689] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-22T19:50:13.717669] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-22T19:50:13.895866] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-22T19:50:14.517684] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-22T19:50:15.259817] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T19:50:15.317668] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-22T19:50:16.117622] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-22T19:50:16.240061] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T19:50:16.917637] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-22T19:50:16.981031] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T19:50:17.085744] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T19:50:17.717682] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-22T19:50:17.814474] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T19:50:18.321727] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T19:50:18.517636] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-22T19:50:19.317706] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-22T19:50:19.485165] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T19:50:20.117731] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-22T19:50:20.917626] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-22T19:50:21.047924] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T19:50:21.236619] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T19:50:21.717722] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-22T19:50:22.517625] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-22T19:50:22.847792] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T19:50:22.856399] [INFO ] [REMOTE ] MDU: Full fetch complete (70688 records). [2025-10-22T19:50:22.856544] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-22T19:50:23.027319] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T19:50:23.058050] [INFO ] [REMOTE ] MEC: Full fetch complete (23146 records). [2025-10-22T19:50:23.120865] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-22T19:50:23.323817] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-22T19:50:23.422548] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-22T19:50:23.427823] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-22T19:50:23.447052] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-22T19:50:23.467346] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-22T19:50:23.594294] [DEBUG] [LOCAL ] MDU: Trimmed 70688 records to 48009 (keeping 200 days of data) [2025-10-22T19:50:23.773360] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-22T19:50:23.773985] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-22T19:50:23.777130] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-22T19:50:23.777208] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-22T19:50:23.789715] [DEBUG] [LOCAL ] MEC: Trimmed 23146 records to 16914 (keeping 200 days of data) [2025-10-22T19:50:24.059920] [DEBUG] [LOCAL ] MEC: Primary data saved (16914 records). [2025-10-22T19:50:24.070804] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-22T19:50:24.084912] [INFO ] [MAIN ] Update Progress: 1321/2367 symbols completed. MEC took 30.6s. Estimated remaining: 2h 14m 52s. Rate: 7.8 symbols/min [2025-10-22T19:50:24.084740] [DEBUG] [LOCAL ] MDU: Primary data saved (48009 records). [2025-10-22T19:50:24.085104] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-22T19:50:24.085499] [INFO ] [MAIN ] Update Progress: 1322/2367 symbols completed. MDU took 30.6s. Estimated remaining: 2h 14m 38s. Rate: 7.8 symbols/min [2025-10-22T19:50:24.377017] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T19:50:24.399589] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:24.449795] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:24.450398] [INFO ] [REMOTE ] MDV: Full fetch complete (11697 records). [2025-10-22T19:50:24.451119] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-22T19:50:24.627025] [DEBUG] [LOCAL ] MED: Loaded 21011 existing records from primary storage. [2025-10-22T19:50:24.674067] [INFO ] [MAIN ] MED: Loaded 21011 existing records. [2025-10-22T19:50:24.693819] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T19:50:24.786524] [DEBUG] [LOCAL ] MEG: Loaded 31613 existing records from primary storage. [2025-10-22T19:50:24.882919] [INFO ] [MAIN ] MEG: Loaded 31613 existing records. [2025-10-22T19:50:24.872317] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-22T19:50:25.234884] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:25.252040] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-22T19:50:25.252185] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-22T19:50:25.263483] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-22T19:50:25.268990] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-22T19:50:25.269257] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-22T19:50:25.269404] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-22T19:50:25.292037] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-22T19:50:25.297780] [DEBUG] [LOCAL ] MDV: Trimmed 11697 records to 8298 (keeping 200 days of data) [2025-10-22T19:50:25.297889] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-22T19:50:25.410018] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:25.470008] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-22T19:50:25.500374] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-22T19:50:25.509762] [DEBUG] [LOCAL ] MDV: Primary data saved (8298 records). [2025-10-22T19:50:25.510048] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-22T19:50:25.510298] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-22T19:50:25.510251] [INFO ] [MAIN ] Update Progress: 1323/2367 symbols completed. MDV took 32.0s. Estimated remaining: 2h 14m 25s. Rate: 7.8 symbols/min [2025-10-22T19:50:25.515735] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-22T19:50:26.067198] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:26.296012] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:26.301957] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-22T19:50:26.392570] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:26.393004] [DEBUG] [LOCAL ] MEGI: Loaded 19774 existing records from primary storage. [2025-10-22T19:50:26.393255] [INFO ] [MAIN ] MEGI: Loaded 19774 existing records. [2025-10-22T19:50:26.393482] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-22T19:50:26.576565] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:26.576852] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-22T19:50:26.576902] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-22T19:50:26.577130] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-22T19:50:26.577188] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-22T19:50:26.934493] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:26.934856] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-22T19:50:27.044320] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-22T19:50:27.053325] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-22T19:50:27.053581] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-22T19:50:27.452305] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-22T19:50:27.452441] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-22T19:50:27.453611] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-22T19:50:27.453716] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-22T19:50:27.469308] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T19:50:27.474871] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-22T19:50:27.476021] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 53678 (keeping 200 days of data) [2025-10-22T19:50:27.833339] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-22T19:50:27.833530] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-22T19:50:27.833805] [INFO ] [MAIN ] Update Progress: 1324/2367 symbols completed. MDT took 34.4s. Estimated remaining: 2h 14m 13s. Rate: 7.8 symbols/min [2025-10-22T19:50:28.016219] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:28.045595] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T19:50:28.072152] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T19:50:28.100170] [DEBUG] [LOCAL ] MEI: Loaded 31387 existing records from primary storage. [2025-10-22T19:50:28.100469] [INFO ] [MAIN ] MEI: Loaded 31387 existing records. [2025-10-22T19:50:28.122901] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-22T19:50:28.284773] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:28.284982] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-22T19:50:28.285049] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-22T19:50:28.285394] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-22T19:50:28.285449] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-22T19:50:28.638863] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:28.701974] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T19:50:28.874883] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T19:50:28.917635] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-22T19:50:29.717682] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-22T19:50:30.165561] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T19:50:30.517710] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-22T19:50:30.952311] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T19:50:31.317627] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-22T19:50:31.710795] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T19:50:32.117697] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-22T19:50:32.442551] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T19:50:32.917688] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-22T19:50:33.537394] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T19:50:33.717709] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-22T19:50:33.901927] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T19:50:34.517636] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-22T19:50:34.842876] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T19:50:35.317670] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-22T19:50:35.885130] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T19:50:36.117709] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-22T19:50:36.782770] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T19:50:36.917675] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-22T19:50:37.250792] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:50:37.717734] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-22T19:50:37.900787] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T19:50:38.517703] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-22T19:50:38.662875] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T19:50:39.317690] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-22T19:50:39.968925] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T19:50:40.117663] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-22T19:50:40.307813] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T19:50:40.919089] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-22T19:50:40.922691] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T19:50:41.717709] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-22T19:50:42.348684] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:50:42.517634] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-22T19:50:42.902082] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T19:50:43.317731] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-22T19:50:43.967210] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T19:50:44.117683] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-22T19:50:44.804261] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:50:44.922496] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-22T19:50:44.927190] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T19:50:45.717636] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-22T19:50:46.517677] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-22T19:50:46.703080] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T19:50:46.806246] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T19:50:47.317685] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-22T19:50:47.580327] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T19:50:48.117680] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-22T19:50:48.352434] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T19:50:48.917693] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-22T19:50:49.179444] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T19:50:49.717717] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-22T19:50:49.919697] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:50:50.517693] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-22T19:50:51.135546] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T19:50:51.317633] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-22T19:50:51.592073] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T19:50:51.595362] [INFO ] [REMOTE ] MEGI: Full fetch complete (28976 records). [2025-10-22T19:50:51.595444] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-22T19:50:52.023921] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-22T19:50:52.024261] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-22T19:50:52.024975] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-22T19:50:52.025058] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-22T19:50:52.026107] [DEBUG] [LOCAL ] MEGI: Trimmed 28976 records to 19699 (keeping 200 days of data) [2025-10-22T19:50:52.118436] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-22T19:50:52.157568] [DEBUG] [LOCAL ] MEGI: Primary data saved (19699 records). [2025-10-22T19:50:52.157765] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-22T19:50:52.157877] [INFO ] [MAIN ] Update Progress: 1325/2367 symbols completed. MEGI took 26.6s. Estimated remaining: 2h 14m 19s. Rate: 7.8 symbols/min [2025-10-22T19:50:52.350708] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:52.399753] [DEBUG] [LOCAL ] MET: Loaded 53305 existing records from primary storage. [2025-10-22T19:50:52.400109] [INFO ] [MAIN ] MET: Loaded 53305 existing records. [2025-10-22T19:50:52.528166] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T19:50:52.574179] [INFO ] [REMOTE ] MED: Full fetch complete (31822 records). [2025-10-22T19:50:52.574947] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-22T19:50:52.627119] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:52.686349] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-22T19:50:52.696742] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-22T19:50:52.702476] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-22T19:50:52.723140] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-22T19:50:52.959364] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-22T19:50:53.338737] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-22T19:50:53.347359] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-22T19:50:53.350115] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-22T19:50:53.350473] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-22T19:50:53.371571] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:53.372701] [DEBUG] [LOCAL ] MED: Trimmed 31822 records to 20919 (keeping 200 days of data) [2025-10-22T19:50:53.508469] [DEBUG] [LOCAL ] MED: Primary data saved (20919 records). [2025-10-22T19:50:53.508672] [INFO ] [MAIN ] MED: Full history saved. [2025-10-22T19:50:53.508794] [INFO ] [MAIN ] Update Progress: 1326/2367 symbols completed. MED took 29.4s. Estimated remaining: 2h 14m 6s. Rate: 7.8 symbols/min [2025-10-22T19:50:53.737406] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-22T19:50:53.753202] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:53.809016] [DEBUG] [LOCAL ] MFA: Loaded 45661 existing records from primary storage. [2025-10-22T19:50:53.809588] [INFO ] [MAIN ] MFA: Loaded 45661 existing records. [2025-10-22T19:50:54.112704] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:54.113105] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-22T19:50:54.113181] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-22T19:50:54.113578] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-22T19:50:54.113690] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-22T19:50:54.688536] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:54.689240] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-22T19:50:54.853334] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T19:50:55.055817] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T19:50:55.317736] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-22T19:50:55.932134] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T19:50:56.117725] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-22T19:50:56.811305] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:50:56.817382] [INFO ] [REMOTE ] MEG: Full fetch complete (47472 records). [2025-10-22T19:50:56.817575] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-22T19:50:56.921483] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-22T19:50:57.232050] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-22T19:50:57.232194] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-22T19:50:57.233148] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-22T19:50:57.233273] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-22T19:50:57.257635] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (5.14 seconds). [2025-10-22T19:50:57.256753] [DEBUG] [LOCAL ] MEG: Trimmed 47472 records to 31527 (keeping 200 days of data) [2025-10-22T19:50:57.448578] [DEBUG] [LOCAL ] MEG: Primary data saved (31527 records). [2025-10-22T19:50:57.448751] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-22T19:50:57.448846] [INFO ] [MAIN ] Update Progress: 1327/2367 symbols completed. MEG took 33.4s. Estimated remaining: 2h 13m 55s. Rate: 7.8 symbols/min [2025-10-22T19:50:57.615325] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:57.622253] [DEBUG] [LOCAL ] MFAN: Loaded 4348 existing records from primary storage. [2025-10-22T19:50:57.622453] [INFO ] [MAIN ] MFAN: Loaded 4348 existing records. [2025-10-22T19:50:57.723979] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-22T19:50:57.804460] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:57.804717] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-22T19:50:57.804772] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-22T19:50:57.804927] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-22T19:50:57.804982] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-22T19:50:58.176188] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:58.244280] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-22T19:50:58.525325] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-22T19:50:58.540334] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:50:58.864465] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-22T19:50:59.096070] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T19:50:59.317679] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-22T19:50:59.756778] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T19:51:00.117687] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-22T19:51:00.917688] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-22T19:51:01.503638] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T19:51:01.717778] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-22T19:51:02.221358] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T19:51:02.353368] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T19:51:02.517704] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-22T19:51:03.317721] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-22T19:51:04.117693] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-22T19:51:04.445128] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T19:51:04.771182] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:51:04.917721] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-22T19:51:05.515052] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T19:51:05.722808] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-22T19:51:05.746407] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:51:06.517695] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-22T19:51:07.089292] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T19:51:07.159383] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:51:07.164588] [INFO ] [REMOTE ] MEI: Full fetch complete (45360 records). [2025-10-22T19:51:07.164781] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-22T19:51:07.322581] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-22T19:51:07.568478] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-22T19:51:07.568562] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-22T19:51:07.569470] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-22T19:51:07.569566] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-22T19:51:07.570736] [DEBUG] [LOCAL ] MEI: Trimmed 45360 records to 31216 (keeping 200 days of data) [2025-10-22T19:51:07.751415] [DEBUG] [LOCAL ] MEI: Primary data saved (31216 records). [2025-10-22T19:51:07.751545] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-22T19:51:07.751630] [INFO ] [MAIN ] Update Progress: 1328/2367 symbols completed. MEI took 39.9s. Estimated remaining: 2h 13m 50s. Rate: 7.8 symbols/min [2025-10-22T19:51:07.931116] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:51:07.937551] [DEBUG] [LOCAL ] MFAO: Loaded 3968 existing records from primary storage. [2025-10-22T19:51:07.937851] [INFO ] [MAIN ] MFAO: Loaded 3968 existing records. [2025-10-22T19:51:08.120553] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:51:08.120732] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-22T19:51:08.121234] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-22T19:51:08.122551] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-22T19:51:08.122763] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-22T19:51:08.122821] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-22T19:51:08.498064] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:51:08.917685] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-22T19:51:09.125715] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T19:51:09.460440] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-22T19:51:09.717679] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-22T19:51:09.839712] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:51:10.201064] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-22T19:51:10.517690] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-22T19:51:11.317692] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-22T19:51:11.923292] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T19:51:12.117715] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-22T19:51:12.395705] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T19:51:12.675425] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T19:51:12.917625] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-22T19:51:13.323146] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-22T19:51:13.717674] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-22T19:51:14.471890] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T19:51:14.473250] [INFO ] [REMOTE ] MFAN: Full fetch complete (5978 records). [2025-10-22T19:51:14.473318] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-22T19:51:14.528159] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-22T19:51:14.831809] [DEBUG] [VALIDATOR ] MFAN: A